![]() |
![]() |
#1 |
Can I have a cookie
Join Date: Jun 2008
Location: Wasilla, Alaska, US
Posts: 707
|
Cyoc down
So as I'm sure alot of people have noticed, CYOC has gone down now for several days in a row. Looks like there database is down or something. Ironically, I've been afraid of sites disappearing lately and was in the process of making my own kind of backup database of the chapters. I've got about 3500+ entries. I don't scan every day and I respect there wait rules which is 10 seconds, so I don't end up ddosing there site lol
I wonder if anyone knows what in the world is going on? Also, don't suppose anyone has there own backup database of cyoc? ![]() ![]()
__________________
![]() |
![]() |
![]() |
![]() |
#2 |
Frequent Poster
Join Date: Jun 2013
Location: United States
Posts: 105
|
Re: Cyoc down
It's strange on my end too. I just finished and overly long and creative chapter and the moment to submitted, the site went down, and this was on a Tuesday or Wednesday when it seemed okay at first. I was lucky to copy and paste the story on Notes before hand, otherwise I would've lost so much writing. Hopefully, they get it back up, but with it taking this long, I fear we might see the end of CYOC as a whole, if not now, than soon.
|
![]() |
![]() |
![]() |
#3 |
Can I have a cookie
Join Date: Jun 2008
Location: Wasilla, Alaska, US
Posts: 707
|
Re: Cyoc down
getting a bit scary now, I'm starting to wonder if CYOC is gone for good. Which would be super unlucky since I was just in the middle of trying to backup all of the posts
![]()
__________________
![]() |
![]() |
![]() |
![]() |
#4 |
Can I have a cookie
Join Date: Jun 2008
Location: Wasilla, Alaska, US
Posts: 707
|
Re: Cyoc down
so, with cyoc being down now for about a week. I've decided to try and figure out a work around/pull my hair out. I've found the wayback machine seems to have archived a bunch of chapters. I mean ALOT of chapters. Unfortunately, it's still not everything. Thankfully wayback has an api called "wayback cdx server" that I can interface with to search for the latest date of a url with some wild cards. It's a lot more clunky now, and wayback machine has some really odd rate limiting going on. But it IS grabbing chapters once again. Also unfortunately, the date that I was saving in the database for the chapter is going to be wildly off now XD lol So is the ID I was saving, I can probably fix some of this but I don't think it'll be all that useful now with the CYOC site being down for the foreseable future.
It's going to take me a VERY long time to grab all of this data and sort through some of it. I'm making a seperate python script to give me a gui to easily search it. Maybe I'll release it all once I get it done with, so we at least have something we can have fun sifting around inside of. Heck, I know some people would love to use it for AI driven projects ![]() What I'm saving is the id, url, title, branch, date and chapter contents. I am not saving the "what to do next" chapter select. I might be able to do this by creating a new table in the db or something. Maybe something for a future project, if there is enough demand for it. The original project was really only supposed to be for myself, so I had something easy to search through using synonyms of keywords. Then if I was interested in the chapter, I could click a button to go to that chapter and add a new option if I wanted to. It was never designed to try and duplicate the functionality of the site. If you have any suggestions or ideas on what should be included in the project I'm somehow starting. Please don't hesitate to throw it out there. More than 80% of this code is spaghetti and strung together, working on hopes, dreams and chewing gum. Also, I know for a fact someone on this forum has a database of cyoc chapters. If anyone knows where it's at on the forums (because I can't freaking find the damn thing) let me know. So it begins ![]()
__________________
![]() Last edited by godleydemon; 4 Weeks Ago at 03:54 PM. |
![]() |
![]() |
![]() |
#5 |
Process Fan
Join Date: Apr 2007
Posts: 42
|
Re: Cyoc down
Good luck! Wouldn't want to lose CYOC, so I'm glad you're trying to preserve the content in some form.
|
![]() |
![]() |
![]() |
#6 |
Frequent Poster
Join Date: Jun 2013
Location: United States
Posts: 105
|
Re: Cyoc down
Well, giving that it is taking so long for CYOC to fix the matter, the chances of it coming back are getting slimmer and slimmer. Godley, can you find my interactive stories and send them to me here. Think it's under my author name of LuisJM. If not, provide me the Wayback link with the CYOC site and I'll find them myself.
|
![]() |
![]() |
![]() |
#7 | |
Can I have a cookie
Join Date: Jun 2008
Location: Wasilla, Alaska, US
Posts: 707
|
Re: Cyoc down
Quote:
Pluses, you CAN manually navigate the cyoc site through web archive. But it's going to be tedious like I said and you're not going to be able to get to everything. If your patient enough you can probably find alot of what your searching for you can get to the cyoc interactive for 2025 here: https://web.archive.org/web/20250328...tory_index.php
__________________
![]() |
|
![]() |
![]() |
![]() |
#8 | |
Casual Artist
Join Date: Sep 2007
Location: Louisiana, USA
Posts: 2,269
|
Re: Cyoc down
Quote:
|
|
![]() |
![]() |
![]() |
#9 |
Can I have a cookie
Join Date: Jun 2008
Location: Wasilla, Alaska, US
Posts: 707
|
Re: Cyoc down
to give a quick update about this small project. I have temporarily stopped scanning for new pages on the web archive. I'm now running a separate script that goes through and updates the author of what I have. Since I've decided that it would take way to freaking long to wait for the initial scan to finish and then start adding authors.
I'm currently around 170,000+ entries in my db, so even updating all of the authors is going to take a long ass while. Probably the rest of the week by my estimates. Once I get all of the authors for what I currently already have in my db. Then I'll update my viewer to include the ability to search by author. Maybe a checkbox or something. Now, onto an interesting problem I've run into that in hindsight I probably should have expected. At 170,000+ rows on the sqlite db, because of the way I'm searching, it takes about 4 - 5 minutes to complete a full search. Now for the why this is happening. It's because I'm not using simplified string searches, I'm using regex ontop of synonym phrases. So if someone searches "Breasts shrinking" it also searching for: breasts getting smaller, chest shrinking, bra getting loose, ect. and it tries to match those exact phrases. So I'm performing one giant regex search on a row and it takes a sec. I've already sped this WAY up since version 0.5 when I increased the accuracy of results by adding multi threading and a few other tricks. I'll be releasing version 1 like this, but I'll eventually include a version 2. Version 2 will have an interesting feature that should speed up searches. The idea actually came from a buddy of mine. When someone does a synonym search, version 2 will apply a new tag to the row it finds the synonym in. It'll also save the id in a separate json array that's basically saying, "I found a synonym of breast shrinking in the contents of this row id" this way, in the future, even if new entries are added to the db. It'll always bring those search results up quickly. It doesn't need to rescan other contents either, since I plan to create a sort of checkpoint in the array. You just search "breasts shrinking" and you should get results within seconds instead of minutes. But that's for version 2. I'll eventually make all of this code public and easily accessible. I'm still adding comments to the code and reorganizing it to make it easier to read. right now it looks more like spaghetti. lol
__________________
![]() Last edited by godleydemon; 1 Week Ago at 09:38 PM. |
![]() |
![]() |
![]() |
#10 |
Process Fan
Join Date: Apr 2007
Posts: 42
|
Re: Cyoc down
All that backend stuff may be lost on me. But I’m rooting for you! And probably a lot of lurkers and people not even on this site are, too.
|
![]() |
![]() |
![]() |
#11 |
Frequent Poster
Join Date: Jun 2013
Location: United States
Posts: 105
|
Re: Cyoc down
Well, quick update...
The account that CYOC.net has been suspended after one month of inactivity. That means that CYOC and over twenty years of Interactive TF stories is officially dead. This is sad as we all have always been a part of that for so long and to see it go out like that is is rather upsetting. I mean out of all the interactive sites that we've seen, this one was meant for all the writers and their unique imaginations. But now it's gone, where will we go? AR Archive disabled their Interactive section considering it became a cesspool of one sentence stories and diaper fetishes and Writing.com has not only a word limit but you have to log in to prevent the messed up network traffic. The only place would be BE Archive, but I have no idea how to upload stories and the like. Still, it's been fun taking part of CYOC and the many stories I've done. I hope things will turn around, eventually. But as far as I'm concerned, the chances of CYOC going back is rather...bleak. |
![]() |
![]() |
![]() |
#12 |
Can I have a cookie
Join Date: Jun 2008
Location: Wasilla, Alaska, US
Posts: 707
|
Re: Cyoc down
It's always sad to see our old favorites go like this. But this one hits pretty hard. On the bright side, I am still scanning and backing up all of the chapters from the web archive for cyoc. I'm at over 200k+ unique entries so far. I think I'll have to do some more optimizations soon to the database to make it easier to search and load. I want to get this out as soon as possible, but it takes a very long time for me to grab everything. Cyoc was huge, freaking ancient monster. I think the last time I had looked at the total entries on the live cyoc site we were sitting somewhere around 2 mill. I'm not sure, I just remembered seeing a 2 and several digits lol.
As a side note, as I get this version of the search tool I'm designing for this. I'm also planning several versions ahead. One of the things I think I want to include is having the ability to follow branches. It currently doesn't have that function, as the original scope of the project was just a fancy search tool for cyoc. Then cyoc happened to go down in the middle of designing it. I have some ideas on how to include following branches without having to modify the database and grabbing individual page data from webarchive through a websocket but only for the branch information. It would then update that information in the db for future reference/use. I guess the ultimate goal would be to try and restore as much of the cyoc functionality as possible and maybe inlude a live database to connect to that'll allow posting of new branch story lines. That's alot of versions out though ![]()
__________________
![]() |
![]() |
![]() |
![]() |
|
|