so, with cyoc being down now for about a week. I've decided to try and figure out a work around/pull my hair out. I've found the wayback machine seems to have archived a bunch of chapters. I mean ALOT of chapters. Unfortunately, it's still not everything. Thankfully wayback has an api called "wayback cdx server" that I can interface with to search for the latest date of a url with some wild cards. It's a lot more clunky now, and wayback machine has some really odd rate limiting going on. But it IS grabbing chapters once again. Also unfortunately, the date that I was saving in the database for the chapter is going to be wildly off now XD lol So is the ID I was saving, I can probably fix some of this but I don't think it'll be all that useful now with the CYOC site being down for the foreseable future.
It's going to take me a VERY long time to grab all of this data and sort through some of it. I'm making a seperate python script to give me a gui to easily search it. Maybe I'll release it all once I get it done with, so we at least have something we can have fun sifting around inside of. Heck, I know some people would love to use it for AI driven projects
What I'm saving is the id, url, title, branch, date and chapter contents. I am not saving the "what to do next" chapter select. I might be able to do this by creating a new table in the db or something. Maybe something for a future project, if there is enough demand for it. The original project was really only supposed to be for myself, so I had something easy to search through using synonyms of keywords. Then if I was interested in the chapter, I could click a button to go to that chapter and add a new option if I wanted to. It was never designed to try and duplicate the functionality of the site.
If you have any suggestions or ideas on what should be included in the project I'm somehow starting. Please don't hesitate to throw it out there. More than 80% of this code is spaghetti and strung together, working on hopes, dreams and chewing gum. Also, I know for a fact someone on this forum has a database of cyoc chapters. If anyone knows where it's at on the forums (because I can't freaking find the damn thing) let me know.
So it begins
