The upstream sites all have feeds.
Merging is done by skipping duplicates identified by BTIH.
There's some rules to try to skip malware, but they're only somewhat effective.

That's the general gist of it - nothing particularly fancy.

Thank you! for 15 year of Service.

Rather than taking the code unchanged, I'll probably look only for inspiration. How to access the other sites, how to merge the listings, how to exclude posts that are unwanted noise.
Anyway... unfortunate to see this site gone. You ran a really nice operation here.

No, I simply care too much.

Well, the fact that you keep replying to everyone here meaning you simply care too much. Just ignore and move on. But you can't do that, can you?

Debrid is one of those things I always planned to play with but never got around to, but as my server grew it became kind of a hobby to manage it and I like having everything locally.

I feel like people are taking this as if I was genuinely complaining that torrents are "bad" or something - it was just a random half serious comment that I've been spoiled by the convenience of Tosho and not needing to torrent anything available here - that's it, it wasn't some grand commentary on file availability or some definitive statement that torrents are a bad thing. Fuck.

It would feel that way for me because I've been so spoiled by having everything this site grabs available on Usenet. Nobody's disputing what torrents are or do - that's why I said "feel like."

The fuck are you talking about, dude? I came here to thank the guy for his hard work because it was so convenient to be able to grab everything via Usenet and not have to dedicate more storage to seeding. Nobody is disputing that torrents are a big part of how this shit works - I also didn't say "not all come here for DDLs" - I said that a lot of people mentioned they missed it and that I PERSONALLY going to miss the Usenet grabs more. What kind of fucking douchebag are you that you're trying so hard to start some weird internet battle here over somebody simply saying they preferred using the Usenet grabs and would miss them? You win, dude, you win the internet fight. Go away.

I'm working on releasing the code to that, but it won't be of any use to you. The scraping code is designed to populate a database and isn't inteded to be a feed.

It's not always nyaa that deleted torrents, sometimes the uploaders also deleted their torrents but you're right. To be able to see deleted torrents is still a cool feature to have.

No storage needed either.

Have you heard of debrid? Stremio? Nzbdav? Instant cached torrent streaming. And instant Usenet streaming. All foss.