I'm looking to move to another host. I generally try to work through with hosts, especially since I'm paying for cheapo ones, but this one's had 4 downtime incidents in 7 days, which I really think is unacceptable. This last time, apparently, they needed to restore a backup and screwed up permissions, meaning more work for me to fix things up (and I still don't know if there's some badly set ) :| Hopefully they'll at least be willing to refund part of my annual payment.
And sorry for all the recent downtime. Once I move over to a new host, it should hopefully be better.
I see. No, I'm not expecting you to understand how the script is designed since you wouldn't even have the chance to have seen the code :P Ignoring the writing of a script, the issues I'm primarily thinking about are in regards to the amount of bandwidth that may be needed and how to detect duplicates. Nyaa's not so hard for the latter since most torrents on TokyoTosho link to Nyaa anyway, whereas this isn't so nice with other sites.
Sorry for that putty tat, you were never supposed to see... err, yeah that was just your imagination - you saw nothing! Cheers for the tip anyway.
Yeah, some lurker/leecher is bound to upload their stuff in TokyoTosho. However, sometimes no one does it, so for those cases nyaa.eu is more accurate because they themselves (the groups or one of their members) upload it to nyaa.eu.
And about scripting for another site, I thought AnimeTosho is in "single mode" that follows only TokyoTosho, so I thought becoming "multiple mode" that follows multiple torrent sites was the big challenge. And then I thought after becoming "multiple mode" it'd be easy to add more sites to it; I didn't think you had to make a different script for every single site. Forgive me for talking in codes, but theoretically that's what I thought.
Yo! I don't really know the technical details but here I go:
I read somewhere in the comments about the possibility of including files from nyaa.eu in the future. It would be totally useful as many fansub groups (i.e. UTW, gg, WhyNot, FFFpeeps, etc.) use it directly.
When that time comes, can you please include http://tracker.anime-index.org/ please? That's Doki's list, which contains only their files. You can probably use this as a sample site/guinea pig if you need a site for the scripting for adding nyaa.eu because this is not as active -- after all, this is a tracker for just one group.
Thanks, man. Either way, I'll forever be a lurker of AT.
Well, thanks for enlightening me. Now i can see the big picture and the constraints that u are facing. Also thanks for the alternatives, appreciate them. Hope this site can stay around. =D
I see. Unfortunately though, it's not quite so simple. Bandwidth is generally more limited by transferred amount (e.g. quota) rather than realtime line usage, because the server is on a shared pipe as opposed to a dedicated link (this also means I can't really gauge when it's "idle"). Unmetered dedicated links are expensive unfortunately, and I don't really have the funds for it :( That's probably the main issue. There's a few other minor things, such as disk space consumption, but I think I could work around it. I'll probably need a new server to handle batches (and a good one at that, considering how large they generally are).
Oh, and if I do enable batches, it'll be for newer stuff only; old batches won't get fetched (unless they're resubmitted). As for your suggestion to fetch arbitrary torrents, I don't really think I can be a free torrent fetch type service (which is probably bound to fail anyway - once people start finding it and submitting heaps of stuff for fetching, the queue will grow huge and you'll be back to week long waits). You'll probably get more luck begging someone on a forum or seeing if anyone will set up a free torrent fetch service for you. Perhaps even share a seedbox amongst a few people. Have never really searched for seedboxes, but you can probably find a decent VPS for around $5/mo; although most won't allow torrents, you might get lucky.
There are possible ways you can try looking into to get around ISP blocks, such as enabling encryption etc - do a search on that if you haven't already.
AnimeSenshi.com looks like they do DDLs - have you tried searching their site? You'll probably get more luck asking them just to put up DDL links for you. Otherwise request in their forums and see if someone is willing to help you.
That is the only free torrent to HTTP download service i know, but the wait time for me range from hours to days, worst is weeks. The queuing time is very long. I suppose is due to the larger number of files to be processed. Premium is something i can't afford unfortunately.
Actually by torrents, I'm referring more to batch torrents that are relatively huge in file size (5-20GB) if they could be processed when the server is idling during off-peak hours so as to maximize the usage of the server. In view of this, i was wondering if you could setup a submit system where people can submit batch torrents(Anime/Recent) so the server can process it during off-peak hours when it is idling and would not cause any issues for normal operation of the site. I hope i am more specific and clearer in my explanation.
Basically i couldn't find many torrent fetcher services, even if i did, most of them are quite expensive by my standard and i definitely can't afford a seedbox. Also, the fundamental reason I prefer DDL to torrent is that my ISP has a set in place restrictions on torrenting so i am resorted to DDL for more efficient downloading of files. I'm just a poor lecher. >_<
We used to upload to EmbedUpload which does send to Fileserve/Filesonic [example file] but at the moment, the service is causing issues (it's throwing lots of errors) so it has been disabled. Hoping to enable it in the future, but only after issues are sorted (if ever...).
If you do know of a decent and reliable multi-uploader, I'm willing to look into it.
I like forums myself and want to put one up, but on the other hand, I'm not a fan of putting up something that hardly anyone would use (take a look at the TokyoTosho forums). I'll probably set one up in the future anyway.
You can submit torrents to TokyoTosho and if it's in the Anime category and not considered a file that is excluded, it'll appear here.
If you just want to get a DDL for a torrent for yourself, I think it's better to look for one of those torrent fetcher services (I know ImageShack used to have a limited free torrent mirror service, but if you do a search, you should probably be able to find a few) or get a seedbox if you don't mind paying for something better. If you want others to download it as well, you're probably better off posting it to TokyoTosho anyway since it gets more exposure there.
Taking the above into consideration, I didn't really think that a submission feature was that necessary. Perhaps I could link to TokyoTosho's torrent submission page if that would help anyone wishing to submit anything. Or is there something I missed?
At the moment no. This is some kludgy script I put together so that people could actually comment. I'm hoping to replace it with something better, which hopefully will incorporate nicer features, though this isn't a priority at the moment unfortunately.
Maybe if I add a forum (see below comments) I'll get rid of this feedback page; forums generally have some sort of avatar system.
I was wondering if we could submit torrents to be processed? Maybe admin could have a submit system where individuals can submit the torrents they want to be processed and admin can then decide to approve it or reject the submission. Of course this is in consideration that it is could be done during which the server is least busy so as to maximize the usage of server and to benefit most of us lechers. =P Hope you can take my suggestion into consideration and develop a more well-rounded service for everyone. That said, I would like to say thanks for the current system as it is really efficient and awesome in terms of simplicity and diversity. My deepest gratitude.
Is it the Government doing the blocking? That sounds interesting, especially since MediaFire is quite well known. I'm in no such country so I have absolutely no idea about file host blocking. My guess is that it would probably be more likely that the file host itself does the blocking (possibly because they can't earn ad revenue in your country?).
It doesn't take all files at the moment unfortunately. Due to limited server bandwidth, I'm currently skipping batch files - this includes files in the Anime category that looks like a batch. It does take anything under 1.5GB though, and will skip anything that's obsessively large (like >12GB).
Ideally I'd do these in the future, but that will depend on whether I can finance another server for processing. Hope this answer helps.
Hi, i was wondering why didnt bluray releases that appeared in cat 1 TT was not found on this site. To be more specific would be Doki's Angel Beat(720p Hi10p) and Coalgirls' To aru majutsu no Index II(720). If possible can u upload them?
I intend to re-enable it in the future. At the moment, it's causing some severely long delays with everything else - in fact the upload queue has been growing because of it. Now that it's disabled, finally the queue has become shorter.
I can't say exactly what's making it slow - all I can see from logs is that it's sometimes taking absurdly long to upload a file. I'll see what I can do to resolve the issue.
This mirrors files posted on TokyoTosho, so if groups decide to do similar things to Hi10, and they post it to the Anime section of TT, it'll probably appear here.
Unfortunately, it's a bit more problematic than that. ~16 minutes for 200MB is about average IF there are no errors. But MF likes to throw errors now and then (like dropping the connection for no particular reason) so the script does retry uploading; it usually works after one retry. Also, the average file size is closer to 300MB than 200MB.
I've put recently mentioned files at the front of the queue, so they should be processed sooner. Hopefully that helps you, though it won't solve the global issue of MF being slow at the moment.
Thanks for including Hi10 Anime group's re-encoded versions. Would appreciate if you included more groups like this. Their small file sizes are sure win if we want to keep the files in our hard drives for a long time. Again, thanks!
26/10/2011 10:25 — admin