As far as I know links are removed on the following criteria and the standard prevention for each case depending on what level you want: 1. Reported | Obfuscate the link with dlc, captchas, and or login required 2. File Name Match | Randomize filename, make an archive with random name but keep the file inside the same 2. Archive contains matched file | Encrypt headers in archive to scramble filenames using 7z(mhe option) or rar(hp optoin) ect 3. CRC Match | Archive file and add a password 4. Link expired | Rarely happens with major hosts and popular websites as long as file is in use but you can automatically download a little of the file periodically.
Churning through stuff I guess >_> Have disabled updates for now, and done some 'load chunking' to try to help it get through without totally dying.
Sucks, but at least the host has been quite helpful through this and they're actively trying to stop it occurring in the future (they're fine most of the time, but sometimes things stuff up). Downtime like this is rare, fortunately enough.
Interesting point about the link scrapers - I hadn't thought of that. Though I guess if one's just looking to obfuscate links, one can simply obfuscate it themselves without requiring downloader support? I think most links at the moment are being removed due to expiry from the host, as opposed to take down notices, but that may not always be the case later on. So for now, I guess the benefit will just be to have everything in a single list, and I'll keep the plaintext links available for convenience sake.
That was actually a reply to bottom of pg 15 but I failed the captcha and when I hit back my comment was deleted and the reply bubble didn't fill back up, so after retyping it I forgot to hit reply.
Those things exist not because they wanted to hide links, but to prevent deletiion by robot grabbers and minumum wage workers. DLC support is not exclusive to Jdownloader but a secured technology to help discourage(there are utilities that work around) abuse by linik deleting 3rd parties. Some other downloaders that have been approved are pyload and cryptload. There are some link obscurer/protector websites where you submit yoru links and they give your users a dlc or if you want the actual links you need to solve a captcha for them, many have a backend for automated downloaders such as jdownloder/pyload so you don't even have to actually have people get the dlc.
By following the practice of producing randomly renamed rar files with a password and filename encryption enabled, and only distributing your links through DLC or related technology you can ensure your links will weather not just days/week but years.
Yes, it is a list of links for download a lot of parts. http://cl.ly/0h000X2K200j172i0j1r ("kaiba" is a dlc conteiner of 24 links) However, it is not only for Jdownloader. I think MyPony uses it too.
Really sorry about the downtime. It's frustrating to me too as it means I have to worry about when the server does come online, the amount of load it has to get through. The host has informed me that the DC apparently will only reconnect the server on Monday, and provided a detailed explanation of what the issue was (I like this host because they actually actively inform you of issues and how they try to solve them).
So here's hoping everything goes back to normal on Monday and the server doesn't die from trying to mirror so much at once. Apologies for the inconvenience.
Thanks for the link - looks interesting. I've tried reading that page, but I'm not too sure on what it exactly is. It sounds like some encrypted list of links that only JDownloader can use? I'm a bit confused about the encryption part - it would seem that if JDownloader needs to contact the server to decrypt the links, then any application pretending to be JDownloader could do the same.
So I guess the only real point of it is for JDownloader to download everything as one part?
A more stable server (or maybe some backup if it can be set up) would be nice, but I use not-so-stable servers because they're cheap. If someone's willing to supply a better server to me for free I'll look into it.
Apparently someone on the node was abusing the server, it got disconnected by the DC, so now the host has to try and get it back and running. Arguably the host's fault for not filtering out the attack.
A FLAC audio stream is typically 100-150MB per episode (as opposed to, say, a 128kbps AAC stream which would be around 20-25MB per episode; why anyone would use AC3 is beyond me), but if you subtract the difference, their files are still large. I'm actually not sure how they make their files so big, at least for their 720p encodes (excessive filtering?) - their x264 settings seem decent.
Anyway, I don't particularly like criticising people who give away their time for free, so I apologise for even starting the topic.
All hosts are uploaded to anonymously - accounts are never used. I'm a bit iffy over raising the batch limit at the moment as I feel that the server is pretty much near its processing limits anyway. Maybe some day. (mutters about how Coalgirls' releases are usually oversized anyway)
Are the files uploaded on bayfiles under anonymous? There seemed to be no captcha and countdown when i tried to download them.
When i went to the site, it says 5GB for everyone. Is that true? Can anyone testify to that?
On another note, could you raise the file size limit to 2GB if the server permits? This is due to quite a handful of Coalgirls's releases (720p) are not being processed as they are over the limit. [Whatever the script considers to be a 'batch', over 1.5GB in size]
One of the sub groups I follow started using http://bayfiles.com and for me it's like MU only better. And reading a news post about the current filehost situation a user posted http://www.peeje.com/remote which has multi-file uploading.
I hope this was mentioned, but JUMBOFILES.com, is awesome, ftp uploads and more, and the download speed is the same as mediafire very fast, hope you check it :)
I won't be using MirrorCreator due to their restrictions, but I'm uploading to MediaFire separately as it is now, as they're the only host with a 200MB file limit.
Thanks for all the file host suggestions! I'll be looking through them when I get free time. I'm going to prefer multi-host uploaders as they'll consume less server bandwidth. Do note that once I pick one or more hosts, I'll have to code up an upload script, then let it go through a testing period, all of which may take some time.
31/01/2012 02:07 — Anonymous