Feedback Page

This is a somewhat temporary page made especially for the beta version of this website. It's to collect all your death threats, love messages, requests to the code monkeys or just suggestions/issues/questions/criticisms/idle talk or whatever feedback you think is worth our database space.

20,233 comment(s) posted: [view latest]

Page: 1 2 ... 411 412413414 415 ... 483 484

16/03/2024 22:59 — Anonymous: "c n"

From the DB export page:

> torpc_sha1_*: hex encoded SHA1 hash of concatenated SHA1 hashes (binary encoded) of the respective block size. For example, the torpc_sha1_16k hash is obtained by breaking the file into 16KB blocks (if the last block is less than 16KB, it is discarded), calculating a 20 byte SHA1 hash for each block, concatenating these hashes, which is then fed through SHA1 to obtain the final hash. The selected block sizes correspond with the most common piece sizes used for torrents, and hence this hash can be useful in trying to detect duplicate torrents which have different info hash values.

This means that errors in the last block will not be detected, right?

> Mediainfo and related data are currently not included mainly due to size and time it takes to dump the data. The data is also compressed using a custom LZMA2 based scheme, which users would need to implement a decompressor for. I may consider including this data if many are interested in such.

This has made me curious about that scheme. Would you mind sharing it or some code implementing it?

Thanks for the awesome site, cute design, and making these database dumps available :) Very cool!

16/03/2024 23:24 — Anonymous: "c n"

Also, your SIMD stuff is pretty nice.

17/03/2024 04:16 — admin

This means that errors in the last block will not be detected, right?

The hash isn't intended to detect errors, but if you used it for such, then yes.

This has made me curious about that scheme.

It's just a raw LZMA2 stream with a preset dictionary and CRC32 checksum.

Thank you for the compliments.

17/03/2024 08:07 — Anonymous: "c n"

(Does this use BBCode?)

[quote]The hash isn't intended to detect errors, but if you used it for such, then yes.[/quote]
Ah, of course, my bad. Ditto for duplicate detection though, files with different trailing data will hash equal. Is there a reason it's done this way? In any case, it's not like it can be changed at this point, and even if, it would be of small benefit, if any. Thanks for the quick response.

17/03/2024 10:50 * — admin

Is there a reason it's done this way?

As opposed to including the partial block at the end? If so, I don't see how you could make it work.

Keep in mind that the point is to provide an indicator to detect duplicates. Arguably it's not 100% accurate, but it should be close.
You don't know how the partial block at the end will be filled - if it's the last block of the torrent, it isn't padded, if it's not the last block, it's filled with the contents of the next file. There's no way to compute the hash for the latter case, since you can't anticipate what file will be concatenated onto the end. The former case is computable, but would only be useful to match against torrents where that file is at the end and the file's offset is block aligned - basically it'd only be useful for matching against single file torrents, but useless for matching batches.

17/03/2024 11:37 * — c_n

You don't know how the partial block at the end will be filled [...]

Oh, I see the problem now. Thanks for your explanation. The last block of the file might contain information from the next file, and since that would be included in the block hash, it wouldn't be useful for detecting duplicates.

My thought process was to split the file into blocks and hash the partial last block, but I didn't consider the interaction with torrents containing multiple files.

Sorry to be a bother, but if I understand correctly, this would also not allow for detecting duplicate files that aren't aligned to block boundaries, is that the case?

~~It would also be nice to know the rich text formatting used on this feedback page.~~ Figured it out, it's pseudo-HTML.

Another minor question: the documentation says "CRC32" ~~a lot~~ sometimes, which CRC polynomial is actually used here? The Ethernet one?

17/03/2024 13:05 — admin

but if I understand correctly, this would also not allow for detecting duplicate files that aren't aligned to block boundaries, is that the case?

Correct, it's only intended to match the first file in the torrent.

which CRC polynomial is actually used here? The Ethernet one?

Correct.

17/03/2024 17:41 — c_n

Thanks!

19/03/2024 16:47 — Anonymous

how much does it cost to run all of anime tosho?

19/03/2024 23:06 — admin

You can find relevant info at https://animetosho.org/about/logistics

20/03/2024 13:07 — Anonymous

thx

21/03/2024 14:02 — Anonymous: "Ahura"

Happy Nowruz (Persian New Year) 🤩 🥳

23/03/2024 22:22 — Anonymous

Does anyone know if Mashle S2 and The Dangers in My Heart S2 are going to be dubbed? I will have to deal if not. I like both equally but prefer to watch a series in the language I started. Its a shame Orphen and Edens dubs were cancelled. Anyway thanks for any info.

23/03/2024 22:23 — Anonymous

Never mind with Mashle S2 episode 1 dub is out.

24/03/2024 06:45 — Anonymous

Looks like the NNTP uploads have stopped. Last NZB uploaded was at 01:30, with a few missing before that.
As always, thanks for the good work.

24/03/2024 10:06 — admin

Thanks for raising the issue.
NNTP uploads seem to be working, there's just a large backlog, so it's taking time to process.
Sorry for the wait.

24/03/2024 16:23 — Anonymous

seems like the stopped updating

these Nyaa releases have not uploaded yet:

https://nyaa.si/view/1794202
https://nyaa.si/view/1794203

24/03/2024 16:41 — Anonymous

aren't they redundant to:

https://animetosho.org/view/db-kono-ot...1.n1794204

24/03/2024 17:01 — Anonymous

[DB] has developed the habit of duplicating files to create a S1 torrent, a S2 torrent and a S1 + S2 torrent, all released at the same time. To me, it's a waste of resources.

25/03/2024 15:44 — Anonymous

Admin, what Usenet provider do you use? I want to upload a lot with a lot of connections.

25/03/2024 16:50 — Anonymous

I may not be the admin, but I've been using newsdemon for a while from a gigabit server and so far absolutely no issues uploading TBs weekly

26/03/2024 12:09 — admin

Usenet Farm, though there's likely plenty of alternatives.

27/03/2024 18:09 * — schniva

I can't seem to confirm my email address. I don't receive an email when I click to confirm it.. Anything I'm doing wrong?

28/03/2024 03:49 — admin

Nothing wrong on your side - the server is blocked from sending emails, so none will get through.
Nothing relies on it though, so feel free to ignore it.

30/03/2024 19:21 — Anonymous

I don't know if it's processing is dead or just very slow but the last NZB if from four hours ago.

30/03/2024 21:14 — Anonymous

It seem to be processing again now.

Page: 1 2 ... 411 412413414 415 ... 483 484

Add new comment
Name:
Message:
Image Verification:	Our squiggly text game where the aim is to copy the image into the textbox. All characters are upper case, and there are no zeros (0) and ones (1) in the above image. Apparently bots aren't as good as humans at this game. Image Verification Passed.