@WikiDude thanks for looking at this, I really appreciate it!
I am responding to your most recent post in that torrent's comments, quoted here:
Thanks for your comments:
- this isn't a qBitTorrent issue, it is a libtorrent issue (libtorrent is the "driver" software that qBitTorrent uses - but it is from a different development team. Kind of like differentiating between the Windows OS, and the qBitTorrent app.)
- I hadn't thought of it, but yes - a non-padded torrent WOULD appear significantly smaller... however, as I noted in my post above: those "padding" files are created as "sparse" files with all zero data. ACTUAL XFERED DATA is practically nil! Depending on the filesystem you download into, they may also store as practically zero-length files (in storage, not in the OS listing of the file size).
- exactly how is requiring uploaders to use a specific encoding client any different from requiring downloaders to use a different torrent client? Keep in mind that there is nothing preventing you from using multiple torrent clients on your system... I would presume that you have more than 1 browser on your system?
- Neither this site, nor any torrent site that I am aware of, actually CREATES the .torrent data! Uploaders (users) do that!
That you haven't run into this issue on another site is simply a matter of chance. To wit: How many "collections" are you downloading from other sites? (For my own personal use, this site has an enormously larger percentage of "collection" torrents - the ONLY torrents this would apply to, as padding data exists solely to "space out" data in the stream so that individual files always start on a "block boundary"). I'd say that, other than torrents where there is a separate .srt file, or those damnable uploader text files, the VAST majority of my downloads from other locations are single files...
#2 is unfortunately incorrect for most torrent clients and filesystems. When I download a 32MB file of all zero bytes from my seedbox, it takes exactly as long as downloading a 32MB file with non-zero bytes.
Same for ratio: when I download a torrent with lots of padding in Tixati (my alternate client when rutorrent doesn't work) all of the padding bytes count against my ratio. Not that I care, I have a 2 petabyte buffer, but some people have to worry about their ratio.
For instance, when I deleted the .pad directory for the ASG torrent, I got about 34 GB of disk space back. File with all zero bytes are only more efficient if you're using compression. If you're not using compression, then on the disk, and through the network, there is no difference between files with just zeroes and files with both ones and zeroes.
qbittorrent may never actually download the padding files at all. I believe the default behavior is to completely hide everything having to do with padding. That's why so many Uploaders don't know their torrent client is adding pad files, I usually have to ask them to click on [See full list] before they believe that such a thing exists. So if you're using qbittorrent, the pad files may indeed appear to take no time to download, because they're not being downloaded. However most torrent clients don't have this feature, so they treat the pad files just like any other pic or vid file.
#3 I don't want to require anyone to do anything, but this error was introduced recently, and it would be very nice if we could "patch" it by removing whatever extension field or metadata that's causing this error in so many other torrent clients.
I've read a lot of comments from frustrated users on the torrents with this error, and it appears most people only use one torrent client, so when they get an error, they think there's something wrong with the torrent file, they don't think there's something wrong with their torrrent client, and they don't try a different one.
BTW, it's possible this error was fixed by an even newer version of qbittorrent/libtorrent, because I've recently seen a few large torrents with lots of padding files that load correctly in rutorrent. So maybe the solution is to ask all the libtorrent users to do one more upgrade. I don't know for sure, because I can't figure out what's causing the error. However when I look at the headers in these .torrent files it seems like there's some entries I haven't seen before.
#4 I download a large number of multi-file torrents from other sites. You're right, no other site has anywhere near the content that we have here, but I get probably a third of my torrents from other sites, and many of them have those pesky .srt files and thumbnail pics etc. This particular error (fails to load in rutorrent, Transmission, and others) started a few months ago. On GT, I run into this error maybe once per day (I don't post every link here, and I didn't start this thread until recently.) On the other sites, I've never had this happen, not once. Just based on the numbers, I don't think it's coincidence.
Yes, Uploaders create the initial .torrent file, but this site's processing engine modifies them too. When I upload a new torrent, the .torrent file I download from the post-upload page is not the same as the .torrent file I initially created with my torrent client.
Maybe the other sites are using some logic that strips non-standard extensions and metadata from .torrent file headers.
Again, really appreciate you taking the time to discuss this. If there's a solution, it may apply more broadly, and shield us from the next bug that the programmers will inevitably introduce...