Bug with metalinks and HTTP? 614s60

[Nicolas]

NOTE: the symptoms look like the problem might exist on any normal HTTP and not only those started by metalinks. I haven\'t tried any normal HTTP on the new FDM. However, if that was the case, I would really doubt nobody had noticed it yet.

I loaded a metalink into FDM. I made this metalink myself, with Hampus\' Metalink Editor and some manual tweaking with a text editor. It works correctly in aria2. FTP mirrors started ing the file correctly, but every single HTTP mirror failed with \

[Guest]

What the hell? It removed half my post! Trying again without any link:

NOTE: the symptoms look like the problem might exist on any normal HTTP and not only those started by metalinks. I haven't tried any normal HTTP on the new FDM. However, if that was the case, I would really doubt nobody had noticed it yet.

I loaded a metalink into FDM. I made this metalink myself, with Hampus' Metalink Editor and some manual tweaking with a text editor. It works correctly in aria2. FTP mirrors started ing the file correctly, but every single HTTP mirror failed with "File size doesn't match".

Here is my guess: FDM is checking the reply of Content-Length and comparing it with the filesize specified in the .metalink file (it BETTER be doing that, and not doing something stupid like comparing with size from the first mirror; there is a reason why <filesize> tag is there). However, on a 206 Partial Content reply, the Content-Length response header has the size of the chunk the client requested, not the size of the whole file. It should instead read the last number of the Content-Range response header.

Code: Select all

Content-Length: 1698664314
Content-Range: bytes 2831833222-4530497535/4530497536

1698664314 is the size of the requested chunk (bytes=2831833222-). 4530497536 is the total filesize, and it matches what I have on the .metalink.

[Alex]

FDM does so as you said.

[Nicolas]

FDM does so as you said.

Thanks for the ambiguous answer. I said many things

You mean you confirm the bug? You mean it's doing things the way I said they should be? You mean it's comparing with size from the first mirror, and you ignored all the rest of my post? Please explain.

[Guest]

shameless bump

[Nicolas]

I have some useful information: I tried with a 600MB file and it can from the HTTP mirrors without any problem. So it could be a problem related to 64-bit integers (the file I mentioned on my first post was just above 4GB).

[antini]

Are you using the latest build? I know there were some large file fixes recently.

Can you share the metalink/URLs you're using?

[Alex]

FDM does so as you said.

Thanks for the ambiguous answer. I said many things

You mean you confirm the bug? You mean it's doing things the way I said they should be? You mean it's comparing with size from the first mirror, and you ignored all the rest of my post? Please explain.

I meant FDM already get the file length from Content-Range field.

[Guest]

Are you using the latest build? I know there were some large file fixes recently.

I'm using FDM 2.5.713 (fdminst.exe md5 576d62a4cfeab78be3348ef18d6e8dfb).

Can you share the metalink/URLs you're using?

Sure: impfarm.imp.org/~nico/sabayon/
miniEditions are <700MB, those work. 3.4f fails with said error on all HTTP servers.

[antini]

I get the same error. FDM shows that only FTP sites are being used.

12:44:30 PM 9/27/2007 Starting ...
12:44:30 PM 9/27/2007 Opening file on the disk...
12:44:30 PM 9/27/2007 Succeeded
12:44:30 PM 9/27/2007 Preparing files on the disk... This may take several minutes
12:44:30 PM 9/27/2007 [Section 1] - Started
12:44:30 PM 9/27/2007 [Section 1] - ing
12:44:31 PM 9/27/2007 [Section 1] - Done
12:44:31 PM 9/27/2007 complete
12:44:31 PM 9/27/2007 Metalink info file has been detected. Continue ing.
12:44:32 PM 9/27/2007 Starting ...
12:44:33 PM 9/27/2007 Opening file on the disk...
12:44:33 PM 9/27/2007 Succeeded
12:44:33 PM 9/27/2007 Preparing files on the disk... This may take several minutes
12:45:35 PM 9/27/2007 [Section 1] - Started
12:45:35 PM 9/27/2007 [Section 1] - ing
12:45:35 PM 9/27/2007 Creating new section...
12:45:39 PM 9/27/2007 [Section 2] - Started
12:45:39 PM 9/27/2007 [Section 2] - ing
12:45:39 PM 9/27/2007 Creating new section...
12:45:41 PM 9/27/2007 [Section 3] - Started
12:45:41 PM 9/27/2007 [Section 3] - ing
12:45:41 PM 9/27/2007 Creating new section...
12:45:43 PM 9/27/2007 Files' sizes are not equal
12:45:43 PM 9/27/2007 Trying another mirror...
12:45:50 PM 9/27/2007 [Section 4] - Started
12:45:50 PM 9/27/2007 [Section 4] - ing
12:45:50 PM 9/27/2007 Creating new section...
12:45:51 PM 9/27/2007 Files' sizes are not equal
12:45:51 PM 9/27/2007 Trying another mirror...
12:45:52 PM 9/27/2007 Files' sizes are not equal
12:45:52 PM 9/27/2007 Trying another mirror...
12:45:56 PM 9/27/2007 [Section 5] - Started
12:45:56 PM 9/27/2007 [Section 5] - ing
12:45:56 PM 9/27/2007 Creating new section...
12:45:58 PM 9/27/2007 Files' sizes are not equal
12:45:58 PM 9/27/2007 Trying another mirror...
12:46:00 PM 9/27/2007 [Section 6] - Started
12:46:00 PM 9/27/2007 [Section 6] - ing
12:46:00 PM 9/27/2007 Creating new section...
12:46:00 PM 9/27/2007 Files' sizes are not equal
12:46:00 PM 9/27/2007 Trying another mirror...
12:46:07 PM 9/27/2007 [Section 7] - Started
12:46:07 PM 9/27/2007 [Section 7] - ing
12:46:07 PM 9/27/2007 Creating new section...
12:46:13 PM 9/27/2007 [Section 8] - Started
12:46:13 PM 9/27/2007 [Section 8] - ing

[antini]

If I manually start a from just the HTTP mirrors, I don't have any problems.

Can you create a test metalink listing just HTTP?

[Guest]

If I manually start a from just the HTTP mirrors, I don't have any problems.

Can you create a test metalink listing just HTTP?

Done, it's up on the same URL as before.

Damned strange thing... First two or three mirrors gave that error, the rest worked. But both Content-Length and Content-Range headers were identical!

[Alex]

Thank you for report.
Bug will be fixed in the next update.

[antini]

Nicolas, thanks for finding & reporting the bug!

Alex, thanks for checking the report out!

There are a few more feature requests dealing with Metalink at

http://www.freemanager.telechargerjeux.org/boar ... php?t=7439

Adding local metalinks, ing multi-file metalinks and those with directory information, & chunk checksums.