big files download bug

[mastabog]

Hello,

I just tried to download the Fedora Linux Core2, dvd format (4.1Gb iso file) using first a download manager, reget deluxe, and it failed ... reported wrong size (79Mb) and downloaded the reported size (79Mb) only ...

I've put the 4.1Gb file in wincmd (v6.03a, WinXP Pro) using the background transfer manager, not directly with ctrl-n, and started the download. The problem is that the % indicator (window title) is not advancing, it remains at 0%, but the bytes keep coming and the file grows in size, sign it's being downloaded ... The progress bar that normally appeared, now does not ... its white and no green blocks appear (blue i think if no theme is used in winxp).

Sorry, can't post now if the file downloaded corectly in the end cus the download is not finished yet; but is now @ 840Mb and going (well i hope).

Here are some http links for you to try yourself:
http://redhat.secsup.org/fedora/core/2/i386/iso/FC2-i386-DVD.iso
http://download.fedora.redhat.com/pub/fedora/linux/core/2/i386/iso/FC2-i386-DVD.iso

The download page is here: http://download.fedora.redhat.com/pub/fedora/linux/core/2/i386/iso/
And a list of mirrors is here: http://fedora.redhat.com/download/mirrors.html

Cheers

[Clo]

2mastabog
Hello !
• Just a feeling : while downloading a single huge file like you are doing, I'm not sure that the bar shows always the % progress continually...
- Although I don't use often the Bk. Gr.Tr. Manager, I had noticed a while ago that its progress-bar was too short for 100 %. Isn't your problem currently, but I'ld be curious to know what it displays in you case before 100% be reached (the bar was full at ~ 96 …97 %)

* Waiting for your download be ended, you could have a look in the Search with progress-bar as keyword…

Glad to hear the continuation…

  Kind regards,
Claude
Clo

[mastabog]

So sorry ... i forgot to post once the download finished (i got directly to installing fedora core2).

First off: it wasn't only the bar that didnt move (no advancement at all even when reched half the download size). Read on.

So here are the details:
I tried both the background transfer manager and downloading directly (pressing ctrl-n, paste the link and hit ok). Both download windows (bk. tr. manager and download) i tried were displaying 0% on their title at all times and no progress bar was shown. This went on and on until i got disconnected.

My adsl connection got disconnected at about half the download size (2.4Gb) because of the 24h regular disconnection my isp has (pricks).

After i reconnected, i started and resumed the download and suprprise: the window was showing 55% (in its title) and the progress bar was filled also 55%. They both worked until the end, meaning the title advanced untill 100% and so did the progress bar. This was true for the background transfer manager also (i was courageus enough to stop it and resume with the bk. tr. manager )

Happily, my 4.1Gb file downloaded just fine (with all disconnections and stoppping on my part) as I checked its md5 hash. I must admit, i never downloaded a file this big with any download manager or wincmd. Most other downloaders i've tried choked completely and stopped downloading after 75Mb (e.g. ReGet Deluxe).

// the email reply from the board got interpretted as junk and I aonly saw t 10 minutes ago, that's why i havent replied sooner. Now its all good

[SanskritFritz]

Most other downloaders i've tried choked completely and stopped downloading after 75Mb (e.g. ReGet Deluxe).

Ooooooh, TC rulez!

[mastabog]

it sure does ... and did for me since the Era Of Win3.1

[ghisler(Author)]

The missing percent bar means that the server uses a really old or non-standard server software, which doesn't report the size of the downloaded file. It probably also means that the server doesn't support download resume either.

[mastabog]

Hellow Christian

Sorry to say this but you are wrong. In fact, that's one reason i posted those links, to check and see for yourself.

Besides, I wrote in my second message that after a resume (so it does support resuming) at about 55% (2.4Gb) both progress-bar and percent value appeared.

Please try downloading this before saying its not Total Commander's fault:
http://ftp.heanet.ie/pub/fedora/linux/core/2/i386/iso/FC2-i386-DVD.iso
Check the HTTP headers, they report the size correctly in bytes. Also stop and resume the download to see that the site supports resuming.

It is a TC issue/bug.

Also, other readers of this post can try themselves too. Just press CTRL+N, paste the link above and hit OK. Or from Commands > Background Transfer Manager > + > Add URL for download > Paste and hit OK.

This is not only a TC issue. TC was the best cus at least it got the file completely (and I even resumed it 4 times). Most other download managers only downloaded 79Mb. Feel free to try any link from the mirror page that I posted in the first post.

Cheers,
Bogdan

[ghisler(Author)]

Hmm, it could be that TC was confused by the reported size > 6 GB (resulting in an integer conversion error), and therefore assuming an invalid response. I will try to find a workaround. It's quite unusual to find a file >4GB online, that's why this was probably never encountered...

[mastabog]

Hmm, it could be that TC was confused by the reported size > 6 GB (resulting in an integer conversion error), and therefore assuming an invalid response. I will try to find a workaround. It's quite unusual to find a file >4GB online, that's why this was probably never encountered...

Yep ... though the size reported in the http header is ok (Content-Length: 4370640896). Too rare are the files bigger than 4Gb. I drew this conclusion also from the fact that every single download program out there had bugs or didn't even retrieve the whole file ... TC did got me the file

[ghisler(Author)]

I found the error - I changed a function strtoint to strtofloat, and now it works! The file gives me a download time of about 20 hours - I will not wait for this to complete.

[mastabog]

great news ... I don't mean to sing praises, but here's the reply I got from the ReGet (a popular downloader program) developers to the email i sent them about the same problem (reget didn't even finish the file, it stopped at 79mb):

Hello, Bogdan.

The problems is ReGet sometimes doesn't work correctly with the files larger than 3Gb. You can use Internet Explorer but it's not as useful as ReGet of cource.

We're working at this problem, but it's hard to solve it.

What can I say ...