Multicore internal ZIP

Here you can propose new features, make suggestions etc.

Moderators: Hacker, petermad, Stefan2, white

Post Reply
User avatar
hlloyge
Member
Member
Posts: 131
Joined: 2006-11-02, 23:14 UTC

Multicore internal ZIP

Post by *hlloyge »

Well, I would like to suggest, if it is possible, to add multicore compression for internal zip archiver, for making really quick backups... is that possible?
User avatar
ghisler(Author)
Site Admin
Site Admin
Posts: 50873
Joined: 2003-02-04, 09:46 UTC
Location: Switzerland
Contact:

Post by *ghisler(Author) »

This would be possible when packing many small files, because each file is compressed separately (no solid archives), but not when packing 1 large file. The ZIP compression doesn't look like it could be parallelized well, because the compression results of later bytes depend on the results of previous bytes.
Author of Total Commander
https://www.ghisler.com
User avatar
hlloyge
Member
Member
Posts: 131
Joined: 2006-11-02, 23:14 UTC

Post by *hlloyge »

That would be an advantage, too, for making quick backups of folders with documents. Can you implement that, please?
User avatar
ghisler(Author)
Site Admin
Site Admin
Posts: 50873
Joined: 2003-02-04, 09:46 UTC
Location: Switzerland
Contact:

Post by *ghisler(Author) »

Sorry, that's not something which could be done over night, it's very complex to get it right. In the worst case, it would be even slower, because the disk operations to read all the various files take a considerable amount (and reading from multiple files at the same time is a very bad idea).
Author of Total Commander
https://www.ghisler.com
User avatar
hlloyge
Member
Member
Posts: 131
Joined: 2006-11-02, 23:14 UTC

Post by *hlloyge »

I wouldn't be asking if it hasn't been done in 7zip's zip compression - it takes multiple cores and compresses files; when dealing with one big file, it does employ just one core; but when dealing with folder with a lot of smaller files, it is considerably faster. Hard drives are not so slow as ten years ago, and they can handle reading four files at the same time.
User avatar
MVV
Power Member
Power Member
Posts: 8711
Joined: 2008-08-03, 12:51 UTC
Location: Russian Federation

Post by *MVV »

hlloyge, you may use 7-Zip's compressor for such cases if you know that it is faster.
User avatar
hlloyge
Member
Member
Posts: 131
Joined: 2006-11-02, 23:14 UTC

Post by *hlloyge »

Well, I am, but if there is a space for improvement, why not improve on internal zip compression?
User avatar
MVV
Power Member
Power Member
Posts: 8711
Joined: 2008-08-03, 12:51 UTC
Location: Russian Federation

Post by *MVV »

I would improve something more important BTW. :D
User avatar
hlloyge
Member
Member
Posts: 131
Joined: 2006-11-02, 23:14 UTC

Post by *hlloyge »

I would improve something more important BTW. Very Happy
You are welcome to do that, but compression is important to ME :)
Post Reply