[TC 11.50b7] Sync tool: Too slow reading inside solid 7z

The behaviour described in the bug report is either by design, or would be far too complex/time-consuming to be changed

Moderators: Hacker, petermad, Stefan2, white

Post Reply
User avatar
MaxX
Power Member
Power Member
Posts: 1185
Joined: 2012-03-23, 18:15 UTC
Location: UA

[TC 11.50b7] Sync tool: Too slow reading inside solid 7z

Post by *MaxX »

Sync tool is too slow when reading files from the inside of solid 7z.

Also I see that TC reads the 7z archive again for each file inside it.

All I did:
1. Pack ~256 megs of ~1k files into one ~50 megs 7z archive
2. Open this 7z in other side, then open sync tool
3. Compare the original folder and the 7z inside. (include subdirs, by content, ignore dates)

Look here https://i.imgur.com/mXDnHw8.png
Screenshot does not show all the process, there was even nearly 30% compared...

Another shot https://i.imgur.com/ssGYxoQ.png --- ~17 gigs read, ~0.5 gig write, 10 min 20 sec of CPU time
The comparison is finally done. Amazing read bytes and processor time. That is too much to be good.

No plugins used, only original internal 7zip dll and TC 11.50b7 x64 at Win10 22H2 x64.
May be older versions work the same way, can't check right now.


UPD.
Another tests for comparison of proper work in Sync tool:
Total7zip.wcx + 7z 24.08 --- https://i.imgur.com/dLrs5cV.png --- ~1.3 gig read, ~0.25 gig write, 25 sec CPU time
Old 7zip.wcx plugin --- https://i.imgur.com/JjtFCne.png --- ~0.5 gig read, ~0.25 gig write, 5 sec CPU time

Look at the difference...


UPD2.
There's NO problem with "RAR vs RAR" or "RAR vs folder" comparison. Only 7zip.
Ukrainian Total Commander Translator. Feedback and discuss.
User avatar
ghisler(Author)
Site Admin
Site Admin
Posts: 50824
Joined: 2003-02-04, 09:46 UTC
Location: Switzerland
Contact:

Re: [TC 11.50b7] Sync tool: Too slow reading inside solid 7z

Post by *ghisler(Author) »

Currently only RAR solid archives are handled in order. With RAR this is easy: I can extract the files one by one to temp, compare them, and then delete them. With 7-Zip this doesn't work. I would have to tell the unpacker to unpack the entire archive, and then somehow compare the unpacked files in a callback function one by one. The files also couldn't be unpacked to the same temp file.

So for now I cannot add this, sorry. Use RAR if you need this functionality.

Moderator message from: ghisler(Author) » 2024-11-20, 18:16 UTC

Moved to will not be changed
Author of Total Commander
https://www.ghisler.com
Post Reply