This forum uses cookies. Click X button to hide this message. What is stored? 
Total Commander Forum Index Total Commander
Forum - Public Discussion and Support
 
 FAQFAQ   SearchSearch   MemberlistMemberlist   UsergroupsUsergroups   RegisterRegister 
 ProfileProfile   Log in to check your private messagesLog in to check your private messages   Log inLog in 

A ZStandard packer Plugin for the Total Commander
Goto page 1, 2  Next
 
Post new topic   Reply to topic    Total Commander Forum Index -> Plugins and addons: devel.+support (English) Printable version
View previous topic :: View next topic  
Author Message
bebbo
Junior Member
Junior Member


Joined: 24 Jun 2009
Posts: 51

PostPosted: Fri Dec 23, 2016 6:08 am    Post subject: A ZStandard packer Plugin for the Total Commander Reply with quote

I wrote a WCX plugin for zstandard http://www.zstd.net/. The packer supports packing of one file, so apply tar before using zstd.

Feel free to download at http://franke.ms/packer/zstd.wiki and test it.
_________________
SFTP4TC - sftp based on PuTTY
report tickets at https://sf.net/p/sftp4tc/tickets
ZSTDWCX - zstd packer http://franke.ms/packer/zstd.wiki
Back to top
View user's profile Send private message
tbeu
Power Member
Power Member


Joined: 04 Jul 2003
Posts: 1189
Location: Germany

PostPosted: Thu Jan 26, 2017 3:49 pm    Post subject: Reply with quote

Thanks for the plugin. However, it does not show the unpacked size yet.
_________________
TC plugins: Autodesk 3ds Max Preview, Blat Mailer, ImageMetaData (JPG Comment/EXIF/IPTC/XMP) , MATLAB MAT-file Viewer, SolidWorks Preview and more
Back to top
View user's profile Send private message Send e-mail Visit poster's website
TW
Senior Member
Senior Member


Joined: 19 Jan 2005
Posts: 306

PostPosted: Thu Jan 26, 2017 5:00 pm    Post subject: Reply with quote

here's a long thread @encode.ru about Zstandard

https://encode.ru/threads/2119-Zstandard
_________________
licenced and happy TC user since 1994 (#11xx)
Back to top
View user's profile Send private message
bebbo
Junior Member
Junior Member


Joined: 24 Jun 2009
Posts: 51

PostPosted: Sun Jan 29, 2017 5:46 pm    Post subject: Reply with quote

tbeu wrote:
Thanks for the plugin. However, it does not show the unpacked size yet.


The size is displayed if the compressed file contains the info of the uncompressed size.

Unfortunately most archives are created using a zstandard stream (many compressed chunks), and then the uncompressed size is not stored.

Bebbo
_________________
SFTP4TC - sftp based on PuTTY
report tickets at https://sf.net/p/sftp4tc/tickets
ZSTDWCX - zstd packer http://franke.ms/packer/zstd.wiki
Back to top
View user's profile Send private message
Slobodoslav
Junior Member
Junior Member


Joined: 30 Jan 2017
Posts: 2

PostPosted: Wed Feb 01, 2017 9:24 am    Post subject: Reply with quote

Thank you for this plugin and good idea of using zstd as it is probably the best compression algorithm out there in term of speed and compression ratio.

Unfortunately there is maybe bug in this version of plugin that it doesn't create readable archives in case compressed file is bigger then 2GB. In this case it also sometimes cause TC crash. That is pity.

Tested with TC 32&64 bit, 8.5 and 9.0a.
Back to top
View user's profile Send private message
bebbo
Junior Member
Junior Member


Joined: 24 Jun 2009
Posts: 51

PostPosted: Wed Feb 01, 2017 12:53 pm    Post subject: Reply with quote

Slobodoslav wrote:
Thank you for this plugin and good idea of using zstd as it is probably the best compression algorithm out there in term of speed and compression ratio.

Unfortunately there is maybe bug in this version of plugin that it doesn't create readable archives in case compressed file is bigger then 2GB. In this case it also sometimes cause TC crash. That is pity.

Tested with TC 32&64 bit, 8.5 and 9.0a.


Good news: the created files are ok. The bug is in the reading part, where opening fails. It's fixed locally so I will soon publish an update.

Bebbo
_________________
SFTP4TC - sftp based on PuTTY
report tickets at https://sf.net/p/sftp4tc/tickets
ZSTDWCX - zstd packer http://franke.ms/packer/zstd.wiki
Back to top
View user's profile Send private message
bebbo
Junior Member
Junior Member


Joined: 24 Jun 2009
Posts: 51

PostPosted: Wed Feb 01, 2017 3:10 pm    Post subject: Reply with quote

The update is available http://franke.ms/download/wcx_zstd_1_1_3_3.zip.

Bebbo
_________________
SFTP4TC - sftp based on PuTTY
report tickets at https://sf.net/p/sftp4tc/tickets
ZSTDWCX - zstd packer http://franke.ms/packer/zstd.wiki
Back to top
View user's profile Send private message
Slobodoslav
Junior Member
Junior Member


Joined: 30 Jan 2017
Posts: 2

PostPosted: Wed Feb 01, 2017 3:36 pm    Post subject: Reply with quote

Thank you Bebbo.
Support for your plugin is better than professional.
I just tested it and it is working like a charm.
It is now the best packer plugin for big files like virtual machines disks etc.
Back to top
View user's profile Send private message
ghisler(Author)
Site Admin
Site Admin


Joined: 04 Feb 2003
Posts: 33614
Location: Switzerland

PostPosted: Thu Feb 02, 2017 4:22 am    Post subject: Reply with quote

If you could support the StartMemPack, PackToMem and DoneMemPack functions, and return PK_CAPS_MEMPACK in GetPackerCaps, then TC could create .tar.zst files directly.

If the zst API works with callbacks, you could create a background thread for packing, and pass the data blocks received from PackToMem to that thread, where the callback would pass the data to the packer.
_________________
Author of Total Commander
http://www.ghisler.com
Back to top
View user's profile Send private message Send e-mail Visit poster's website
bebbo
Junior Member
Junior Member


Joined: 24 Jun 2009
Posts: 51

PostPosted: Thu Feb 02, 2017 7:47 am    Post subject: Reply with quote

ghisler(Author) wrote:
If you could support the StartMemPack, PackToMem and DoneMemPack functions, and return PK_CAPS_MEMPACK in GetPackerCaps, then TC could create .tar.zst files directly.
...


Sorry, I don't see a benefit.

Bebbo
_________________
SFTP4TC - sftp based on PuTTY
report tickets at https://sf.net/p/sftp4tc/tickets
ZSTDWCX - zstd packer http://franke.ms/packer/zstd.wiki
Back to top
View user's profile Send private message
bebbo
Junior Member
Junior Member


Joined: 24 Jun 2009
Posts: 51

PostPosted: Thu Feb 02, 2017 1:05 pm    Post subject: Reply with quote

bebbo wrote:
ghisler(Author) wrote:
If you could support the StartMemPack, PackToMem and DoneMemPack functions, and return PK_CAPS_MEMPACK in GetPackerCaps, then TC could create .tar.zst files directly.
...


Sorry, I don't see a benefit.

Bebbo


Plus (according to wcx_ref2.21se.zip) there is only

Code:

int __stdcall StartMemPack (int Options, char *FileName);


but not:
Code:

int __stdcall StartMemPackW (int Options, wchar_t *FileName);


And it's not clear how to return error codes...

Bebbo[/code]
_________________
SFTP4TC - sftp based on PuTTY
report tickets at https://sf.net/p/sftp4tc/tickets
ZSTDWCX - zstd packer http://franke.ms/packer/zstd.wiki
Back to top
View user's profile Send private message
bebbo
Junior Member
Junior Member


Joined: 24 Jun 2009
Posts: 51

PostPosted: Thu Feb 02, 2017 3:31 pm    Post subject: Reply with quote

A new version is available http://franke.ms/download/wcx_zstd_1_1_3_4.zip .

Code:

VERSION 1.1.3.4 [2017-02-02]
* Added support for MemPack thus tar.zst archives can be created.


Bebbo
_________________
SFTP4TC - sftp based on PuTTY
report tickets at https://sf.net/p/sftp4tc/tickets
ZSTDWCX - zstd packer http://franke.ms/packer/zstd.wiki
Back to top
View user's profile Send private message
lezerogan2
Junior Member
Junior Member


Joined: 19 Apr 2010
Posts: 20

PostPosted: Sun Mar 12, 2017 3:49 am    Post subject: TC crash Reply with quote

I have Windows 10 Home Version 10.0.14393 64bit and Totcmd 9.0a 64bit.
i installed WCX Zstandard packer plugin 1.1.3.4 32/64bit
This plugin works fine with zst extension files but
if i try to unpack any file type that is not a packed file like plain txt file,
TC crashes with alert message:
Total commander has stopped working. a problem caused the program to stop working correctly.
It does not matter if the file has extension ot not.
no entry in TC log file.
If the file is zero size, then the crash is even without an alert message.
This error dose not occurs with other packer plugins (z.wcx, iso.wcx, gifwcx.wcx, total7zip.wcx...)

Just to clarify: sometimes file does not have extension and I want to check if it is a packed file. Sometimes file have a packed type extension but actually it is not. Sometimes I select a lot of files to unpack and it includes some files that are not packed and etc.
Back to top
View user's profile Send private message
Horst.Epp
Power Member
Power Member


Joined: 06 Feb 2003
Posts: 2434
Location: Germany

PostPosted: Sun Mar 12, 2017 10:17 am    Post subject: Reply with quote

bebbo wrote:
A new version is available http://franke.ms/download/wcx_zstd_1_1_3_4.zip .

Code:

VERSION 1.1.3.4 [2017-02-02]
* Added support for MemPack thus tar.zst archives can be created.


Bebbo

The link gives an
Not Found
404
_________________
Windows 10 x64 Creators Update Build 15063.296
TC 9.0a x64 and x86
Back to top
View user's profile Send private message
Ovg
Senior Member
Senior Member


Joined: 06 Jan 2014
Posts: 451
Location: Moscow

PostPosted: Sun Mar 12, 2017 10:36 am    Post subject: Reply with quote

There is a dot at the end of the link. It should be removed ...
http://franke.ms/download/wcx_zstd_1_1_3_4.zip
_________________
It's impossible to lead us astray for we don't care even to choose the way.
#259941, TC 9.0a x64, Windows 7 SP1 x64
Back to top
View user's profile Send private message Send e-mail
Display posts from previous:   
Post new topic   Reply to topic    Total Commander Forum Index -> Plugins and addons: devel.+support (English) All times are GMT - 6 Hours
Goto page 1, 2  Next
Page 1 of 2

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum


Impressum: This site is maintained by Ghisler Software GmbH

Using phpBB © 2001-2005 phpBB Group