copy dozen thousands small files

[trevor12]

Good afternoon, when I copy many of small files, the speed decrease significantly, it lasts hours. I know that can experimet in Options with buffers tec. but it will be comfortable that TC before starting copying recognize this situation and internally autoselect best copy method (much quickier is for example firstly make *.rar of whole direcotry with many files with "only store" option, than copy this *.rar to target disk and then unrar this archive on target drive - this process would be automatically happen on the fly in the ram or swap disk driven by TC itself.

[trevor12]

worst situation is this copying to flash usb disks or external usb hdd (2TB)

[ghisler(Author)]

The creation of small files is quite slow, not only because there are additional write and seek operations needed for each file, but also because each file is scanned by a virus scanner. Therefore creating a single ZIP file on the flash disk is much faster.

[trevor12]

although I had turn off virus scanner writing files check the copy speed was extremely slow anyway ... for example my full installation directory of \cygwin has 23387 subdirectories and 391373 files ...

what I want to TC would be able (or via plugin), when I run Copy C:\cygwin -> to E:\cygwin (usb 2.0 external hdd 2TB), the TC (or plugin) automatically on the background would do

0) recognize number of files in the directory \cygwin for copying, if number of files is > XY -> then
1) C:\cygwin -> C:\cygwin.rar (store)
2) move cygwin.rar -> E:
3 unrar E:\cygwin.rar to E:\cygwin
4) remove E:\cygwin.rar
5) done

[HolgerK]

3 unrar E:\cygwin.rar to E:\cygwin

Why do you think that this would take less time (together with the packing on C:\) than copying directly from C:\ to E:\ ?

Regards
Holger

[trevor12]

ok I tried it now and you are right, it is not speed improvement via archive .. my mistake


thread closed ...

[solid]

The method of creating rar/zip file speeds up the copying, only when you use the usb device as a carrier for a later extracting content on a another HDD.