Get directory content faster with many files!

English support forum

Moderators: white, Hacker, petermad, Stefan2

User avatar
makinero
Senior Member
Senior Member
Posts: 268
Joined: 2013-10-26, 10:05 UTC

Get directory content faster with many files!

Post by *makinero »

Code: Select all

Reading Directories: 1 (Esc to abort)
[Cancel]
More than 100k large subfolders to read... so it slowly.
The window locks GUI.
How to move to the background?
Possible to change the advanced settings, can * .INI
Last edited by makinero on 2017-03-16, 06:34 UTC, edited 1 time in total.
User avatar
tuska
Power Member
Power Member
Posts: 3755
Joined: 2007-05-21, 12:17 UTC

Post by *tuska »

Similar topic:
http://ghisler.ch/board/viewtopic.php?t=47409

If you first open a separate TC instance, then you already have a TC instance, which is then not blocked.
User avatar
makinero
Senior Member
Senior Member
Posts: 268
Joined: 2013-10-26, 10:05 UTC

Post by *makinero »

but it works (no blocks GUI) in TC 9 Beta 1.

http://www.ghisler.com/900_b1.php

in spite of all still is unstable version does not always work correctly
User avatar
ghisler(Author)
Site Admin
Site Admin
Posts: 48077
Joined: 2003-02-04, 09:46 UTC
Location: Switzerland
Contact:

Post by *ghisler(Author) »

This isn't a bug, it's a new feature! The dialog is shown after a certain time to allow the user to abort the reading. The reading itself shouldn't be slower than before.
Author of Total Commander
https://www.ghisler.com
User avatar
makinero
Senior Member
Senior Member
Posts: 268
Joined: 2013-10-26, 10:05 UTC

Post by *makinero »

Unfortunately, reading large directories in TC - is very slow compared to the Explorer. That's the truth.
For example. In the Explorer - it takes X or XX seconds, TC sometimes several minutes (First Read 2:59 min 108K subfolders containing many small files)
User avatar
Lefteous
Power Member
Power Member
Posts: 9535
Joined: 2003-02-09, 01:18 UTC
Location: Germany
Contact:

Post by *Lefteous »

The question in this case is as always if the problem is the folder reading or filling the listbox with so many items...
User avatar
makinero
Senior Member
Senior Member
Posts: 268
Joined: 2013-10-26, 10:05 UTC

Post by *makinero »

Read is not designed assuming that it have all the data in RAM so it will be not fast.

Other tool read speed of 400 MB/s (3-4 TB) in peaks 500 MB/s (2TB)
use 3 500 000 KB RAM
User avatar
Horst.Epp
Power Member
Power Member
Posts: 6480
Joined: 2003-02-06, 17:36 UTC
Location: Germany

Post by *Horst.Epp »

makinero wrote:Read is not designed assuming that it have all the data in RAM so it will be not fast.

Other tool read speed of 400 MB/s (3-4 TB) in peaks 500 MB/s (2TB)
use 3 500 000 KB RAM
And again, we have that anonymous other tool which only you know :cry:
Windows 11 Home x64 Version 23H2 (OS Build 22631.3447)
TC 11.03 x64 / x86
Everything 1.5.0.1371a (x64), Everything Toolbar 1.3.3, Listary Pro 6.3.0.73
QAP 11.6.3.2 x64
User avatar
makinero
Senior Member
Senior Member
Posts: 268
Joined: 2013-10-26, 10:05 UTC

Post by *makinero »

Well, I have written in this forum program name, the next time please use the search engine

https://www.powergrep.com/
PowerGREP:
Quickly search through large numbers of files on your PC or network using powerful text patterns to find exactly the information you want. Search and replace with plain text or regular expressions to maintain web sites, source code, reports, ...
but I want more intuitive simpler the interface of this application, so I ask to performance TC
User avatar
makinero
Senior Member
Senior Member
Posts: 268
Joined: 2013-10-26, 10:05 UTC

Post by *makinero »

Lefteous wrote:The question in this case is as always if the problem is the folder reading or filling the listbox with so many items...
problem is the folder reading.


Why do 50% of my medium and large folders on the disk is read slowly.
Explorer - always wins with speed, not to mention other specialist tools read "MFT " always win with TC.
TC - was never not be fast. Never. Nobody translate weight on the overall speed. No one. Because there are other more important things?
I dream of such a tool, which will be able to handle today's large server disks at high speed. Is any progress made in this TC. The answer is. No.
User avatar
Lefteous
Power Member
Power Member
Posts: 9535
Joined: 2003-02-09, 01:18 UTC
Location: Germany
Contact:

Post by *Lefteous »

2makinero
problem is the folder reading.


Why do 50% of my medium and large folders on the disk is read slowly.
Explorer - always wins with speed, not to mention other specialist tools read "MFT " always win with TC.
TC - was never not be fast. Never. Nobody translate weight on the overall speed. No one. Because there are other more important things?
I dream of such a tool, which will be able to handle today's large server disks at high speed. Is any progress made in this TC. The answer is. No.
I can't find any evidence in your post that folder enumeration is the problem not displaying items. You may be interested in a discussion about the way TC displays items: http://www.ghisler.ch/board/viewtopic.php?p=123583#123583
User avatar
makinero
Senior Member
Senior Member
Posts: 268
Joined: 2013-10-26, 10:05 UTC

Post by *makinero »

Lefteous wrote: I can't find any evidence in your post that folder enumeration is the problem not displaying items. You may be interested in a discussion about the way TC displays items: http://www.ghisler.ch/board/viewtopic.php?p=123583#123583
This topic is 10 years old!
It has nothing to do with my issue!
Why you dig up old threads?
User avatar
Lefteous
Power Member
Power Member
Posts: 9535
Joined: 2003-02-09, 01:18 UTC
Location: Germany
Contact:

Post by *Lefteous »

It has nothing to do with my issue!
Why you dig up old threads?
It's definitely related to your issue as it deals with displaying very large amounts of items in listboxes or listviews. Explorer for example uses a listview control. So to follow your way to argue one could say that the listbox control in TC is the problem - but it's not that simple. It depends on how it's used. I linked to the thread as I think that it could be the real issue here. There is not so much a developer can do to speed up the actual enumeration.
User avatar
makinero
Senior Member
Senior Member
Posts: 268
Joined: 2013-10-26, 10:05 UTC

Post by *makinero »

Sometimes the application "freezes" (BUSY) for a long time.
Then lose total control over the application.
User avatar
Lefteous
Power Member
Power Member
Posts: 9535
Joined: 2003-02-09, 01:18 UTC
Location: Germany
Contact:

Post by *Lefteous »

Sometimes the application "freezes" (BUSY) for a long time.
Well that's really a different issue. If you have something reproducable fill a bug report.
Post Reply