FTP: Problem with uploading multiple large files

[DarkRuleR]

Hello,

When I use FTP to upload 2 large (> 1Gb) video files TC hangs after the first file.
And I have to click cancel to continue.
The second file exists on the FTP server but is only 0kb.

With other FTP clients like FlashFXP and FileZilla it works fine.

The FTP server is a Synology DiskStation 412.

I have tested it with TC v8.01 (64 & 32).
With a clean wcx_ftp.ini with these settings:

[General]
SpecialFlags=6
UploadBlockSize=46720

Passive mode on.
Upload in background (separate thread) off.

Logging:

----------
Connect to: (16-11-2013 18:11:05)
hostname=<deleted>
username=ftp-user
startdir=
<deleted>=<deleted>
220 DiskStation412 FTP server ready.
AUTH TLS
234 AUTH SSL command successful.
Cert subject: /C=TW/ST=Taiwan/L=Taipei/O=Synology Inc./OU=FTP Team/CN=synology.com/emailAddress=product@synology.com
Cert issuer: /C=TW/ST=Taiwan/L=Taipei/O=Synology Inc./OU=Certificate Authority/CN=Synology Inc. CA/emailAddress=product@synology.com
USER ftp-user
331 Password required for ftp-user.
PASS ***********
230 User ftp-user logged in.
SYST
215 UNIX Type: L8
FEAT
211- Extensions supported:
AUTH TLS
PBSZ
PROT
SIZE
MDTM
MFMT
REST STREAM
211 End.
PBSZ 0
200 PBSZ command successful (PBSZ=0).
PROT P
200 Protection level set to Private.
OPTS UTF8 ON
500 UTF8: command not understood.
Connect ok!
PWD
257 "/" is current directory.
Get directory
TYPE A
200 Type set to A.
PASV
227 Entering Passive Mode (<deleted>,5,127)
LIST
150 Opening BINARY mode SSL data connection for 'file list'.
Download
Waiting for server...
226 Transfer complete.
CWD video
250 CWD command successful.
PWD
257 "/video" is current directory.
Get directory
PASV
227 Entering Passive Mode (<deleted>,5,129)
LIST
150 Opening BINARY mode SSL data connection for 'file list'.
Download
Waiting for server...
226 Transfer complete.
CWD upload_test
250 CWD command successful.
PWD
257 "/video/upload_test" is current directory.
Get directory
PASV
227 Entering Passive Mode (<deleted>,5,129)
LIST
150 Opening BINARY mode SSL data connection for 'file list'.
Download
Waiting for server...
226 Transfer complete.
TYPE I
200 Type set to I.
PASV
227 Entering Passive Mode (<deleted>,5,129)
STOR testvideo001.mkv
150 Opening BINARY mode SSL data connection for 'testvideo001.mkv'.
Upload: 1.296.245.615 bytes, 1.155 kbytes/s
Cancel pressed!
SIZE testvideo001.mkv
SSL_read returned -1, SSL_get_error=5, ERR_get_error=0
OFFLINE2, error=0
Copied (16-11-2013 18:24:42): C:\temp\testvideo001.mkv -> ftps://<deleted>/video/upload_test/testvideo001.mkv 1.296.245.615 bytes, 1.564 kbytes/s
----------
Connect to: (16-11-2013 18:24:42)
hostname=<deleted>
username=ftp-user
startdir=/video/upload_test
<deleted>=<deleted>
220 DiskStation412 FTP server ready.
AUTH TLS
234 AUTH SSL command successful.
Cert subject: /C=TW/ST=Taiwan/L=Taipei/O=Synology Inc./OU=FTP Team/CN=synology.com/emailAddress=product@synology.com
Cert issuer: /C=TW/ST=Taiwan/L=Taipei/O=Synology Inc./OU=Certificate Authority/CN=Synology Inc. CA/emailAddress=product@synology.com
USER ftp-user
331 Password required for ftp-user.
PASS ***********
230 User ftp-user logged in.
SYST
215 UNIX Type: L8
FEAT
211- Extensions supported:
AUTH TLS
PBSZ
PROT
SIZE
MDTM
MFMT
REST STREAM
211 End.
PBSZ 0
200 PBSZ command successful (PBSZ=0).
PROT P
200 Protection level set to Private.
Connect ok!
CWD /video/upload_test
250 CWD command successful.
PWD
257 "/video/upload_test" is current directory.
TYPE I
200 Type set to I.
SIZE testvideo001.mkv
213 1296245615
PASV
227 Entering Passive Mode (<deleted>,5,122)
STOR testvideo002.mkv
150 Opening BINARY mode SSL data connection for 'testvideo002.mkv'.
Upload
226 Transfer complete.
Get directory
TYPE A
200 Type set to A.
PASV
227 Entering Passive Mode (<deleted>,5,124)
LIST
150 Opening BINARY mode SSL data connection for 'file list'.
Download
Waiting for server...
226 Transfer complete.

Any idea?

Greetz,

DarkRuleR

[HerbieH]

I have exactly the same problem (have almost the same computerspecs) with a G6FTP server at the other end.

To DarkRuleR: Have you tried to wait (and wait and wait..?) I think the server is calculating checksums (or whatever) before sending a 'upload OK acknowledgement signal'

Mostly, but not always - if I wait from 5 mins up to half an hour - my next upload starts. If I press 'cancel', it makes a zero byte file on the server, and continues with the third file in the row.

Maybe TC is slow negotiating with the server?

[DarkRuleR]

I have exactly the same problem (have almost the same computerspecs) with a G6FTP server at the other end.

To DarkRuleR: Have you tried to wait (and wait and wait..?) I think the server is calculating checksums (or whatever) before sending a 'upload OK acknowledgement signal'

Mostly, but not always - if I wait from 5 mins up to half an hour - my next upload starts. If I press 'cancel', it makes a zero byte file on the server, and continues with the third file in the row.

Maybe TC is slow negotiating with the server?

Yes, I tried waiting for > 1 hour.
But no luck.

Have you tried other FTP clients?
For me FlashFXP and FileZilla works fine.

[ghisler(Author)]

How does the log of these ftp client look? I guess that they also get kicked out and have to reconnect after the upload...

[DarkRuleR]

How does the log of these ftp client look? I guess that they also get kicked out and have to reconnect after the upload...

I have included the client logs.
It seems like the other clients are also kicked out.
But they resume/continue after the first file.

FlashFXP:

FlashFXP 4.4.2 (build 2025)
Support Forums http://forum.flashfxp.com
Winsock 2.2 -- OpenSSL 1.0.1e 11 Feb 2013
[L] Connecting to DiskStation412+ -> DNS=<deleted>
[L] Connected to DiskStation412+
[L] 220 DiskStation412 FTP server ready.
[L] AUTH SSL
[L] 234 AUTH SSL command successful.
[L] Connected. Negotiating SSL/TLS session
[L] TLSv1 negotiation successful...
[L] TLSv1 encrypted session using cipher AES256-SHA (256 bits)
[L] PBSZ 0
[L] 200 PBSZ command successful (PBSZ=0).
[L] USER ftp-user
[L] 331 Password required for ftp-user.
[L] PASS (hidden)
[L] 230 User ftp-user logged in.
[L] SYST
[L] 215 UNIX Type: L8
[L] FEAT
[L] 211- Extensions supported:
[L] AUTH TLS
[L] PBSZ
[L] PROT
[L] SIZE
[L] MDTM
[L] MFMT
[L] REST STREAM
[L] 211 End.
[L] PWD
[L] 257 "/" is current directory.
[L] TYPE A
[L] 200 Type set to A.
[L] PROT P
[L] 200 Protection level set to Private.
[L] PASV
[L] 227 Entering Passive Mode (<deleted>,5,122)
[L] Opening data connection IP: <deleted> PORT: 1402
[L] LIST -al
[L] Connected. Negotiating SSL/TLS session
[L] TLSv1 negotiation successful...
[L] TLSv1 encrypted session using cipher AES256-SHA (256 bits)
[L] 150 Opening BINARY mode SSL data connection for 'file list'.
[L] 226 Transfer complete.
[L] List Complete: 57 bytes in 0,12 second (0,1 KB/s)
[L] CWD video
[L] 250 CWD command successful.
[L] PWD
[L] 257 "/video" is current directory.
[L] PASV
[L] 227 Entering Passive Mode (<deleted>,5,128)
[L] Opening data connection IP: <deleted> PORT: 1408
[L] LIST -al
[L] Connected. Negotiating SSL/TLS session
[L] TLSv1 negotiation successful...
[L] TLSv1 encrypted session using cipher AES256-SHA (256 bits)
[L] 150 Opening BINARY mode SSL data connection for 'file list'.
[L] 226 Transfer complete.
[L] List Complete: 203 bytes in 0,09 second (0,2 KB/s)
[L] CWD upload_test
[L] 250 CWD command successful.
[L] PWD
[L] 257 "/video/upload_test" is current directory.
[L] PASV
[L] 227 Entering Passive Mode (<deleted>,5,121)
[L] Opening data connection IP: <deleted> PORT: 1401
[L] LIST -al
[L] Connected. Negotiating SSL/TLS session
[L] TLSv1 negotiation successful...
[L] TLSv1 encrypted session using cipher AES256-SHA (256 bits)
[L] 150 Opening BINARY mode SSL data connection for 'file list'.
[L] 226 Transfer complete.
[L] List Complete: 0 bytes in 0,08 second (0,0 KB/s)
[L] TYPE I
[L] 200 Type set to I.
[L] SIZE testvideo001.mkv
[L] 550 testvideo001.mkv: No such file or directory.
[L] PASV
[L] 227 Entering Passive Mode (<deleted>,5,126)
[L] Opening data connection IP: <deleted> PORT: 1406
[L] STOR testvideo001.mkv
[L] Connected. Negotiating SSL/TLS session
[L] TLSv1 negotiation successful...
[L] TLSv1 encrypted session using cipher AES256-SHA (256 bits)
[L] 150 Opening BINARY mode SSL data connection for 'testvideo001.mkv'.
[L] Connection lost: DiskStation412+ (Duration: 17 minutes 27 seconds / Idle: 17 minutes 18 seconds)
Upload: testvideo001.mkv 1,21 GB in 17 minutes 18 seconds (1,19 MB/s)
[L] Attempting to Reconnect.
[L] Connecting to DiskStation412+ -> DNS=<deleted> (attempt # 1)
[L] Connected to DiskStation412+
[L] 220 DiskStation412 FTP server ready.
[L] AUTH SSL
[L] 234 AUTH SSL command successful.
[L] Connected. Negotiating SSL/TLS session
[L] TLSv1 negotiation successful...
[L] TLSv1 encrypted session using cipher AES256-SHA (256 bits)
[L] PBSZ 0
[L] 200 PBSZ command successful (PBSZ=0).
[L] USER ftp-user
[L] 331 Password required for ftp-user.
[L] PASS (hidden)
[L] 230 User ftp-user logged in.
[L] SYST
[L] 215 UNIX Type: L8
[L] FEAT
[L] 211- Extensions supported:
[L] AUTH TLS
[L] PBSZ
[L] PROT
[L] SIZE
[L] MDTM
[L] MFMT
[L] REST STREAM
[L] 211 End.
[L] PWD
[L] 257 "/" is current directory.
[L] CWD /video/upload_test
[L] 250 CWD command successful.
[L] PWD
[L] 257 "/video/upload_test" is current directory.
[L] TYPE A
[L] 200 Type set to A.
[L] PROT P
[L] 200 Protection level set to Private.
[L] PASV
[L] 227 Entering Passive Mode (<deleted>,5,129)
[L] Opening data connection IP: <deleted> PORT: 1409
[L] LIST -al
[L] Connected. Negotiating SSL/TLS session
[L] TLSv1 negotiation successful...
[L] TLSv1 encrypted session using cipher AES256-SHA (256 bits)
[L] 150 Opening BINARY mode SSL data connection for 'file list'.
[L] 226 Transfer complete.
[L] List Complete: 75 bytes in 0,12 second (0,1 KB/s)
[L] Calculating timezone offset of server...
[L] MDTM testvideo001.mkv
[L] 213 20131118183727
[L] Timezone offsets: Server: 3600 seconds. Local: 3600 seconds. Difference: 0 seconds.
[L] MFMT 20121001020822 /video/upload_test/testvideo001.mkv
[L] 213 Modify=20121001020822; /video/upload_test/testvideo001.mkv
[L] TYPE I
[L] 200 Type set to I.
[L] SIZE testvideo002.mkv
[L] 550 testvideo002.mkv: No such file or directory.
[L] PASV
[L] 227 Entering Passive Mode (<deleted>,5,126)
[L] Opening data connection IP: <deleted> PORT: 1406
[L] STOR testvideo002.mkv
[L] Connected. Negotiating SSL/TLS session
[L] TLSv1 negotiation successful...
[L] TLSv1 encrypted session using cipher AES256-SHA (256 bits)
[L] 150 Opening BINARY mode SSL data connection for 'testvideo002.mkv'.
[L] Connection lost: DiskStation412+ (Duration: 18 minutes 4 seconds / Idle: 18 minutes 1 second)
Transferred 1 File (1,21 GB) in 35 minutes 24 seconds (596,0 KB/s)
Upload: testvideo002.mkv 1,24 GB in 18 minutes 1 second (1,18 MB/s)
[L] Attempting to Reconnect.
[L] Connecting to DiskStation412+ -> DNS=<deleted> (attempt # 1)
[L] Connected to DiskStation412+
[L] 220 DiskStation412 FTP server ready.
[L] AUTH SSL
[L] 234 AUTH SSL command successful.
[L] Connected. Negotiating SSL/TLS session
[L] TLSv1 negotiation successful...
[L] TLSv1 encrypted session using cipher AES256-SHA (256 bits)
[L] PBSZ 0
[L] 200 PBSZ command successful (PBSZ=0).
[L] USER ftp-user
[L] 331 Password required for ftp-user.
[L] PASS (hidden)
[L] 230 User ftp-user logged in.
[L] SYST
[L] 215 UNIX Type: L8
[L] FEAT
[L] 211- Extensions supported:
[L] AUTH TLS
[L] PBSZ
[L] PROT
[L] SIZE
[L] MDTM
[L] MFMT
[L] REST STREAM
[L] 211 End.
[L] PWD
[L] 257 "/" is current directory.
[L] CWD /video/upload_test
[L] 250 CWD command successful.
[L] PWD
[L] 257 "/video/upload_test" is current directory.
[L] TYPE A
[L] 200 Type set to A.
[L] PROT P
[L] 200 Protection level set to Private.
[L] PASV
[L] 227 Entering Passive Mode (<deleted>,5,127)
[L] Opening data connection IP: <deleted> PORT: 1407
[L] LIST -al
[L] Connected. Negotiating SSL/TLS session
[L] TLSv1 negotiation successful...
[L] TLSv1 encrypted session using cipher AES256-SHA (256 bits)
[L] 150 Opening BINARY mode SSL data connection for 'file list'.
[L] 226 Transfer complete.
[L] List Complete: 150 bytes in 0,10 second (0,1 KB/s)
[L] MFMT 20121008020749 /video/upload_test/testvideo002.mkv
[L] 213 Modify=20121008020749; /video/upload_test/testvideo002.mkv
[L] PASV
[L] 227 Entering Passive Mode (<deleted>,5,122)
[L] Opening data connection IP: <deleted> PORT: 1402
[L] LIST -al
[L] Connected. Negotiating SSL/TLS session
[L] TLSv1 negotiation successful...
[L] TLSv1 encrypted session using cipher AES256-SHA (256 bits)
[L] 150 Opening BINARY mode SSL data connection for 'file list'.
[L] 226 Transfer complete.
[L] List Complete: 150 bytes in 0,08 second (0,1 KB/s)
Transfer queue completed
Transferred 2 Files (2,45 GB) in 35 minutes 28 seconds (1,18 MB/s)

FileZilla:

11:29:11 Status: Resolving address of <deleted>
11:29:11 Status: Connecting to <deleted>...
11:29:11 Status: Connection established, waiting for welcome message...
11:29:11 Response: 220 DiskStation412 FTP server ready.
11:29:11 Command: AUTH TLS
11:29:11 Response: 234 AUTH SSL command successful.
11:29:11 Status: Initializing TLS...
11:29:11 Status: Verifying certificate...
11:29:11 Command: USER ftp-user
11:29:11 Status: TLS/SSL connection established.
11:29:11 Response: 331 Password required for ftp-user.
11:29:11 Command: PASS *****************
11:29:12 Response: 230 User ftp-user logged in.
11:29:12 Command: SYST
11:29:12 Response: 215 UNIX Type: L8
11:29:12 Command: FEAT
11:29:12 Response: 211- Extensions supported:
11:29:12 Response: AUTH TLS
11:29:12 Response: PBSZ
11:29:12 Response: PROT
11:29:12 Response: SIZE
11:29:12 Response: MDTM
11:29:12 Response: MFMT
11:29:12 Response: REST STREAM
11:29:12 Response: 211 End.
11:29:12 Status: Server does not support non-ASCII characters.
11:29:12 Command: PBSZ 0
11:29:12 Response: 200 PBSZ command successful (PBSZ=0).
11:29:12 Command: PROT P
11:29:12 Response: 200 Protection level set to Private.
11:29:12 Status: Connected
11:29:12 Status: Retrieving directory listing...
11:29:12 Command: PWD
11:29:12 Response: 257 "/" is current directory.
11:29:12 Command: TYPE I
11:29:12 Response: 200 Type set to I.
11:29:12 Command: PASV
11:29:12 Response: 227 Entering Passive Mode (<deleted>,5,130)
11:29:12 Command: LIST
11:29:12 Response: 150 Opening BINARY mode SSL data connection for 'file list'.
11:29:12 Response: 226 Transfer complete.
11:29:12 Status: Directory listing successful
11:29:15 Status: Retrieving directory listing...
11:29:15 Command: CWD video
11:29:15 Response: 250 CWD command successful.
11:29:15 Command: PWD
11:29:15 Response: 257 "/video" is current directory.
11:29:15 Command: PASV
11:29:15 Response: 227 Entering Passive Mode (<deleted>,5,122)
11:29:15 Command: LIST
11:29:15 Response: 150 Opening BINARY mode SSL data connection for 'file list'.
11:29:15 Response: 226 Transfer complete.
11:29:15 Status: Directory listing successful
11:29:17 Status: Retrieving directory listing...
11:29:17 Command: CWD upload_test
11:29:18 Response: 250 CWD command successful.
11:29:18 Command: PWD
11:29:18 Response: 257 "/video/upload_test" is current directory.
11:29:18 Command: PASV
11:29:18 Response: 227 Entering Passive Mode (<deleted>,5,131)
11:29:18 Command: LIST
11:29:18 Response: 150 Opening BINARY mode SSL data connection for 'file list'.
11:29:18 Response: 226 Transfer complete.
11:29:18 Status: Directory listing successful
11:29:39 Status: Resolving address of <deleted>
11:29:39 Status: Connecting to <deleted>...
11:29:39 Status: Connection established, waiting for welcome message...
11:29:39 Response: 220 DiskStation412 FTP server ready.
11:29:39 Command: AUTH TLS
11:29:39 Response: 234 AUTH SSL command successful.
11:29:39 Status: Initializing TLS...
11:29:39 Status: Verifying certificate...
11:29:39 Command: USER ftp-user
11:29:39 Status: TLS/SSL connection established.
11:29:39 Response: 331 Password required for ftp-user.
11:29:39 Command: PASS *****************
11:29:40 Response: 230 User ftp-user logged in.
11:29:40 Status: Server does not support non-ASCII characters.
11:29:40 Command: PBSZ 0
11:29:40 Response: 200 PBSZ command successful (PBSZ=0).
11:29:40 Command: PROT P
11:29:40 Response: 200 Protection level set to Private.
11:29:40 Status: Connected
11:29:40 Status: Starting upload of E:\temp\testvideo001.mkv
11:29:40 Command: CWD /video/upload_test
11:29:40 Response: 250 CWD command successful.
11:29:40 Command: PWD
11:29:40 Response: 257 "/video/upload_test" is current directory.
11:29:40 Command: TYPE I
11:29:40 Response: 200 Type set to I.
11:29:40 Command: PASV
11:29:40 Response: 227 Entering Passive Mode (<deleted>,5,129)
11:29:40 Command: STOR testvideo001.mkv
11:29:40 Response: 150 Opening BINARY mode SSL data connection for 'testvideo001.mkv'.
11:34:18 Response: 421 Timeout (300 seconds): closing control connection.
11:34:18 Error: GnuTLS error -110: The TLS connection was non-properly terminated.
11:34:18 Status: Server did not properly shut down TLS connection
11:34:18 Error: Disconnected from server: ECONNABORTED - Connection aborted
11:42:16 Error: Connection timed out
11:42:16 Error: File transfer failed after transferring 1.296.245.615 bytes in 756 seconds
11:42:16 Status: Resolving address of <deleted>
11:42:16 Status: Connecting to <deleted>...
11:42:16 Status: Connection established, waiting for welcome message...
11:42:16 Response: 220 DiskStation412 FTP server ready.
11:42:16 Command: AUTH TLS
11:42:16 Response: 234 AUTH SSL command successful.
11:42:16 Status: Initializing TLS...
11:42:16 Status: Verifying certificate...
11:42:16 Command: USER ftp-user
11:42:16 Status: TLS/SSL connection established.
11:42:16 Response: 331 Password required for ftp-user.
11:42:16 Command: PASS *****************
11:42:17 Response: 230 User ftp-user logged in.
11:42:17 Status: Server does not support non-ASCII characters.
11:42:17 Command: PBSZ 0
11:42:17 Response: 200 PBSZ command successful (PBSZ=0).
11:42:17 Command: PROT P
11:42:17 Response: 200 Protection level set to Private.
11:42:17 Status: Connected
11:42:17 Status: Starting upload of E:\temp\testvideo001.mkv
11:42:17 Command: CWD /video/upload_test
11:42:17 Response: 250 CWD command successful.
11:42:17 Status: Retrieving directory listing...
11:42:17 Command: TYPE I
11:42:17 Response: 200 Type set to I.
11:42:17 Command: PASV
11:42:17 Response: 227 Entering Passive Mode (<deleted>,5,128)
11:42:17 Command: LIST
11:42:17 Response: 150 Opening BINARY mode SSL data connection for 'file list'.
11:42:17 Response: 226 Transfer complete.
11:42:17 Status: Calculating timezone offset of server...
11:42:17 Command: MDTM testvideo001.mkv
11:42:17 Response: 213 20131119104155
11:42:17 Status: Timezone offsets: Server: 3600 seconds. Local: 3600 seconds. Difference: 0 seconds.
11:42:17 Command: PASV
11:42:17 Response: 227 Entering Passive Mode (<deleted>,5,131)
11:42:17 Command: REST 1296245615
11:42:17 Response: 350 Restarting at 1296245615. Send STORE or RETRIEVE to initiate transfer.
11:42:17 Command: STOR testvideo001.mkv
11:42:17 Response: 150 Opening BINARY mode SSL data connection for 'testvideo001.mkv'.
11:42:17 Response: 226 Transfer complete.
11:42:17 Status: File transfer successful, transferred 0 bytes in 1 second
11:42:17 Status: Starting upload of E:\temp\testvideo002.mkv
11:42:17 Command: PASV
11:42:17 Response: 227 Entering Passive Mode (<deleted>,5,121)
11:42:17 Command: REST 0
11:42:17 Response: 350 Restarting at 0. Send STORE or RETRIEVE to initiate transfer.
11:42:17 Command: STOR testvideo002.mkv
11:42:17 Response: 150 Opening BINARY mode SSL data connection for 'testvideo002.mkv'.
11:55:24 Error: Connection timed out
11:55:24 Error: File transfer failed after transferring 1.334.687.006 bytes in 787 seconds
11:55:24 Status: Resolving address of <deleted>
11:55:24 Status: Connecting to <deleted>...
11:55:24 Status: Connection established, waiting for welcome message...
11:55:24 Response: 220 DiskStation412 FTP server ready.
11:55:24 Command: AUTH TLS
11:55:24 Response: 234 AUTH SSL command successful.
11:55:24 Status: Initializing TLS...
11:55:25 Status: Verifying certificate...
11:55:25 Command: USER ftp-user
11:55:25 Status: TLS/SSL connection established.
11:55:25 Response: 331 Password required for ftp-user.
11:55:25 Command: PASS *****************
11:55:25 Response: 230 User ftp-user logged in.
11:55:25 Status: Server does not support non-ASCII characters.
11:55:25 Command: PBSZ 0
11:55:26 Response: 200 PBSZ command successful (PBSZ=0).
11:55:26 Command: PROT P
11:55:26 Response: 200 Protection level set to Private.
11:55:26 Status: Connected
11:55:26 Status: Starting upload of E:\temp\testvideo002.mkv
11:55:26 Command: CWD /video/upload_test
11:55:26 Response: 250 CWD command successful.
11:55:26 Status: Retrieving directory listing...
11:55:26 Command: TYPE I
11:55:26 Response: 200 Type set to I.
11:55:26 Command: PASV
11:55:26 Response: 227 Entering Passive Mode (<deleted>,5,126)
11:55:26 Command: LIST
11:55:26 Response: 150 Opening BINARY mode SSL data connection for 'file list'.
11:55:26 Response: 226 Transfer complete.
11:55:26 Command: PASV
11:55:26 Response: 227 Entering Passive Mode (<deleted>,5,131)
11:55:26 Command: REST 1334687006
11:55:26 Response: 350 Restarting at 1334687006. Send STORE or RETRIEVE to initiate transfer.
11:55:26 Command: STOR testvideo002.mkv
11:55:26 Response: 150 Opening BINARY mode SSL data connection for 'testvideo002.mkv'.
11:55:26 Response: 226 Transfer complete.
11:55:26 Status: File transfer successful, transferred 0 bytes in 1 second
11:55:26 Status: Retrieving directory listing...
11:55:26 Command: PASV
11:55:26 Response: 227 Entering Passive Mode (<deleted>,5,121)
11:55:26 Command: REST 0
11:55:26 Response: 350 Restarting at 0. Send STORE or RETRIEVE to initiate transfer.
11:55:26 Command: LIST
11:55:26 Response: 150 Opening BINARY mode SSL data connection for 'file list'.
11:55:26 Response: 226 Transfer complete.
11:55:26 Status: Directory listing successful

Greetz,

DarkRuleR

[ghisler(Author)]

It seems that they get a "Connection timed out " error but TC does not.

[DarkRuleR]

It seems that they get a "Connection timed out " error but TC does not.

After uploading a file TC checks if the file is uploaded correctly using the "SIZE" command?
I assume that in my case this fails because the connection timed out.

Is it possible to add a function in TC that checks if the "SIZE" command was executed successfully and if not TC tries to reconnect to the server?

Greetz,

DarkRuleR

[ghisler(Author)]

No, I checked it in the debugger - TC waits for the "transfer complete" message from the server, but it never comes. TC also doesn't get a "connection reset" or "connection close" error when trying to read from the control connection.

I have now added a 20 second timeout, so it will at least continue with the next file after the timeout. Unfortunately I don't have access to a server with this strange behaviour, so I cannot say whether it helps or not.

[Sob]

It works.

I don't have such server either, but it's very easy to reproduce. Connect to ftp server and start upload. Add drop rule for port 21 to router's firewall (obviously the connection must go through router, so the easiest is to connect to some server on internet). TC finishes uploading first file and wants to continue with next one, but control connection is dead. Previous versions would hang for longer than I was willing to wait. Beta 10 waits 20 seconds and then tries to reconnect.

[ghisler(Author)]

My home router/firewall doesn't seem to have such a drop rule. But I'm running iptables on ghisler.com, is there a rule for iptables to disconnect port 21 after, say, 5 minutes?

[DarkRuleR]

It also works for me with v8.50 beta 10!


Thank you!!!

@ghisler(Author) I have created a test account on my DiskStation FTP server for you.
Please let me know if you want to use this and how you want to receive the login details.

[ghisler(Author)]

Great, please send the details to support at ghisler dot com. Please set a non-trivial password, not just user/pass or so.

[Sob]

My home router/firewall doesn't seem to have such a drop rule.

Sorry, since I got RouterBoard(*1), I often forget about limited home routers. :)

But I'm running iptables on ghisler.com, is there a rule for iptables to disconnect port 21 after, say, 5 minutes?

You don't need any timer. As you know, once the transfer starts, there are no packets going over control connection (that's why it gets dropped by some impatient firewall/NAT on the way). You can add the rule manually, while the first file is uploading. Just run something like "iptables -I 1 OUTPUT -p tcp --sport 21 -j DROP" on server and wait until upload finishes. When you see TC trying to reconnect, remove the rule and see that is succeeds and continues. If you choose first file with right size, you can make whole test in two minutes.

--
(*1) - It has a little closed down (one significant downside) Linux-based system, but still with full power of iptables and that with nice and friendly native Windows admin GUI (no suffering in limited web interface!). Working with firewall there is great. Dragging rules by mouse, live packet counters, ... It's not even work, it's joyful play. They have x86 version of OS too and also free (limited but usable) licence, perfect for building virtual network lab for testing. End of advertising. :)

[ghisler(Author)]

Doesn't this rule prevent the reconnection too?

[Sob]

It does. But you can see TC trying. And when you do, you can remove the rule and it will succeed. Either almost immediately, if you are quick enough or after another 20(?) seconds delay.