Jump to content


Photo

Uploading to local FTP site - large files get to 99% then drop back to part way thru


This topic has been archived. This means that you cannot reply to this topic.
5 replies to this topic

#1 Nick Hill

Nick Hill
  • Members
  • 3 posts

Posted 23 February 2010 - 09:14 AM

I'm trying to FTP a large amount of files (about 2TB) from a local machine to an FTP server which is on the same Windows workgroup (so the IP is something like 192.168.1.65). Small files work fine, but anything larger than a few hundred Mb seems to get to 99% and then restart from 64% or somewhere - all the files "fall back" to different points, but each one seems to return to the same point each time. When it does this, it really quickly returns to almost 100% again (like it's just checking what's there rather than actually reuploading) and then resets itself. I'm running the latest 64-bit version (4.0.1072.0) on Windows Vista x64.

I can manually copy the files across fine in Windows Explorer (the ftp server is also mapped as a network drive), but given the amount of files I need to copy, that's not really a very reliable way to make sure I've got everything.

#2 mb

mb

    Developer

  • Administrators
  • 11521 posts

Posted 23 February 2010 - 09:15 AM

Please post the log from a failed transfer. To get it double click the file in the transfer queue window.

You may also want to install the latest beta version from here:
http://www.smartftp.com/download

#3 Nick Hill

Nick Hill
  • Members
  • 3 posts

Posted 24 February 2010 - 05:50 PM

Please post the log from a failed transfer. To get it double click the file in the transfer queue window.

You may also want to install the latest beta version from here:
http://www.smartftp.com/download


Hi

This is part of it (it seems to be going round in loops):

[17:47:15] SIZE O2_MJ_EXPERIENCE47.MP4
[17:47:15] 213 169574400
[17:47:15] MDTM O2_MJ_EXPERIENCE47.MP4
[17:47:15] 213 20100224164057
[17:47:15] Source File: Size=171454549, Time=2009-11-03T11:50:23
[17:47:15] Destination File: Size=169574400, Time=2010-02-24T16:40:57
[17:47:15] RecentTime=2010-02-24T17:47:15
[17:47:15] Rule "IF Destination Time=Recent AND Size=Smaller AND Transfer=No Matter THEN Resume" matched. Action="Resume".
[17:47:15] PASV
[17:47:15] 227 Entering Passive Mode (192,168,1,65,217,134).
[17:47:15] Opening data connection to 192.168.1.65 Port: 55686
[17:47:15] REST 169574400
[17:47:15] 350 Restarting at 169574400. Send STORE or RETRIEVE to initiate transfer
[17:47:15] STOR O2_MJ_EXPERIENCE47.MP4
[17:47:15] 150 Opening BINARY mode data connection for O2_MJ_EXPERIENCE47.MP4
[17:47:15] 1880149 bytes transferred. (17.2 MB/s) (104 ms)
[17:47:15] 226 Transfer complete
[17:47:15] SIZE O2_MJ_EXPERIENCE47.MP4
[17:47:15] 213 169574400
[17:47:15] Source File Size=171454549, Destination File Size=169574400
[17:47:15] Possible file size discrepancy. Please contact the technical support.
[17:47:15] File size mismatch.
[17:47:15] Transfer failed.
[17:47:15] Operation End
[17:47:15] Operation Begin
[17:47:15] Remote file exist check: "O2_MJ_EXPERIENCE47.MP4".
[17:47:15] SIZE O2_MJ_EXPERIENCE47.MP4
[17:47:15] 213 169574400
[17:47:15] MDTM O2_MJ_EXPERIENCE47.MP4
[17:47:15] 213 20100224164057
[17:47:15] Source File: Size=171454549, Time=2009-11-03T11:50:23
[17:47:15] Destination File: Size=169574400, Time=2010-02-24T16:40:57
[17:47:15] RecentTime=2010-02-24T17:47:15
[17:47:15] Rule "IF Destination Time=Recent AND Size=Smaller AND Transfer=No Matter THEN Resume" matched. Action="Resume".
[17:47:15] PASV
[17:47:15] 227 Entering Passive Mode (192,168,1,65,217,243).
[17:47:15] Opening data connection to 192.168.1.65 Port: 55795
[17:47:15] REST 169574400
[17:47:15] 350 Restarting at 169574400. Send STORE or RETRIEVE to initiate transfer
[17:47:15] STOR O2_MJ_EXPERIENCE47.MP4
[17:47:15] 150 Opening BINARY mode data connection for O2_MJ_EXPERIENCE47.MP4
[17:47:16] 1880149 bytes transferred. (12.5 MB/s) (143 ms)
[17:47:16] 226 Transfer complete
[17:47:16] SIZE O2_MJ_EXPERIENCE47.MP4
[17:47:16] 213 169574400
[17:47:16] Source File Size=171454549, Destination File Size=169574400
[17:47:16] Possible file size discrepancy. Please contact the technical support.
[17:47:16] File size mismatch.
[17:47:16] Transfer failed.
[17:47:16] Operation End
[17:47:16] Operation Begin
[17:47:16] Remote file exist check: "O2_MJ_EXPERIENCE47.MP4".
[17:47:16] SIZE O2_MJ_EXPERIENCE47.MP4
[17:47:16] 213 169574400
[17:47:16] MDTM O2_MJ_EXPERIENCE47.MP4
[17:47:16] 213 20100224164057
[17:47:16] Source File: Size=171454549, Time=2009-11-03T11:50:23
[17:47:16] Destination File: Size=169574400, Time=2010-02-24T16:40:57
[17:47:16] RecentTime=2010-02-24T17:47:16
[17:47:16] Rule "IF Destination Time=Recent AND Size=Smaller AND Transfer=No Matter THEN Resume" matched. Action="Resume".
[17:47:16] PASV
[17:47:16] 227 Entering Passive Mode (192,168,1,65,219,7).
[17:47:16] Opening data connection to 192.168.1.65 Port: 56071
[17:47:16] REST 169574400
[17:47:16] 350 Restarting at 169574400. Send STORE or RETRIEVE to initiate transfer
[17:47:16] STOR O2_MJ_EXPERIENCE47.MP4
[17:47:16] 150 Opening BINARY mode data connection for O2_MJ_EXPERIENCE47.MP4
[17:47:16] Transfer failed.
[17:47:16] Operation End
[17:47:16] Client closed the connection.

-- at this point I aborted it.

#4 mb

mb

    Developer

  • Administrators
  • 11521 posts

Posted 24 February 2010 - 08:10 PM

It's a server bug. It returns the wrong size in the SIZE reply.

#5 Nick Hill

Nick Hill
  • Members
  • 3 posts

Posted 24 February 2010 - 08:13 PM

Oh. It works for some files, though?... including one of about 3GB which uploaded fine. I'm aborting ones in the Q that aren't working - so far there's no consistency on size, they range from 163Mb to 3.6 Gb.

What can I do about this? - Contact the server manufacturer?

#6 mb

mb

    Developer

  • Administrators
  • 11521 posts

Posted 24 February 2010 - 08:34 PM

If you control the FTP server, install an updated version or another FTP server product (e.g. proftpd).

You can see the problem quite easily here:
[17:47:15] SIZE O2_MJ_EXPERIENCE47.MP4
[17:47:15] 213 169574400
-> here the server says that the file size is: 169574400

[17:47:15] REST 169574400
[17:47:15] 350 Restarting at 169574400. Send STORE or RETRIEVE to initiate transfer
[17:47:15] STOR O2_MJ_EXPERIENCE47.MP4
[17:47:15] 150 Opening BINARY mode data connection for O2_MJ_EXPERIENCE47.MP4
[17:47:15] 1880149 bytes transferred. (17.2 MB/s) (104 ms)
-> smartftp has uploaded 1880149 more bytes

[17:47:15] 226 Transfer complete
[17:47:16] SIZE O2_MJ_EXPERIENCE47.MP4
[17:47:16] 213 169574400
-> now the server tells SmartFTP the file size is still the same as before.