jdruding
I have scheduled my My Pictures folder to be uploaded to server as a remote backup solution. I'm in the process of establishing the the first full back up. It is rather large so is taking days. Every couple of days, it will get hung up on a particular image and will continually upload the same image over and over again. I though it might have something to do with the default "file exists" rules for determining if a file should be overwritten so I simplified them to be:
IF Destination Time = No Matter AND Size = Equal AND Transfer=No Matter THEN Skip
Default Action: Overwrite
Looking at the original file on the server, it does appear to be a partial file. According to the log, it appears to recognize that the file size is different but instead of overwritting, it creates another copy, appending something like -100, -101, -103, etc. I have also noticed this loop may start if I suddenly close out SmartFTP or my FTP Gateway. I guessing that a network glitch causes the connection to break, leaving a partial file and when the connection restarts, it doesn't overwrite properly, creates new files with the extension. The new file with the extension is now the correct file size, but SmartFTP goes back and checks the original file, which of course is the wrong size and it makes another copy. Any ideas? Below is an extract of the log that shows two loops:
[20080107 19:21:54] Remote file exist check: "IMG_0168.jpg".
[20080107 19:21:54] SIZE IMG_0168.jpg
[20080107 19:21:54] 213 1015808
[20080107 19:21:54] MDTM IMG_0168.jpg
[20080107 19:21:54] 213 00010101000000
[20080107 19:21:55] Source File: Size=1531172, SizeUnit=Byte, Time=2004-10-30T23:24:42, TimeFormat=Exact
[20080107 19:21:55] Destination File: Size=1015808, SizeUnit=Byte, Time=1601-01-01T00:00:00, TimeFormat=Exact
[20080107 19:21:55] No rule matched. Default Action="Overwrite".
[20080107 19:21:55] PASV
[20080107 19:21:55] 227 Entering Passive Mode (127,0,0,1,8,20)
[20080107 19:21:55] Opening data connection to 127.0.0.1 Port: 2068
[20080107 19:21:55] STOR IMG_0168.jpg
[20080107 19:21:55] 150 Binary data connection
[20080107 19:24:05] 1531172 bytes transferred. (11.4 KB/s) (00:02:10)
[20080107 19:24:09] 226 Transfer completed.
[20080107 19:24:09] MDTM 20041030232442 IMG_0168.jpg
[20080107 19:24:10] 550 file not found, or no access.
[20080107 19:24:10] SIZE IMG_0168.jpg
[20080107 19:24:10] 213 1015808
[20080107 19:24:10] File size mismatch.
[20080107 19:24:10] Log closed
[20080107 19:24:10] Log opened
[20080107 19:24:10] Remote file exist check: "IMG_0168.jpg".
[20080107 19:24:10] SIZE IMG_0168.jpg
[20080107 19:24:11] 213 1015808
[20080107 19:24:11] MDTM IMG_0168.jpg
[20080107 19:24:11] 213 00010101000000
[20080107 19:24:11] Source File: Size=1531172, SizeUnit=Byte, Time=2004-10-30T23:24:42, TimeFormat=Exact
[20080107 19:24:11] Destination File: Size=1015808, SizeUnit=Byte, Time=1601-01-01T00:00:00, TimeFormat=Exact
[20080107 19:24:11] No rule matched. Default Action="Overwrite".
[20080107 19:24:11] PASV
[20080107 19:24:11] 227 Entering Passive Mode (127,0,0,1,8,21)
[20080107 19:24:11] Opening data connection to 127.0.0.1 Port: 2069
[20080107 19:24:11] STOR IMG_0168.jpg
[20080107 19:24:11] 150 Binary data connection
[20080107 19:26:25] 1531172 bytes transferred. (11.1 KB/s) (00:02:14)
[20080107 19:26:29] 226 Transfer completed.
[20080107 19:26:29] MDTM 20041030232442 IMG_0168.jpg
[20080107 19:26:30] 550 file not found, or no access.
[20080107 19:26:30] SIZE IMG_0168.jpg
[20080107 19:26:30] 213 1015808
[20080107 19:26:30] File size mismatch.
[20080107 19:26:30] Log closed
[20080107 19:26:30] Log opened
[20080107 19:26:30] Remote file exist check: "IMG_0168.jpg".
IF Destination Time = No Matter AND Size = Equal AND Transfer=No Matter THEN Skip
Default Action: Overwrite
Looking at the original file on the server, it does appear to be a partial file. According to the log, it appears to recognize that the file size is different but instead of overwritting, it creates another copy, appending something like -100, -101, -103, etc. I have also noticed this loop may start if I suddenly close out SmartFTP or my FTP Gateway. I guessing that a network glitch causes the connection to break, leaving a partial file and when the connection restarts, it doesn't overwrite properly, creates new files with the extension. The new file with the extension is now the correct file size, but SmartFTP goes back and checks the original file, which of course is the wrong size and it makes another copy. Any ideas? Below is an extract of the log that shows two loops:
[20080107 19:21:54] Remote file exist check: "IMG_0168.jpg".
[20080107 19:21:54] SIZE IMG_0168.jpg
[20080107 19:21:54] 213 1015808
[20080107 19:21:54] MDTM IMG_0168.jpg
[20080107 19:21:54] 213 00010101000000
[20080107 19:21:55] Source File: Size=1531172, SizeUnit=Byte, Time=2004-10-30T23:24:42, TimeFormat=Exact
[20080107 19:21:55] Destination File: Size=1015808, SizeUnit=Byte, Time=1601-01-01T00:00:00, TimeFormat=Exact
[20080107 19:21:55] No rule matched. Default Action="Overwrite".
[20080107 19:21:55] PASV
[20080107 19:21:55] 227 Entering Passive Mode (127,0,0,1,8,20)
[20080107 19:21:55] Opening data connection to 127.0.0.1 Port: 2068
[20080107 19:21:55] STOR IMG_0168.jpg
[20080107 19:21:55] 150 Binary data connection
[20080107 19:24:05] 1531172 bytes transferred. (11.4 KB/s) (00:02:10)
[20080107 19:24:09] 226 Transfer completed.
[20080107 19:24:09] MDTM 20041030232442 IMG_0168.jpg
[20080107 19:24:10] 550 file not found, or no access.
[20080107 19:24:10] SIZE IMG_0168.jpg
[20080107 19:24:10] 213 1015808
[20080107 19:24:10] File size mismatch.
[20080107 19:24:10] Log closed
[20080107 19:24:10] Log opened
[20080107 19:24:10] Remote file exist check: "IMG_0168.jpg".
[20080107 19:24:10] SIZE IMG_0168.jpg
[20080107 19:24:11] 213 1015808
[20080107 19:24:11] MDTM IMG_0168.jpg
[20080107 19:24:11] 213 00010101000000
[20080107 19:24:11] Source File: Size=1531172, SizeUnit=Byte, Time=2004-10-30T23:24:42, TimeFormat=Exact
[20080107 19:24:11] Destination File: Size=1015808, SizeUnit=Byte, Time=1601-01-01T00:00:00, TimeFormat=Exact
[20080107 19:24:11] No rule matched. Default Action="Overwrite".
[20080107 19:24:11] PASV
[20080107 19:24:11] 227 Entering Passive Mode (127,0,0,1,8,21)
[20080107 19:24:11] Opening data connection to 127.0.0.1 Port: 2069
[20080107 19:24:11] STOR IMG_0168.jpg
[20080107 19:24:11] 150 Binary data connection
[20080107 19:26:25] 1531172 bytes transferred. (11.1 KB/s) (00:02:14)
[20080107 19:26:29] 226 Transfer completed.
[20080107 19:26:29] MDTM 20041030232442 IMG_0168.jpg
[20080107 19:26:30] 550 file not found, or no access.
[20080107 19:26:30] SIZE IMG_0168.jpg
[20080107 19:26:30] 213 1015808
[20080107 19:26:30] File size mismatch.
[20080107 19:26:30] Log closed
[20080107 19:26:30] Log opened
[20080107 19:26:30] Remote file exist check: "IMG_0168.jpg".