Move Problem

TekBudE

2009-03-17 17:13:12

Hello. I am having the same issue and unfortunately the instructions above do not remedy my 550 error. Each query item's transfer type is set to MOVE - it appears SmartFTP deletes the item (from the server) after transferring it then forgets it already deleted it. Below is relative information from the log (I hope, if more is needed let me know). Thank you for your time.

[10:10:26] CWD /cam07
[10:10:26] 250 CWD successful. "/cam07" is current directory.
[10:10:26] PWD
[10:10:26] 257 "/cam07" is current directory.
[10:10:26] MLST Event20090316201113007`0316.avi
[10:10:26] 550 File or directory not found.
[10:10:26] TYPE I
[10:10:26] 200 Type set to I
[10:10:26] PASV
[10:10:26] 227 Entering Passive Mode (98,150,70,45,15,122)
[10:10:26] Opening data connection to 98.150.70.45 Port: 3962
[10:10:26] RETR Event20090316201113007`0316.avi
[10:10:26] 550 File not found
[10:10:26] MLST Event20090316201113007`0316.avi
[10:10:26] 550 File or directory not found.
[10:10:27] Transfer failed.
[10:10:57] MLST Event20090316201113007`0316.avi
[10:10:57] 550 File or directory not found.
[10:10:57] PASV
[10:10:57] 227 Entering Passive Mode (98,150,70,45,15,130)
[10:10:57] Opening data connection to 98.150.70.45 Port: 3970
[10:10:57] RETR Event20090316201113007`0316.avi
[10:10:57] 550 File not found
[10:10:57] MLST Event20090316201113007`0316.avi
[10:10:57] 550 File or directory not found.
[10:10:57] Transfer failed.

Brian w/
TekBudE.com

mb

2009-03-17 18:28:30

What are you doing exactly? Is your intention to move the file?

TekBudE

2009-03-18 16:30:52

Yes, SmartFTP is scanning 4 folders every 1 minute for changes. I've set the operation (for each of the 4 folders) to MOVE (as I want the files to be removed form the server) and have also set "do not delete folder" under the advanced options tab (I need root folders left because new files get added about every 15 seconds - surveillance system). Thanks for reply.

Brian w/
TekBudE.com

mb

2009-03-18 16:36:09

Can you provide step by step instructions on how to reproduce the problem?

From the log it looks like the file appears in the directory listing but does not really exist on the server - anymore.

Regards,
Mat

TekBudE

2009-03-18 17:29:39

Yes, what you stated sounds correct. Would that be a problem with the FTP server software?

Server running FileZilla. Created a user account with full read/write privileges to the four directories - cam01, cam04, cam06, cam07. My software creates new files in these directories as mentioned about every 15 - 60 seconds (software does NOT apply a locking handle to the files).

Client using most recent version of SmartFTP 3.0.1026.19 setup with 4 separate items in the transfer query (one for each of the four folders above). Each item is a folder that processes every 1 minute (set using the schedule tab). Each item (the 4 scheduled transfers) has an operation of MOVE so SmartFTP will download then delete the original file off the server (next time the schedule runs (every 1 minute), it will not have to re-process the already downloaded file). Each item has its own favorite it uses for settings - however the only change to the default settings are to keep file time and to use 2 workers per favorite.

The server has direct connection to internet, no NAT device or Firewall. The client is behind a router but is demilitarized (all ports are open).

Let me know if you need more info, logs, etc. I could always try rebuilding the query and favorites *sigh*

Thanks for your time.

Brian w/
TekBudE.com

mb

2009-03-18 17:53:01

One reason could be that the server is returning a cached directory listing. If this is the case there might be an option in the server admin tool to disable the directory cache. Another option would be to use a different FTP server product for testing purpose.
If this doesn't help you have to do some further debugging: I would start with one folder (instead of 4). Then enable logging in Advanced dialog in the Menu: Tools->Settings. The Transfer Queue will then create a new log file for each item. As soon as the problem occurs take a look at the log of the failed item. If you see that the item has previously been deleted but the queue is still retrying the same item this might be a sign that there is a problem with SmartFTP. For example this could happen if the client sends the DELE command but never receives the ack/reply from the server. It correctly assumes that it has to retry the item. But of course the file has already been deleted and the transfer will never be successful.

Regards,
Mat

TekBudE

2009-03-23 22:15:04

Finally got around to going through the logs and found two log files referring to one of the transfers that keeps trying to repeat itself.

Ive combined both logs below. Can't seem to make sense of them. I've had problems with other FTP server software so I am a little hesitant to switch but will do so if it's required to get to the bottom of this.

[2009-03-23T14:59:41] Log opened
[2009-03-23T14:59:41] Initializing. Transfer Queue v1.0.19.19.
[2009-03-23T14:59:41] Resolving host name "laundrymat.myftp.org"
[2009-03-23T14:59:41] Connecting to 98.150.70.45 Port: 21
[2009-03-23T14:59:41] Connected to laundrymat.myftp.org.
[2009-03-23T14:59:41] 220-FileZilla Server version 0.9.31 beta
[2009-03-23T14:59:41] 220-written by Tim Kosse (Tim.Kosse@gmx.de)
[2009-03-23T14:59:41] 220 Please visit
[2009-03-23T14:59:41] USER Brad
[2009-03-23T14:59:42] 331 Password required for brad
[2009-03-23T14:59:42] PASS (hidden)
[2009-03-23T14:59:42] 230 Logged on
[2009-03-23T14:59:42] SYST
[2009-03-23T14:59:43] 215 UNIX emulated by FileZilla
[2009-03-23T14:59:43] Detected Server Type: UNIX
[2009-03-23T14:59:43] RTT: 536.023 ms
[2009-03-23T14:59:43] FEAT
[2009-03-23T14:59:43] 211-Features:
[2009-03-23T14:59:44] MDTM
[2009-03-23T14:59:44] REST STREAM
[2009-03-23T14:59:44] SIZE
[2009-03-23T14:59:44] MODE Z
[2009-03-23T14:59:44] MLST type*;size*;modify*;
[2009-03-23T14:59:44] MLSD
[2009-03-23T14:59:44] UTF8
[2009-03-23T14:59:44] CLNT
[2009-03-23T14:59:44] MFMT
[2009-03-23T14:59:44] 211 End
[2009-03-23T14:59:44] CLNT SmartFTP 3.0.1026.19
[2009-03-23T14:59:44] 200 Don't care
[2009-03-23T14:59:44] OPTS UTF8 ON
[2009-03-23T14:59:44] 200 UTF8 mode enabled
[2009-03-23T14:59:44] PWD
[2009-03-23T14:59:45] 257 "/" is current directory.
[2009-03-23T14:59:45] CWD /cam07
[2009-03-23T14:59:45] 250 CWD successful. "/cam07" is current directory.
[2009-03-23T14:59:45] PWD
[2009-03-23T14:59:46] 257 "/cam07" is current directory.
[2009-03-23T14:59:46] MLST Event20090323124702007`0323.avi
[2009-03-23T14:59:46] 250-Listing /cam07/Event20090323124702007`0323.avi
[2009-03-23T14:59:47] type=file;size=2392214;modify=20090323194803; /cam07/Event20090323124702007`0323.avi
[2009-03-23T14:59:47] 250 End
[2009-03-23T14:59:47] Compression disabled. File "Event20090323124702007`0323.avi" matches exception "*.avi".
[2009-03-23T14:59:47] TYPE I
[2009-03-23T14:59:47] 200 Type set to I
[2009-03-23T14:59:47] PASV
[2009-03-23T14:59:48] 227 Entering Passive Mode (98,150,70,45,19,240)
[2009-03-23T14:59:48] Opening data connection to 98.150.70.45 Port: 5104
[2009-03-23T14:59:48] RETR Event20090323124702007`0323.avi
[2009-03-23T14:59:48] 150 Connection accepted
[2009-03-23T15:00:32] 226 Transfer OK
[2009-03-23T15:00:32] 2392214 bytes transferred. (53.6 KB/s) (00:00:43)
[2009-03-23T15:00:32] MLST Event20090323124702007`0323.avi
[2009-03-23T15:00:32] 250-Listing /cam07/Event20090323124702007`0323.avi
[2009-03-23T15:00:32] type=file;size=2392214;modify=20090323194803; /cam07/Event20090323124702007`0323.avi
[2009-03-23T15:00:32] 250 End
[2009-03-23T15:00:32] Source File Size=2392214, Destination File Size=2392214
[2009-03-23T15:00:32] DELE Event20090323124702007`0323.avi
[2009-03-23T15:00:32] 250 File deleted successfully
[2009-03-23T15:00:32] Log closed


[2009-03-23T15:01:32] Log opened
[2009-03-23T15:01:32] Initializing. Transfer Queue v1.0.19.19.
[2009-03-23T15:01:32] CWD /cam07
[2009-03-23T15:01:33] 250 CWD successful. "/cam07" is current directory.
[2009-03-23T15:01:33] PWD
[2009-03-23T15:01:33] 257 "/cam07" is current directory.
[2009-03-23T15:01:33] MLST Event20090323124702007`0323.avi
[2009-03-23T15:01:34] 550 File or directory not found.
[2009-03-23T15:01:34] TYPE I
[2009-03-23T15:01:34] 200 Type set to I
[2009-03-23T15:01:34] PASV
[2009-03-23T15:01:35] 227 Entering Passive Mode (98,150,70,45,19,233)
[2009-03-23T15:01:35] Opening data connection to 98.150.70.45 Port: 5097
[2009-03-23T15:01:35] RETR Event20090323124702007`0323.avi
[2009-03-23T15:01:35] 0 bytes transferred. (0 bytes/s) (60 ms)
[2009-03-23T15:01:35] 550 File not found
[2009-03-23T15:01:35] MLST Event20090323124702007`0323.avi
[2009-03-23T15:01:36] 550 File or directory not found.
[2009-03-23T15:01:36] Transfer failed.
[2009-03-23T15:01:36] Log closed
[2009-03-23T15:02:07] Log opened
[2009-03-23T15:02:07] Initializing. Transfer Queue v1.0.19.19.
[2009-03-23T15:02:07] MLST Event20090323124702007`0323.avi
[2009-03-23T15:02:07] 550 File or directory not found.
[2009-03-23T15:02:07] PASV
[2009-03-23T15:02:07] 227 Entering Passive Mode (98,150,70,45,19,247)
[2009-03-23T15:02:07] Opening data connection to 98.150.70.45 Port: 5111
[2009-03-23T15:02:07] RETR Event20090323124702007`0323.avi
[2009-03-23T15:02:08] 0 bytes transferred. (0 bytes/s) (50 ms)
[2009-03-23T15:02:08] 550 File not found
[2009-03-23T15:02:08] MLST Event20090323124702007`0323.avi
[2009-03-23T15:02:08] 550 File or directory not found.
[2009-03-23T15:02:08] Transfer failed.
[2009-03-23T15:02:08] Log closed

Thanks for your time,

Brian w/
TekBudE.com

mb

2009-03-23 22:28:07

The log is from two different log files? If this is the case you have two different queue items. Meaning they come from different directory enumerations. I would try to my suggestion to use another FTP server product.

Regards,
Mat

TekBudE

2009-03-23 23:36:28

After reading your reply I decided to try changing the amount of workers per favorite from 2 to 1. With only an hour of testing it seems to have cleared up the issue. Strange..

This a problem with SmartFTP or FileZilla Server or both?

mb

2009-03-24 10:36:36

I can't tell you from the information you have provided.