Schedule Upload Runs but Does Not Update on Target

Hello everyone,

SmartFTP works great for me, except one thing. I have been using it for about 8 months to update my website with new pictures every minute. The pictures come from webcams.

The problem is the files on the target FTP site are not getting updated, even though the source files have been updated. I cannot understand why SmartFTP would not overwrite the files on the target. It works sometimes, but not consistently. http://www.danallen.com

If you need more details, screenshots, steps to reproduce, etc., please let me know. I assume I am doing something wrong.

To start the process, I drag all the files that are supposed to get uploaded into Temporary Queue. Right click on the files in the queue, set the schedule. I have tried a lot of different schedules, but the one I like best is to run it every minute, with the recurring box checked. I make sure the first run will be after I am done setting the schedule. Then drag/drop on the target, which moves the files to the Transfer Queue, wait for the clock to come round, and off it goes. But then, over time, some of the pictures stop updating on the target, even though I see SmartFTP running and checking the server and source to see if the pic has updated. I can look at the pics on the source and see they are updated. I can see their system modified times, and look at the pictures themselves to see they are different. I don't know if SmartFTP is failing to send, or if my server is messing up.

Any information anyone can provide will be most extremely much appreciated.

Best regards,
danallendc

Dear danallendc

Please provide the logs from the Transfer Queue:
https://www.smartftp.com/support/kb/how- ... f2564.html

You may want to change the File Exist rules in your favorite's settings. Set it to overwrite the destination file all the time.

Regards,
-Mat

Good morning,

I would like to request re-opening this item for review and resolution.

REPEATABLE PROBLEM
1. Setup a file for upload every minute (filename Home00275.jpg).
2. Upload runs normally during most hours.
3. Between midnight and 10:00 AM, the upload fails. Log below.

NOTE: File size is 12K. From midnight to 10:00 AM, when the file uploads, only a fraction of the 12K bytes are transferred. It seems as if SmartFTP starts the upload, records it complete, but the upload is not happening.

NOTE 2: I just changed my web host from one company to another. This problem was happening before the move, and it continues on the new hosting. Hosting is Linux. Client is SmartFTP for Windows on XP 2000 Pro.

LOG (in this example, the file has updated on the source machine, so it should upload to the target. Upload appears to run, but sends only 110 bytes out of 12K making up the whole file. Target directory shows the file with a new modified date, but the image in the file is unchanged.)
[06:01:30] Remote file exist check: "Home00275.jpg".
[06:01:30] SIZE Home00275.jpg
[06:01:30] 213 11585
[06:01:30] MDTM Home00275.jpg
[06:01:30] 213 20070904084934
[06:01:30] Source File: Size=11695, SizeUnit=Byte, Time=2007-09-04T11:00:15, TimeFormat=Exact
[06:01:30] Destination File: Size=11585, SizeUnit=Byte, Time=2007-09-04T08:49:34, TimeFormat=Exact
[06:01:30] Rule "IF Destination Time=Recent AND Size=Smaller AND Transfer=No Matter THEN Resume" matched. Action="Resume".
[06:01:30] PASV
[06:01:30] 227 Entering Passive Mode (208,109,181,42,189,56)
[06:01:30] Opening data connection to 208.109.181.42 Port: 48440
[06:01:30] REST 11585
[06:01:31] 350 Restarting at 11585
[06:01:31] STOR Home00275.jpg
[06:01:31] 150 Accepted data connection
[06:01:31] 110 bytes transferred. (1000 bytes/s) (110 ms)
[06:01:31] 226-File successfully transferred
[06:01:31] 226 0.092 seconds (measured here), 1.17 Kbytes per second
[06:01:31] MDTM 20070904110015 Home00275.jpg
[06:01:31] 550 Can't check for file existence
[06:01:31] SIZE Home00275.jpg
[06:01:31] 213 11695

Hello ..

I'm sorry but I don't see the problem. The upload is resumed because it previously failed / was incomplete.

Regards,
SmartFTP

Thank you for reviewing my question. I am sorry for providing inadequate information previously.

Here is a copy of an image file uploaded by SmartFTP, followed by the log entry of the upload. No problem at this step.

Image

[02:01:30] Resolving host name "208.109.181.42"
[02:01:30] Connecting to 208.109.181.42 Port: 21
[02:01:30] Connected to 208.109.181.42.
[02:01:30] 220---------- Welcome to Pure-FTPd [privsep] [TLS] ----------
[02:01:30] 220-You are user number 18 of 50 allowed.
[02:01:30] 220-Local time is now 22:01. Server port: 21.
[02:01:30] 220-This is a private system - No anonymous login
[02:01:30] 220 You will be disconnected after 3 minutes of inactivity.
[02:01:30] USER danallendotcom
[02:01:30] 331 User danallendotcom OK. Password required
[02:01:30] PASS (hidden)
[02:01:30] 230-User danallendotcom has group access to: 450
[02:01:30] 230 OK. Current directory is /
[02:01:30] SYST
[02:01:30] 215 UNIX Type: L8
[02:01:30] Detected Server Type: UNIX
[02:01:30] FEAT
[02:01:30] 211-Extensions supported:
[02:01:30] EPRT
[02:01:30] IDLE
[02:01:30] MDTM
[02:01:30] SIZE
[02:01:30] REST STREAM
[02:01:30] MLST type*;size*;sizd*;modify*;UNIX.mode*;UNIX.uid*;UNIX.gid*;unique*;
[02:01:30] MLSD
[02:01:30] ESTP
[02:01:30] PASV
[02:01:30] EPSV
[02:01:30] SPSV
[02:01:30] ESTA
[02:01:30] AUTH TLS
[02:01:30] PBSZ
[02:01:30] PROT
[02:01:30] 211 End.
[02:01:30] Detected Server Software: PureFTPd
[02:01:30] PWD
[02:01:30] 257 "/" is your current location
[02:01:30] CWD /025_Graphics/000_HomePageImages
[02:01:30] 250 OK. Current directory is /025_Graphics/000_HomePageImages
[02:01:30] PWD
[02:01:31] 257 "/025_Graphics/000_HomePageImages" is your current location
[02:01:31] Remote file exist check: "Home00275.jpg".
[02:01:31] TYPE I
[02:01:31] 200 TYPE is now 8-bit binary
[02:01:31] SIZE Home00275.jpg
[02:01:31] 213 10297
[02:01:31] MDTM Home00275.jpg
[02:01:31] 213 20070906044933
[02:01:31] Source File: Size=10293, SizeUnit=Byte, Time=2007-09-06T07:00:04, TimeFormat=Exact
[02:01:31] Destination File: Size=10297, SizeUnit=Byte, Time=2007-09-06T04:49:33, TimeFormat=Exact
[02:01:31] No rule matched. Default Action="Overwrite".
[02:01:31] PASV
[02:01:31] 227 Entering Passive Mode (208,109,181,42,89,59)
[02:01:31] Opening data connection to 208.109.181.42 Port: 22843
[02:01:31] STOR Home00275.jpg
[02:01:31] 150 Accepted data connection
[02:01:31] 10293 bytes transferred. (37.9 KB/s) (265 ms)
[02:01:31] 226-File successfully transferred
[02:01:31] 226 0.301 seconds (measured here), 33.40 Kbytes per second
[02:01:31] MDTM 20070906070004 Home00275.jpg
[02:01:31] 550 Can't check for file existence
[02:01:31] SIZE Home00275.jpg
[02:01:32] 213 10293



THE GOAL
The picture is updated on the client every 12 minutes, showing the position of day/night on Earth. SmartFTP is then supposed to upload the picture to my website.


THE PROBLEM
SmartFTP says it is updating server, but during certain hours, the picture does not change on the server, even though it is changing on the client and SmartFTP fires an upload. During certain hours, the uploads only send a few bytes, instead of the whole image. Here are the log entries showing the number of bytes uploading each cycle, starting at 2:13.

[02:13:31] 40 bytes transferred. (425 bytes/s) (94 ms)
[02:25:31] 29 bytes transferred. (311 bytes/s) (93 ms)
[02:37:32] 68 bytes transferred. (723 bytes/s) (94 ms)
[02:49:30] 112 bytes transferred. (1.16 KB/s) (94 ms)
[03:01:31] 55 bytes transferred. (585 bytes/s) (94 ms)
[03:13:30] 74 bytes transferred. (948 bytes/s) (78 ms)
[03:25:31] 73 bytes transferred. (776 bytes/s) (94 ms)
[03:37:31] 90 bytes transferred. (967 bytes/s) (93 ms)


The complete smartFTP log for this time frame is available at: LINK


If you look at my website now and about 7 hours from now, you will see the light gradually moving across Earth. Here is the image as of this posting. If you look at the log for the last several hours, here are the transfers happening...this is what should happen everytime:

[12:01:31] 14059 bytes transferred. (46.2 KB/s) (297 ms)
[12:13:30] 14053 bytes transferred. (41.7 KB/s) (329 ms)
[12:25:30] 14047 bytes transferred. (43.8 KB/s) (313 ms)
[12:49:30] 14045 bytes transferred. (46.1 KB/s) (297 ms)
[13:01:31] 14036 bytes transferred. (46.1 KB/s) (297 ms)
[13:25:31] 14031 bytes transferred. (46.2 KB/s) (296 ms)


The complete smartFTP log for this time frame is available at: LINK (search txt file for [12:01:30] ).



Here is the image as of now. You can see that for the next 7 hours, the file will be changing, then it will start freezing on the target again until tomorrow afternoon, even though the source file continues to be updated every 12 minutes.

Image



You can compare this image to what you see later tonight on my website and the difference is obvious. Starting with the upload at 02:13:30 tomorrow AM, the upload will start failing again, sending only a few bytes, instead of the whole picture (about 12K bytes), having the effect of freezing the Earth image, not updating it.


The image on the target server should get replaced by the copy of the image on the client every 12 minutes. It is not happening during certain hours. The server image freezes at 02:13, not updating to show the movement of light across Earth, even though SmartFTP is running as it was for the preceding 24 hours. Starting with the 12:01:30 cycle tomorrow afternoon, the updates will work again, until 02:13 the next morning. It does this every night and day. It is as though the upload works different during these hours.


I understand it is because I have something setup wrong, but I cannot figure out what it is.

Thank you in advance for your kind attention to this matter.

Best regards,
Dan Allen
Montpelier, Vermont

Hello ..

Try the following:
1. Locate the favorite.
2. Go to Menu: Favorites -> Edit Favorites
3. In the Favorites window, find your favorite. Look in the Quick Connect folder
4. Right-click on the favorite, select Properties from the context menu
5. Go to Transfer->Files
6. Click on Edit Queue Rules
7. Remove all Queue rules. Set the default action to overwrite

Start the Queue.

Regards,
Mat

Mat,

Thank you very much. I might not have the absolute latest version, so my screen dialogs had slightly different wording from what you wrote... here is my SmartFTP version info

My VERSION
Image


Attempted Fix
Here are two screen shots showing what I did... first, I went into favorites, then the Properties of the link to my target FTP server...

Image

After clicking the button outlined in green, I removed the rules and also reduced the "recent" time from 120s to 5s.

Image

Status
I am running overnight, will post results in the morning. In the meantime, if you see anything wrong with what I did, please let me know. Otherwise, fingers are crossed.

Thank you again,
Best regards,
Dan Allen
Montpelier, Vermont
http://www.danallen.com

Hello ...

You may want to install the latest version from:
https://www.smartftp.com/download

It includes several important fixes.

Regards,
Mat
SmartFTP

Mat,

Thank you again for your prompt and informative support.

The new build fixed the upload problem, but it broke my Windows XP/Visual Studio 6.0 installation. Apparently, the new build updates components required by some programs I am running. This appears to be a variation of DLL-Hell.

My conclusion is SmartFTP scheduling does not work on XP/Visual STudio 6.

Do you have any information on this?

The spcecific problem I am having is that DATE and TIME functions in VB no longer work in Visual Studio, once I installed the new SmartFTP build. My VB program dies with a message saying it cannot find the library it needs to return DATE or TIME. I fixed the problem by running a system restore to a point prior to installation of the new SmartFTP build. Therefore, SmartFTP is causing this problem on my PC.

Any information you can provide to help me understand this problem and how I can fix it would be extrememy much appreciated.

Best regards,
Dan Allen

Hello Dan ..

I'm sorry but I'm not aware of such problems. SmartFTP does not install any shared dll files. However the new version registers the following COM servers:
SmartFTP.exe
sfFavorites.dll
sfShellTools.dll

You can try to manually unregister them to see if it makes a change:
SmartFTP.exe /unregister
regsvr32.exe /u sfFavorites.dll
regsvr32.exe /u sfShellTools.dll
and you can try:
regsr32.exe /u sfFTPLib.dll

If you have identified the file that causes the problem we can continue from there.

Regards,
Mat

Mat,

Thank you again for the prompt informative reply.

The problem is fixed now. Basically, I redid the SmartFTP installation, this time everything is running and nothing is broken.

Hopefully, this is the end of this problem.

Thank you again for your perseverance with this pesky problem. I think we are all set now.

SmartFTP is the best and coolest FTP client.

Best regards,
Dan Allen
Montpelier, VT