budmckenzie@comcast.net
I am experiencing difficulty transferring log files from my server. It looks like the issue is only with active log files, as the "static" ones transfer fine.
Some background ......
I have an application running that is constantly writing out to various logs (3 to be exact [Application Activity Log, System Out Log and an Error Log]). The Application Activity log is very dynamic, and is updated once every few seconds, logging various activity going on in the application, which I think may be the root of the issue. The log grows to about 50Mb over about 12 hours, then is copied to a "backup" file, and the Activity log starts its tracing again.
Every time I try to download the Activity Log, it fails (cycles through a pre-transfer download cycle). The download log states that the transfer failed due to a size mismatch. The size-mismatch occurs because as the file is being downloaded, it is also being written to. I need to be able to download a snapshot of the activity log, because I can't always wait the 12 hours for the file to reach 50Mb so that it will be copied to the backup.
I hope I have made my issue clear, but if you need more info, please let me know.
DOWNLOAD LOG:
[codebox][07:12:59] Resolving host name "wasprode"
[07:12:59] Connecting to 10.240.100.197 Port: 21
[07:12:59] Connected to wasprode.
[07:12:59] 220 s5990656 FTP server (Version 4.2 Sat Jun 16 07:20:05 CDT 2007) ready.
[07:12:59] USER ajones
[07:12:59] 331 Password required for ajones.
[07:12:59] PASS (hidden)
[07:12:59] 230-Last unsuccessful login: Mon Jul 21 10:12:20 2008 on ftp from LT400126.CORP.FFIC.COM
[07:12:59] 230-Last login: Wed Sep 3 07:04:36 2008 on ftp from LT400126.CORP.FFIC.COM
[07:12:59] 230 User ajones logged in.
[07:12:59] SYST
[07:12:59] 215 UNIX Type: L8 Version: BSD-44
[07:12:59] Detected Server Type: UNIX
[07:12:59] FEAT
[07:12:59] 500 'FEAT': command not understood.
[07:12:59] TYPE I
[07:12:59] 200 Type set to I.
[07:12:59] REST 0
[07:12:59] 350 Restarting at 0 Send STORE or RETRIEVE to initiate transfer.
[07:12:59] PWD
[07:12:59] 257 "/home/s1n01/ajones" is current directory.
[07:12:59] CWD /var/WebSphere50/SSO
[07:12:59] 250 CWD command successful.
[07:12:59] PWD
[07:13:00] 257 "/var/WebSphere50/SSO" is current directory.
[07:13:00] SIZE SSOApp.log
[07:13:00] 213 30913146
[07:13:00] MDTM SSOApp.log
[07:13:00] 213 20080903141301
[07:13:00] Source File: Size=30913146, SizeUnit=Byte, Time=2008-09-03T14:13:01, TimeFormat=Exact
[07:13:00] Destination File: Size=23317660, SizeUnit=Byte, Time=2008-09-02T21:48:21, TimeFormat=Exact
[07:13:00] RecentTime=2008-09-03T14:13:00
[07:13:00] No rule matched. Default Action="Overwrite".
[07:13:00] PASV
[07:13:00] 227 Entering Passive Mode (10,240,100,197,225,92)
[07:13:00] Opening data connection to 10.240.100.197 Port: 57692
[07:13:00] RETR SSOApp.log
[07:13:00] 150 Opening data connection for SSOApp.log (30913400 bytes).
[07:13:54] 226 Transfer complete.
[07:13:54] 31004740 bytes transferred. (554 KB/s) (00:00:54)
[07:13:54] MDTM SSOApp.log
[07:13:55] 213 20080903141356
[07:13:55] File size mismatch.
[07:13:55] Transfer failed.
[07:13:55] SIZE SSOApp.log
[07:13:55] 213 31007043
[07:13:55] MDTM SSOApp.log
[07:13:55] 213 20080903141356
[07:13:55] Source File: Size=31007043, SizeUnit=Byte, Time=2008-09-03T14:13:56, TimeFormat=Exact
[07:13:55] Destination File: Size=31004740, SizeUnit=Byte, Time=2008-09-03T14:13:56, TimeFormat=Exact
[07:13:55] RecentTime=2008-09-03T14:13:54
[07:13:55] No rule matched. Default Action="Overwrite".
[07:13:55] PASV
[07:13:55] 227 Entering Passive Mode (10,240,100,197,226,0)
[07:13:55] Opening data connection to 10.240.100.197 Port: 57856
[07:13:55] RETR SSOApp.log
[07:13:55] 150 Opening data connection for SSOApp.log (31007301 bytes).
[07:14:40] 226 Transfer complete.
[07:14:40] 31198744 bytes transferred. (668 KB/s) (00:00:45)
[07:14:40] MDTM SSOApp.log
[07:14:40] 213 20080903141441
[07:14:40] File size mismatch.
[07:14:40] Transfer failed.
[07:14:40] SIZE SSOApp.log
[07:14:41] 213 31198744
[07:14:41] MDTM SSOApp.log
[07:14:41] 213 20080903141441
[07:14:41] Source File: Size=31198744, SizeUnit=Byte, Time=2008-09-03T14:14:41, TimeFormat=Exact
[07:14:41] Destination File: Size=31198744, SizeUnit=Byte, Time=2008-09-03T14:14:41, TimeFormat=Exact
[07:14:41] RecentTime=2008-09-03T14:14:40
[07:14:41] No rule matched. Default Action="Overwrite".
[07:14:41] PASV
[07:14:41] 227 Entering Passive Mode (10,240,100,197,226,145)
[07:14:41] Opening data connection to 10.240.100.197 Port: 58001
[07:14:41] RETR SSOApp.log
[07:14:41] 150 Opening data connection for SSOApp.log (31198744 bytes).[/codebox]
Some background ......
I have an application running that is constantly writing out to various logs (3 to be exact [Application Activity Log, System Out Log and an Error Log]). The Application Activity log is very dynamic, and is updated once every few seconds, logging various activity going on in the application, which I think may be the root of the issue. The log grows to about 50Mb over about 12 hours, then is copied to a "backup" file, and the Activity log starts its tracing again.
Every time I try to download the Activity Log, it fails (cycles through a pre-transfer download cycle). The download log states that the transfer failed due to a size mismatch. The size-mismatch occurs because as the file is being downloaded, it is also being written to. I need to be able to download a snapshot of the activity log, because I can't always wait the 12 hours for the file to reach 50Mb so that it will be copied to the backup.
I hope I have made my issue clear, but if you need more info, please let me know.
DOWNLOAD LOG:
[codebox][07:12:59] Resolving host name "wasprode"
[07:12:59] Connecting to 10.240.100.197 Port: 21
[07:12:59] Connected to wasprode.
[07:12:59] 220 s5990656 FTP server (Version 4.2 Sat Jun 16 07:20:05 CDT 2007) ready.
[07:12:59] USER ajones
[07:12:59] 331 Password required for ajones.
[07:12:59] PASS (hidden)
[07:12:59] 230-Last unsuccessful login: Mon Jul 21 10:12:20 2008 on ftp from LT400126.CORP.FFIC.COM
[07:12:59] 230-Last login: Wed Sep 3 07:04:36 2008 on ftp from LT400126.CORP.FFIC.COM
[07:12:59] 230 User ajones logged in.
[07:12:59] SYST
[07:12:59] 215 UNIX Type: L8 Version: BSD-44
[07:12:59] Detected Server Type: UNIX
[07:12:59] FEAT
[07:12:59] 500 'FEAT': command not understood.
[07:12:59] TYPE I
[07:12:59] 200 Type set to I.
[07:12:59] REST 0
[07:12:59] 350 Restarting at 0 Send STORE or RETRIEVE to initiate transfer.
[07:12:59] PWD
[07:12:59] 257 "/home/s1n01/ajones" is current directory.
[07:12:59] CWD /var/WebSphere50/SSO
[07:12:59] 250 CWD command successful.
[07:12:59] PWD
[07:13:00] 257 "/var/WebSphere50/SSO" is current directory.
[07:13:00] SIZE SSOApp.log
[07:13:00] 213 30913146
[07:13:00] MDTM SSOApp.log
[07:13:00] 213 20080903141301
[07:13:00] Source File: Size=30913146, SizeUnit=Byte, Time=2008-09-03T14:13:01, TimeFormat=Exact
[07:13:00] Destination File: Size=23317660, SizeUnit=Byte, Time=2008-09-02T21:48:21, TimeFormat=Exact
[07:13:00] RecentTime=2008-09-03T14:13:00
[07:13:00] No rule matched. Default Action="Overwrite".
[07:13:00] PASV
[07:13:00] 227 Entering Passive Mode (10,240,100,197,225,92)
[07:13:00] Opening data connection to 10.240.100.197 Port: 57692
[07:13:00] RETR SSOApp.log
[07:13:00] 150 Opening data connection for SSOApp.log (30913400 bytes).
[07:13:54] 226 Transfer complete.
[07:13:54] 31004740 bytes transferred. (554 KB/s) (00:00:54)
[07:13:54] MDTM SSOApp.log
[07:13:55] 213 20080903141356
[07:13:55] File size mismatch.
[07:13:55] Transfer failed.
[07:13:55] SIZE SSOApp.log
[07:13:55] 213 31007043
[07:13:55] MDTM SSOApp.log
[07:13:55] 213 20080903141356
[07:13:55] Source File: Size=31007043, SizeUnit=Byte, Time=2008-09-03T14:13:56, TimeFormat=Exact
[07:13:55] Destination File: Size=31004740, SizeUnit=Byte, Time=2008-09-03T14:13:56, TimeFormat=Exact
[07:13:55] RecentTime=2008-09-03T14:13:54
[07:13:55] No rule matched. Default Action="Overwrite".
[07:13:55] PASV
[07:13:55] 227 Entering Passive Mode (10,240,100,197,226,0)
[07:13:55] Opening data connection to 10.240.100.197 Port: 57856
[07:13:55] RETR SSOApp.log
[07:13:55] 150 Opening data connection for SSOApp.log (31007301 bytes).
[07:14:40] 226 Transfer complete.
[07:14:40] 31198744 bytes transferred. (668 KB/s) (00:00:45)
[07:14:40] MDTM SSOApp.log
[07:14:40] 213 20080903141441
[07:14:40] File size mismatch.
[07:14:40] Transfer failed.
[07:14:40] SIZE SSOApp.log
[07:14:41] 213 31198744
[07:14:41] MDTM SSOApp.log
[07:14:41] 213 20080903141441
[07:14:41] Source File: Size=31198744, SizeUnit=Byte, Time=2008-09-03T14:14:41, TimeFormat=Exact
[07:14:41] Destination File: Size=31198744, SizeUnit=Byte, Time=2008-09-03T14:14:41, TimeFormat=Exact
[07:14:41] RecentTime=2008-09-03T14:14:40
[07:14:41] No rule matched. Default Action="Overwrite".
[07:14:41] PASV
[07:14:41] 227 Entering Passive Mode (10,240,100,197,226,145)
[07:14:41] Opening data connection to 10.240.100.197 Port: 58001
[07:14:41] RETR SSOApp.log
[07:14:41] 150 Opening data connection for SSOApp.log (31198744 bytes).[/codebox]