Jump to content


Photo

Memory Leak


  • Please log in to reply
32 replies to this topic

#21 mb

mb

    Developer

  • Administrators
  • 11526 posts
  • Gender:
    Male
  • Location:
    Worldwide

Posted 06 November 2012 - 10:26 PM

Did you try it with different SFTP servers?

#22 YouBringOnTheLulz

YouBringOnTheLulz
  • Members
  • 16 posts

Posted 09 November 2012 - 07:55 PM

Did you try it with different SFTP servers?


Yes with a 30 gb file. Still same memory leak.

#23 mb

mb

    Developer

  • Administrators
  • 11526 posts
  • Gender:
    Male
  • Location:
    Worldwide

Posted 09 November 2012 - 07:58 PM

We need exact instructions on how to reproduce the problem. Without them there is no chance we can possibly fix the problem.

#24 Purgatory

Purgatory
  • Members
  • 29 posts
  • Gender:
    Male

Posted 10 November 2012 - 09:34 PM

mb,
I'll be testing later on my (rarely used) Win7 system with the original 4.1.1265.0 install, so any updated components (?) of SmartFTP would not have been added and it would have been a pure install.
  • I uninstalled and deleted every reference to SmartFTP that was left behind on my XP system, unless there were other parts not referenced with SmartFTP, I should have been able to remove all traces. ?
  • Installed version 4.1.1265.0 (32-bit) on the XP system, same issues after about 14GB now, not 6GB as before. The client does not crash any more but still runs high CPU to 40% or so and memory is scaled to 1.4GB. The client constantly drops connection and attempts to continue to download until the file is complete. The file finally completes with no errors, a hash check verifies that it is 100% identical.

If the same issue arises on the Win7 system with an original install of build 1265, then I would say that the hosting provider has updated the SFTP server and that would be the cause. ? I'll check with them to see if any updates/changes have been implemented recently in that area.

Again, smaller files no issues, all's normal with SmartFTP. Since I installed build 1265 on my XP system, the stability of SmartFTP is better, no crashing after X amount of SFTP multi-part/segmented downloading, but still high CPU and RAM use.

I'll give you my final report in the next 24hrs or so on the performance of the Win7 system with build 1265 (64-bit) and also if there have been any changes to the FTP/SSH/SFTP software at my host provider.

Thanks for your time on this.

Edited by Purgatory, 10 November 2012 - 10:04 PM.


#25 mb

mb

    Developer

  • Administrators
  • 11526 posts
  • Gender:
    Male
  • Location:
    Worldwide

Posted 11 November 2012 - 10:00 AM

Did you do the same tests with the latest build as well?

#26 Purgatory

Purgatory
  • Members
  • 29 posts
  • Gender:
    Male

Posted 13 November 2012 - 05:46 PM

Yes, tested with the latest build (1279) as well. See below tests results/input with different builds.

As a process of elimination, and for a super clean trial, using my HTPC computer (ASRock Vision 3D Sandy Bridge model):
First time install of 4.1 Build 1279 - Download a 14.1GB File:
Steady Working Set 56MB / Private Bytes 96MB / Peak Private Bytes 1.8GB (at the start, then back down to normal).
Win7 64-bit system. - No prior SmartFTP installs. All Win Updates.
========================

Maingear Potenza H77:
4.1 Build 1265 - Win7 64-bit - 16Gb File. No issues. - 6 Multi-Parts.
Steady as she goes for both systems with different builds. One fresh, first time install of SmartFTP client software. The other updated...

* Updated from Build 1265 to 1279 on the Potenza, after about 10mins, RAM had climbed to 265MB peak and steady at approx. 243MB. At 3hrs in and 10GB downloaded out of 25.1GB, single download (Not using Multi-Part/segmented), RAM was now at 856MB peak and steady at 809MB. No crashes or stalls with the connection up to that time.

(This is a more powerful system then my old XP based one (e.g. 8GB DDR3 1600 RAM, i7 3770, 2TB 7200RPM WD Caviar Black HDD). So I was not surprised that SmartFTP was holding steady after 3+hrs with no stalls or crashes as the RAM increased.)
After the final 5hrs of remaining download the results are: RAM peaked at: 1.894GB. No crashes. No dropped connections as with the XP system. Remember this was done with a single download over SSH, no Multi-Part. A hash check shows the 25.1GB file is 100% identical to the original source.
Final thoughts:
I was hoping this issue was isolated to my XP machine after having success with a first time install of 4.1 Build 1279 on the ASRock. To test this, I updated the Potenza to Build 1279 and started the biggest download I could find, over SFTP, single part as I was able to get MAX download without needing the Multi-Part function. Unfortunately, I'm convinced after doing my own tests, on my own systems, that there is an issue with files larger than 6Gb (the bigger the file and download time, the more the RAM is increased).
With the upgrade to Build 1279 from 1265 (where SmartFTP was perfect and issue free before), the best I can describe it mb, is there's bad code or other file interference somewhere. ?

Here's another test I did on the XP system several days ago(using 4.1 Build 1278):
Downloaded 52.47GB of data, 24 files of approx. 2.19Gb each. Zero issues on the XP system. No high RAM use nor high CPU usage. Each 2.19GB file was split into a Multi-Part of 6.


Other troubleshooting:
Host provider has done no major changes/updates to the FTP Server or FTP over SSH (SSHv2.0/Debian.)

See connection log below:

Spoiler


Firewall:
Thought it might be a Firewall issue after some research. I use COMODO Firewall, latest version as of Nov. 11th, previous version from March 2012. Disabled the FW. Restarted the XP system. Same issue with SmartFTP. So ruled out the Firewall.

*Only using Windows Firewall on both of the Win7 Systems tested above. The Potenza is not using any Anti Virus. The ASRock is using MSE for A/V.


I hope all the above makes sense and can be of some help with this issue.

Later,

#27 Purgatory

Purgatory
  • Members
  • 29 posts
  • Gender:
    Male

Posted 13 November 2012 - 06:12 PM

Forgot to add these screen shots from the XP system:

msvcr100-dll-High-CPU-spike-every-2mins: Posted Image

High-CPU-Every-2mins: Posted Image

msvcr100-dll-Closing-Re_opening-every-2mins: Posted Image

msvcr100-dll-Versions_I-Have-Installed. - v10.00.40219.325 - Used by SmaftFTP: Posted Image

#28 mb

mb

    Developer

  • Administrators
  • 11526 posts
  • Gender:
    Male
  • Location:
    Worldwide

Posted 13 November 2012 - 08:46 PM

Thank you. Can you send me the login/file information by email (support@) for the SFTP server? I will try to reproduce it here and if I can we will provide a fix within 24 hours.

#29 Purgatory

Purgatory
  • Members
  • 29 posts
  • Gender:
    Male

Posted 14 November 2012 - 07:40 PM

Hey again mb.

Details emailed to you. The provider was kind enough to loan us a server for testing proposes, they're fans of SmartFTP :) with a great support team.

Anything else I can do to help, let me know.

Talk with you again soon.

#30 mb

mb

    Developer

  • Administrators
  • 11526 posts
  • Gender:
    Male
  • Location:
    Worldwide

Posted 15 November 2012 - 04:02 PM

Good news: http://www.smartftp.com/download

#31 Purgatory

Purgatory
  • Members
  • 29 posts
  • Gender:
    Male

Posted 15 November 2012 - 06:13 PM

\o/ Thank you mb. :) I'll give it a whirl later tonight.

#32 YouBringOnTheLulz

YouBringOnTheLulz
  • Members
  • 16 posts

Posted 16 November 2012 - 04:54 PM

Seems to be working perfectly! Thanks Purgatory and mb for all your help!

#33 Purgatory

Purgatory
  • Members
  • 29 posts
  • Gender:
    Male

Posted 18 November 2012 - 08:05 PM

:) Good stuff YouBring.

The final tests for my Win7 and XP systems shows perfect performance from SmartFTP 4.1 Build 1282, zero issues.

mb, thank you very much for pinpointing the issue and for persevering with this report, even though you only had 2 people reporting the problem.

YouBringOnTheLulz, I thank you for spotting & reporting the issue first hand, and for insisting there was a problem.

The hosting provider is to be thanked as well for loaning a server for testing, I say thank you again.

Ok, I'll say unless someone other person has a similar issue, this report can be marked as resolved.

Thanks mb and YouBring, talk with you at another time.




0 user(s) are reading this topic

0 members, 0 guests, 0 anonymous users