Connection seems to get lost

Hi,

when downloading or uploading a bunch of files to my ISP, sftp constantly seems to loose the connection.
I keep track of the upload, or download speed, and at first it goes fast, and then stops after about a minute or 2 to 4.

Any idea how I can prevent this?

thx
Chris