Moving Site

I'm trying to move my old website, from Server A, to a different website, Server B. I thought I could do this by just drag and dropping from Remote Connection A to Remote Connection B, but that doesn't seem to be working. Please help me.

Warner