Horacio Reyes wrote:
>>- The files are copied in batch of 100 tif images, in a directory with >>more than 5 million files. >>- the server that initiate the scp is a 1.2Ghz P3 with 2G in ram, the >>receiver is a double Xeon 2.6ghz with 2G in ram. The first server takes >>no time to send the file, but the receiver takes more than 200segs to >>copy. They are in a 100mb lan. >>- the top comand shows 98% free cpu before the scp, when scp start it >>takes 100% of the 2 xeon cpu. The problem is not the ram, both servers >>have more than 1G free when scp starts. >>
I have found thet SCP does not like lots of small files, if you can tar
the files together into on big file it will probably transfer much quicker..
Do you know a command to tar through SSH which is the same as scp but kepps better permissions and is quicker?
Here it is:
You have bar/foo and you'd like to copy dir foo to server blabla: cd bar && tar c foo | ssh user@blabla "cd /dir_on_blabla && tar x"
Great isn't it? -jec
