Hey all..
I was downloading Project Gutenberg ebooks via wget and it's real slow cuz it has to touch each book each time i sync. My friend Aaron mentioned to me that rsync would be a much faster method of downloading the books. Here's the command I was using for wgett o download them. I'm getting only zip files and excluding a number of VERY LARGE ones:
wget -b -a pg.log -t 0 -N -T 60 -nH --cut-dirs=4 -P c:\gutenberg -r -l INF -R dblnr3.zip,fuman3.zip,hgp10.zip,hgp10a.zip,am3.zip,a3.zip,2city3.zip -A zip ftp://ftp.ibiblio.org/pub/docs/books/gutenberg
I want to do the same thing with rsync, this is the command i came up with:
rsync -avHS --delete --exclude=dblnr3.zip,fuman3.zip,hgp10.zip,hgp10a.zip,am3.zip,a3.zip,2city3.zip --include=*.zip ftp@xxxxxxxxxxxxxxx::gutenberg C:\gutenberg
I want to make the command for rsync the same as I did for wget. I'm using the official rsync "line" from gutenberg.org. Am I doing this right or can someone correct me? I don't know as much about rsync as I do about wget.
I was downloading Project Gutenberg ebooks via wget and it's real slow cuz it has to touch each book each time i sync. My friend Aaron mentioned to me that rsync would be a much faster method of downloading the books. Here's the command I was using for wgett o download them. I'm getting only zip files and excluding a number of VERY LARGE ones:
wget -b -a pg.log -t 0 -N -T 60 -nH --cut-dirs=4 -P c:\gutenberg -r -l INF -R dblnr3.zip,fuman3.zip,hgp10.zip,hgp10a.zip,am3.zip,a3.zip,2city3.zip -A zip ftp://ftp.ibiblio.org/pub/docs/books/gutenberg
I want to do the same thing with rsync, this is the command i came up with:
rsync -avHS --delete --exclude=dblnr3.zip,fuman3.zip,hgp10.zip,hgp10a.zip,am3.zip,a3.zip,2city3.zip --include=*.zip ftp@xxxxxxxxxxxxxxx::gutenberg C:\gutenberg
I want to make the command for rsync the same as I did for wget. I'm using the official rsync "line" from gutenberg.org. Am I doing this right or can someone correct me? I don't know as much about rsync as I do about wget.
