> -----Original Message----- > From: fedora-list-bounces@xxxxxxxxxx > [mailto:fedora-list-bounces@xxxxxxxxxx]On Behalf Of Tom 'Needs A Hat' > Mitchell > Sent: Wednesday, April 07, 2004 7:03 AM > To: For users of Fedora Core releases > Subject: Re: wget lot of files > > > On Tue, Apr 06, 2004 at 09:49:15PM +0200, hicham wrote: > > hello > > > > tryin to download lot of rpm files from an ftp site > > how to get all the files with a wget once for all ? > > Cannot do it. > Wget respects the Robot Exclusion Standard. > RTFM. > > The Robot Exclusion Standard exists to avoid abuse of the services. > (sort of like hijacking threads is bad style ;-). For Real?? I've not tried it.. but what alexander suggested wget -ri ftp://ip-address/path/rpm/*.rpm should work?? For me, I use this Stupid little script I wrote. #!/bin/tcsh foreach file (`awk -F: '{ print $1 }' ../ftp4`) echo "Start Downloading Item $file" env http_proxy=http://proxy_ip:port/ wget -c http://ftp.acc.umu.se/pub/GNOME/desktop/2.5/2.5.91/sources/$file echo end The above's a bit troublesome.. but it works. I go to the webpage.. I save the webpage. I sed out everything except the rpm/bz2 files I put it into a file. (1 file per line) and I pass it to the script above. HTH
