RE: wget lot of files

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 




> -----Original Message-----
> From: fedora-list-bounces@xxxxxxxxxx
> [mailto:fedora-list-bounces@xxxxxxxxxx]On Behalf Of Tom 'Needs A Hat'
> Mitchell
> Sent: Wednesday, April 07, 2004 7:03 AM
> To: For users of Fedora Core releases
> Subject: Re: wget lot of files
> 
> 
> On Tue, Apr 06, 2004 at 09:49:15PM +0200, hicham wrote:
> > hello
> > 
> > tryin to download lot of rpm files from an ftp site
> > how to get all the files with a  wget once for all ?
> 
> Cannot do it.
> Wget respects the Robot Exclusion Standard.
> RTFM.
> 
> The Robot Exclusion Standard exists to avoid abuse of the services.
> (sort of like hijacking threads is bad style ;-).

For Real?? I've not tried it.. but what alexander suggested

wget -ri ftp://ip-address/path/rpm/*.rpm

should work??

For me, I use this Stupid little script I wrote.

#!/bin/tcsh

foreach file (`awk -F: '{ print $1 }' ../ftp4`)
	echo "Start Downloading Item $file"
	env http_proxy=http://proxy_ip:port/ wget -c
http://ftp.acc.umu.se/pub/GNOME/desktop/2.5/2.5.91/sources/$file
	echo
end

The above's a bit troublesome.. but it works.

I go to the webpage..
I save the webpage.
I sed out everything except the rpm/bz2 files
I put it into a file. (1 file per line) 
and I pass it to the script above.

HTH



[Index of Archives]     [Current Fedora Users]     [Fedora Desktop]     [Fedora SELinux]     [Yosemite News]     [Yosemite Photos]     [KDE Users]     [Fedora Tools]     [Fedora Docs]

  Powered by Linux