I'm trying to download the iso's for FC4, but they are coming down awfully slowly.
Can others reach your listening ports? Check that your firewall allows the connection and, you're behind a NAT router, that the ports get forwarded to your host.
If others can't reach your listening ports, then the only traffic you get is from peers you've connected to, which will artificially limit the size of the swarm you can reach. (Some other peers will be behind NAT routers that you can't reach, because they didn't' forward ports, and those sources will be unavailable to you unless they contact you first.)