Re: IO scheduling & filesystem v a few processes writing a lot

[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

 



On Mon, 1 Aug 2005, Sander wrote:

Dr. David Alan Gilbert wrote (ao):
* Sander ([email protected]) wrote:
Dr. David Alan Gilbert wrote (ao):
I was using rsync, but the problem with rsync is that I have
a back up server then filled with lots and lots of small files
- I want larger files for spooling to tape.
(Other suggestions welcome)

Can't you just tar the small files from the backupserver to tape? (or,
what is the problem with that?).

Lots of small files->slow; it is an LTO-2 tape drive that is spec'd
at 35MByte/s - it won't get that if I'm feeding it from something
seeking all over.

ic. Sorry if the question is stupid, but is it bad not to reach
35MB/sec?

with modern tape drives, when you fall out of streaming mode you are lucky to get 1/10 of the rated drive performance (not to mention the extra wear and tear on the tape and the drive)

the common thing is to do disk->disk->tape backups. use rsync to pull your data from the remote machines to your server, then use tar on the server to make the one image you want to put on the tape (frequently onto a different drive), then record that image to tape.

note that tar is not nessasarily the best format to use for this in the face of tape errors (see backup software companies for details, several years ago I read an interesting document from the bru backup folks that went into details)

David Lang

--
There are two ways of constructing a software design. One way is to make it so simple that there are obviously no deficiencies. And the other way is to make it so complicated that there are no obvious deficiencies.
 -- C.A.R. Hoare
-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to [email protected]
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/

[Index of Archives]     [Kernel Newbies]     [Netfilter]     [Bugtraq]     [Photo]     [Gimp]     [Yosemite News]     [MIPS Linux]     [ARM Linux]     [Linux Security]     [Linux RAID]     [Video 4 Linux]     [Linux for the blind]
  Powered by Linux