[SlugBug] Filesystem replication

Chris J cej at nightwolf.org.uk
Thu Dec 4 21:32:52 GMT 2003


[[ posted to both shef lugs, so some people may see this twice ]]

Hi all,

Anyone had any experience with any form of FS replication on large (80+ GB)
filesystems? Tried to rsync between two servers on an 81GB filesystem, and
after rsync expecting each file for four hours, the server shutdown with
nothing copied - rsync seems to inspect each file first, regardless of 
whether it exists or not on the server, before actually starting to copy
updates.

Using rsync in daemon mode on server #1, and can't remember off top of head
how invoking rsync (certainly using -az though), connected through a 100Mbit
card (like to use gigbit, but one server doesn't have gigabit card), and
using RH 6.1 on one, and RH 9.x on t'other. Dell Poweredge servers - disk
and processor isn't a /huge/ issue (RAID 5 on one, RAID 1 on t'other), so
looks like rsync's algorithm is the thing that's making it a problem.

So, any magic incantations to speed rsync up, or possible alternatives
that people know about or use. At the moment, we're just breaking the rsync
into smaller chunks which it seems quite happy with :)

Chris...

-- 
\ Chris Johnson                 \ NP: Dire Straits - Brothers in Arms
 \ cej at nightwolf.org.uk          \  
  \ http://cej.nightwolf.org.uk/  \ 
   \ http://redclaw.org.uk/        ~---------------------------------------



More information about the SlugBug mailing list