Quantcast
Channel: linuxadmin: Expanding Linux SysAdmin knowledge
Viewing all articles
Browse latest Browse all 17796

Cross data center real time file replication active/active

$
0
0

So here's the situation. We have 2 DC's, one east timezone and the other in central time, so not same state. We are using internet VPN's for connectivity with a 50+ms latency. What we need is a near real time file replication solution from one file server to another. Both are CentOS 6.7 VM's 5TB worth of data, with a lot of small (less than .5MB) files.

We've tried to use GlusterFS, but the read time was horrendous, couldn't even run a shell script from it. I will admit, the performance may have needed some tweaking to work better.

requirements:

Active/Active (Master/Master) replication across WAN near real time. The faster the better NFS and SMB export supported Works well with small files.

We will not be accessing the data across the WAN, access will stay within the DC.

Right now I have rsync running via CRON every 5 mins one direction. It works, but not ideal for an active/active solution.

Researched other distributed FS. With the Exception of XtreemFS, are geared for in DC clustering. XtreemFS may work, but not sure. Anyone out there using it with a single server to server across the WAN?

Want to keep it FOSS, but paid solutions are not out of the question if the cost is reasonable.

Any suggestions? We do have another solution, can't remember the name, it was purchased by Dell years ago and is not longer offered or supported.

I did see a thread from 3 years ago covering Ceph and GlusterFS, but they were looking for an single DC solution, not quite what we have.

submitted by /u/mikildemion
[link] [comments]

Viewing all articles
Browse latest Browse all 17796

Trending Articles