ÿþ <html> <!-- Mirrored from www.backupassist.com/BackupAssist/FAQ-Rsync.html by HTTrack Website Copier/3.x [XR&CO'2008], Fri, 07 Aug 2009 08:22:02 GMT --> <!-- Added by HTTrack --><meta http-equiv="content-type" content="text/html;charset=ISO-8859-1"><!-- /Added by HTTrack --> <head> <title>BackupAssist  Rsync backup for Windows, run Rsync on Windows, VSS and Rsync, Rsync scheduling</title> <meta name="description" content="Simple and affordable backup software for Windows servers. Easy to manage with email reminders, scheduling wizards and preconfigured rotation schemes." /> <link href="../stylesheets/default.css" rel="stylesheet" type="text/css" /> <script type="text/javascript"> var gaJsHost = (("https:" == document.location.protocol) ? "https://ssl." : "http://www."); document.write(unescape("%3Cscript src='" + gaJsHost + "google-analytics.com/ga.js' type='text/javascript'%3E%3C/script%3E")); </script> <script type="text/javascript"> try { var pageTracker = _gat._getTracker("UA-15361906-2"); pageTracker._trackPageview(); } catch(err) {}</script> </head> <body> <div class="all"> <div class="header"> <SCRIPT src="../js/preload.js" type="text/javascript"></SCRIPT> <div style="height:55px;"> <div class="message">Simple, Reliable, Affordable <br /><strong>BACKUP SOFTWARE</strong></div> <div class="logo"><a href="../index.aspx"><img src="../images/logos/ba-darkbg.png" alt="BackupAssist Home" /></a></div> </div> <DIV class="main_menu" > <TABLE class="main_menu"> <TR> <TD id="tour" ><A href="index.html">Product Tour</A></TD> <TD id="download" ><A href="download2.aspx">Download</A></TD> <TD id="purchase" ><A href="../purchasing/purchase.aspx">Purchase</A></TD> <TD ><A href="../education/index.html">Documentation</A></TD> <TD ><A href="../support/index.html">Support</A></TD> <TD class="current"><A href="../BackupAssist/faq.html">FAQ</A></TD> <TD ><A href="../reseller/index.aspx">Reseller</A></TD> <!--<TD ><A href="../blog/index.html">Blog</A></TD>--> <TD style="border-right: none;" ><a href="../about/index.html">About</a></td> </TR> </TABLE> </DIV> </div> <div class="nav_bar"> <div class="nav_text"> <a href="../index.aspx">BackupAssist Home</a> &gt; <a href="faq.html">BackupAssist FAQ</a> &gt; Rsync Internet Backup FAQ</div><div class="search_bar"> <form action="http://www.backupassist.com/search/search.php"> <!--Search support: <input name="keywords" /> <input type="submit" value="Go" />--> </form> </div> </div> <div class="main"> <h1>Rsync Internet Backup FAQ </h1> <h2><a name="max"></a>Is there a maximum size or number of files in my data set?</h2> <p>In theory, there&rsquo;s no real limit to the number of files or directories that you can Rsync &ndash; apart from the practical limitation of RAM. </p> <p>We have run tests on several different file systems &ndash; a typical file system of 70,000 files and 24 GB with under 50 MB of daily changes can be synced in around 10 minutes. The largest file system we've tested is of 200,000 files and 100 GB, which took 20 minutes to sync.</p> <h2><a name="perform"></a>How does Rsync perform on files and directories? </h2> <p>Rsync performs best on the file system directly - backing up normal files and directories. It performs far better than if you were to use Rsync to synchronize a backup file offsite.</p> <p>Let's look at example to see why that's the case.</p> <p>Scenario 1: File system with 50,000 files, 50 GB total; 50 files of total size 50 MB have changed.</p> <p>Rsync is able to identify which of the 50 files have changed, and for those files, it determines the in-file deltas. It calculates checksums on 50 MB of data, and the backup can complete in a matter of minutes. The amount of data transferred will be around 20 MB for typical documents.</p> <p>Scenario 2: The file system is backed up via NTBackup, which results in a 50GB bkf file. </p> <p>Rsync will detect that the single bkf file has changed, and needs to determine the in-file deltas. It needs to calculate checksums on 50 GB of data, which may take hours. Additionally, we have found that even if the underlying file system changes very little, about 10% of a bkf file changes from day to day and needs to be transferred. Thus, about 5 GB will be transferred.<br> We see here that it is highly preferable in terms of both bandwidth and CPU time that the underlying file system is selected for Rsync, not a backup of that file system.</p> <h2><a name="attributes" id="attributes"></a>What file attributes are preserved when using Rsync? </h2> <p>The table below outlines what file system attributes are preserved at the backup destination when using Rsync to transfer data:</p> <table border="1" class="downloadnew" style="line-height:18px; border: 1px solid #999; width: 400px; margin-left:10px;"> <tr> <th width="258" align="center" style="text-align:center">File attributes at backup destination</th> <th width="126" align="center" style="text-align:center">Preserved?</th> </tr> <tr> <td>Windows File Attributes</td> <td align="center"><img src="../images/ticks/delete2.png" width="16" height="16"></td> </tr> <tr> <td>Creation time</td> <td align="center"><img src="../images/ticks/delete2.png" width="16" height="16"></td> </tr> <tr> <td>Last access time</td> <td align="center"><img src="../images/ticks/delete2.png" width="16" height="16"></td> </tr> <tr> <td>Last modified time</td> <td align="center"><img src="../images/ticks/greenTick.gif" width="17" height="16"></td> </tr> <tr> <td>NTFS security (ACLs)</td> <td align="center"><img src="../images/ticks/delete2.png" width="16" height="16"></td> </tr> <tr> <td>NTFS alternate data streams (ADSs)</td> <td align="center"><img src="../images/ticks/delete2.png" width="16" height="16"></td> </tr> </table> <h3 style="font-size:11pt; color:#666;">Why doesn t Rsync preserve most of the attributes of the file/folder at the destination?</h3> <p>Because rsync works on top of the Cygwin Unix emulation layer, it doesn't know anything about Windows file attributes (e.g. readonly, hidden, system, etc) or about NTFS security attributes (i.e. access control lists) so it is not able to transfer any of these to the backup destination.&nbsp; NTFS alternate data streams are not supported, and as Unix doesn't have a concept of file creation time, this is also not preserved.&nbsp; The only attribute that is preserved is the last modified time of the file.</p> <h2><a name="exchangesql"></a>Can I backup Exchange databases, SQL databases using Rsync? </h2> <p>Yes. We have performance benchmarked Rsyncing both SQL and Exchange database backups, and conclude that it is feasible to use Rsync to transport SQL and Exchange database backups offsite. Please see our <a href="../SBS/documents/4_Rsync.pdf" target="_blank">slideshow presentation</a> for more details.</p> <h2><a name="offsite"></a>Can I use Rsync to synchronize my drive images offsite? </h2> <p>Following from the discussions above, We recommend that you select the underlying file system for Rsync, not a backup of the file system.</p> <p>However, having said that, drive images can be more suitable for Rsync than other types of backup, provided they are uncompressed and unencrypted. However, the checksum process will be CPU intensive. We have found on typical servers that checksums can be performed at a rate of about 100-120GB per hour, during which time the server's CPU is at about 30% on a single core. [Note: on multi-core processors, this means that CPU usage is not particularly high.] </p> <p>So the time to backup via Rsync can be approximately calculated as:</p> <p>2 * checksum time (one checksum for each end) + network time</p> <p>So the short answer is: if you really really want to do it, you can, but we believe there are better ways to achieve what you want to achieve.</p> <p><strong>Remember - that the purpose of doing multiple backups is redundancy.</strong> That means protecting your data in different ways, to different locations. If you synchronize a drive image offsite, you run the risk that if that drive image is bad for whatever reason, you have just lost your data. However, if you back up your underlying file system using Rsync instead, if your image goes bad, you still have your files and folders at your remote site.</p> <h2><a name="compatible"></a>What devices are compatible with Rsync? </h2> <p>Rsync is an open-source program, with an open-specification protocol, so the number of Rsync compatible devices is always growing.</p> <p>Any typical Linux or Windows machine can be configured to run Rsync. Additionally, several NAS devices are Rsync enabled - please see how <a href="../rsync/Setting_up_Rsync_Server.pdf" target="_blank">Rsync White Paper</a> for more details.</p> <h2><a name="opensource"></a>What Open Source software do you use?</h2> <p>BackupAssist uses several Open Source components, which are licensed under the GPL, BSD license or MIT license.</p> <p>The following table summarises the open source software that we use:</p><table cellspacing="2" cellpadding="2" border="1"> <tbody> <tr> <td><span style="text-decoration: underline">Component</span></td> <td><span style="text-decoration: underline">Version</span></td> <td><span style="text-decoration: underline">Licensing</span></td> <td><span style="text-decoration: underline">In short</span></td> </tr> <tr> <td>Rsync</td> <td>3.0.4</td> <td><a target="_blank" href="http://rsync.samba.org/GPL.html"><span style="color: #0000ff">Rsync license</span></a></td> <td>Free to use (GPL)</td> <td><a target="_blank" href="http://sourceforge.net/project/showfiles.php?group_id=69227&amp;package_id=129033"><span style="color: #0000ff">Download source</span></a></td> </tr> <tr> <td>Cygwin and GNU tools</td> <td>1.5.25-15</td> <td><a target="_blank" href="http://cygwin.com/licensing.html"><span style="color: #0000ff">CYGWIN license</span></a></td> <td>Free to use (GPL mostly)</td> <td><a target="_blank" href="http://sourceforge.net/project/showfiles.php?group_id=69227&amp;package_id=129033"><span style="color: #0000ff">Download source</span></a></td> </tr> <tr> <td>OpenSSH</td> <td>5.1p1</td> <td><a target="_blank" href="http://www.openbsd.org/cgi-bin/cvsweb/src/usr.bin/ssh/LICENCE?rev=HEAD"><span style="color: #0000ff">OpenSSH license</span></a></td> <td>Free to use (BSD)</td> </tr> <tr> <td>OpenSSL</td> <td>0.9.8h</td> <td><a target="_blank" href="http://www.openssl.org/source/license.html"><span style="color: #0000ff">OpenSSL license</span></a></td> <td>Free to use (BSD)</td> </tr> <tr> <td>cwRsync (the rest!)</td> <td>2.1.5</td> <td><a target="_blank" href="http://itefix.no/cwrsync/license.html"><span style="color: #0000ff">cwRsync license</span></a></td> <td>Free to use (MIT License)</td> </tr> </tbody> </table></p> </div> <div class="navigation"> <!--<table class="button_menu"> <tr> <td><a href="/BackupAssist/"><img src="/images/buttons/tourButton.png" alt="BackupAssist Product Tour" /></a></td> </tr> <tr> <td><a href="/BackupAssist/download.php"><img src="/images/buttons/evalButton.png" alt="Evaluate BackupAssist" /></a></td> </tr> <tr> <td><a href="/BackupAssist/purchase.php"><img src="/images/buttons/purchaseButton.png" alt="Purchase BackupAssist" /></a></td> </tr> <tr> <td><a href="/BackupAssistV5/beta/v5_1Beta_Announcement.php" id="beta"><img src="/images/buttons/5_1_Beta.png" alt="BackupAssist Beta 5.1" /></a></td> </tr> </table>--> <!--<table class="button_menu"> <tr> <td><a href="/BackupAssistv5/DriveImaging.html"><img src="/images/buttons/server08.png" alt="Server 2008 Drive Imaging" /></a></td> </tr> --> <!--<tr> <td> <a href="/BackupAssistV5/beta/v5Beta_Announcement.html"><img src="/images/buttons/v5betabutton.png" alt="BackupAssist v5 Beta" /></a> </td> </tr> </table>--> <!-- Insert Special or New Items Here --> <table class="sub_menu"> <tr> <th colspan="2">FAQ Index</th> </tr> <tr> <td colspan="2"><A id="sub_menu_backupassist_overview" href="faq.html" >BackupAssist FAQ</A></td> </tr> <tr> <td colspan="2"><A id="sub_menu_backupassist_imaging" href="FAQ-Imaging.html" >Windows Imaging FAQ</A></td> </tr> <tr> <td colspan="2"><A id="sub_menu_backupassist_ntbackup" href="FAQ-NTBackup.html" >NTBackup FAQ</A></td> </tr> <tr> <td colspan="2"><A id="sub_menu_backupassist_filereplication" href="FAQ-FileReplication.html" >File Replication FAQ</A> </td> </tr> <tr> <td colspan="2"><A id="sub_menu_backupassist_rsync" href="FAQ-Rsync.html" class="current" >Rsync Internet Backup FAQ</A></td> </tr> <!--<tr> <td colspan="2"><A id="sub_menu_backupassist_monitoring" href="FAQ-Monitoring.html" >Centralized Monitoring FAQ</A> </td> </tr>--> </table> <table class="sub_menu" cellspacing="5" style="background-position:top;"> <tr> <th colspan="2" id="blue"><a href="index.html">Product Tour</a></th> </tr> <tr> <th colspan="2" id="green"><A href="download2.aspx">Download</A></th> </tr> <tr> <th colspan="2" id="red"><a href="../purchasing/purchase.aspx">Purchase</a></th> </tr> </table> </div> <div class="footer"> <p><!--&copy; Copyright 2002-8 BackupAssist Backup Software<br />--> <!--<a href="testimonials.html">CUSTOMER TESTIMONIAL</a> | <a href="../resources/index.html">RESOURCES</a> | <a href="../about/index.html">ABOUT</a> | <a href="../privacy.html">Privacy Policy</a> | <a href="../Disclaimer.html">Disclaimer</a></p> --> <a href="testimonials.html">CUSTOMER TESTIMONIAL</a> | <a href="../resources/index.html">RESOURCES</a> | <a href="../about/index.html">ABOUT</a> | <a href="../privacy.html">Privacy Policy</a> | <a href="../Disclaimer.html">Disclaimer</a></p> </div> </div> <script type="text/javascript"> var gaJsHost = (("https:" == document.location.protocol) ? "https://ssl." : "http://www."); document.write(unescape("%3Cscript src='" + gaJsHost + "google-analytics.com/ga.js' type='text/javascript'%3E%3C/script%3E")); </script> <script src="../js/ga_keyword2.js" type="text/javascript"></script> <script type="text/javascript"> var pageTracker = _gat._getTracker("UA-244061-1"); pageTracker._initData(); pageTracker._trackPageview(); </script> </body> <!-- Mirrored from www.backupassist.com/BackupAssist/FAQ-Rsync.html by HTTrack Website Copier/3.x [XR&CO'2008], Fri, 07 Aug 2009 08:22:02 GMT --> <!-- Added by HTTrack --><meta http-equiv="content-type" content="text/html;charset=ISO-8859-1"><!-- /Added by HTTrack --> </html>