This commit was manufactured by cvs2svn to create branch 'r1-2'.

git-svn-id: http://svn.savannah.nongnu.org/svn/rdiff-backup@988 2b77aa54-bcbc-44c9-a7ec-4f6cf2b41109

branches/r1-2/rdiff-backup/CVS-README

+CVS README - Notes for people checking out of CVS
+-------------------------------------------------
+
+Getting rdiff-backup to run:
+----------------------------
+
+If you want to run a version of rdiff-backup checked out of CVS into
+your $RDB_CVS directory, change to $RDB_CVS/rdiff_backup and run the
+./compilec.py file:
+
+    cd $RDB_CVS/rdiff_backup; python compilec.py
+
+With any luck, _librsync.so and C.so libraries will appear in that
+directory.  Then run rdiff-backup, making sure that all the files are
+in your PYTHONPATH:
+
+    PYTHONPATH=$RDB_CVS $RDB_CVS/rdiff-backup <arguments>
+
+
+Running the unit tests:
+-----------------------
+
+If you want to try some of tests, you first have to get the
+testfiles.tar.gz tarball.  It is available at
+
+http://rdiff-backup.stanford.edu/testfiles.tar.gz
+
+To untar it, root is required because the tarball contains device
+files, files with various uid/gid, etc.  If you don't have root, it's
+ok, all the tests except for roottest.py may still work.
+
+So, three steps:
+
+1) Make sure the the C modules are compiled as explained above:
+
+    cd $RDB_CVS/rdiff_backup; python compilec.py
+
+2) Untar the testfiles tarball, as root if you have it:
+
+    cd $RDB_CVS/testing; tar -xvzf testfiles.tar.gz
+
+3) In the testing directory, run each of the *test.py files as
+   desired.  For instance,
+
+    cd $RDB_CVS/testing; python rpathtest.py
+
+   If python restoretest.py doesn't work, try running
+   ./makerestoretest3
+
+Note:
+- some of the tests may require a normal user ben and group ben to exist.
+- you may need to install extra packages for acl/xattr... (such as
+	python-pylibacl and python-pyxattr on debian)

branches/r1-2/rdiff-backup/README

+INSTALLATION:
+
+Thank you for trying rdiff-backup.  To install, run:
+
+	python setup.py install
+
+The build process can be also be run separately:
+
+	python setup.py build
+
+The default prefix is generally /usr, so files would be put in /usr/bin,
+/usr/share/man/, etc.  An alternate prefix can be specified using the
+--prefix=<prefix> option.  For example:
+
+	python setup.py install --prefix=/usr/local
+
+The default prefix depends on how you (or your distribution) installed and
+configured Python. Suggested reading is "How installation works" from the
+Python docs, which includes commands to determine your default prefix:
+http://docs.python.org/install/index.html#how-installation-works
+
+The setup script expects to find librsync headers and libraries in the
+default location, usually /usr/include and /usr/lib.  If you want the
+setup script to check different locations, use the --librsync-dir
+switch or the LIBRSYNC_DIR environment variable.  For instance,
+
+	python setup.py --librsync-dir=/usr/local build
+
+instructs the setup program to look in /usr/local/include and
+/usr/local/lib for the librsync files.
+
+Finally, the --lflags and --libs options, and the LFLAGS and LIBS
+environment variables are also recognized.  Running setup.py with no
+arguments will display some help. Additional help is displayed by the
+command:
+
+	python setup.py install --help
+
+More information about using setup.py and how rdiff-backup is installed
+is available from the Python guide, Installing Python Modules for System
+Administrators, located at http://docs.python.org/install/index.html
+
+NB: There is no uninstall command provided by the Python distutils system.
+One strategy is to use the python setup.py install --record <file> option
+to save a list of the files installed to <file>.
+
+To build from source on Windows, you can use the command:
+
+	python setup.py py2exe --single-file
+
+to build a single executable file which contains Python, librsync, and
+all required modules.
+
+REQUIREMENTS:
+
+Remember that you must have Python 2.2 or later and librsync 0.9.7 or
+later installed.  For Python, see http://www.python.org.  The
+rdiff-backup homepage at http://rdiff-backup.nongnu.org/ should
+have a recent version of librsync; otherwise see the librsync homepage
+at http://librsync.sourceforge.net/. On Windows, you must have the
+Python for Windows extensions installed if you are building from source.
+The extensions can be downloaded from: http://pywin32.sourceforge.net/
+If you are not building from source on Windows, you do not need Python
+or librsync; they are bundled with the executable.
+
+For remote operation, rdiff-backup should be installed and in the
+PATH on remote system(s) (see man page for more information). On
+Windows, if you are using the provided .exe binary, you must have an
+SSH package installed for remote operation.
+
+The python modules pylibacl and pyxattr are optional.  If they are
+installed and in the default pythonpath, rdiff-backup will support
+access control lists and user extended attributes, provided the file
+system(s) also support these features.  Pylibacl and pyxattr can be
+downloaded from http://pylibacl.sourceforge.net/ and
+http://pyxattr.sourceforge.net/. Mac OS X users need a different
+pyxattr module, which can be downloaded from
+http://cheeseshop.python.org/pypi/xattr
+
+If you want to use rdiff-backup-statistics, you must have Python 2.4
+or later.
+
+TROUBLESHOOTING:
+
+If you have everything installed properly, and it still doesn't work,
+see the enclosed FAQ.html, the web page at http://rdiff-backup.nongnu.org,
+the Wiki at: http://wiki.rdiff-backup.org, and/or the mailing list.
+
+The FAQ in particular is an important reference, especially if you are
+using smbfs/CIFS, Windows, or have compiled by hand on Mac OS X.

branches/r1-2/rdiff-backup/TODO

+Fix restore with --force over existing regular file.
+
+For comparing, check source filesystem's abilities
+
+Clean up compare reports
+
+Test comparing of single files, and files/directories specified by
+increment.  Also test --include/--exclude with compare options.
+
+---------[ Medium term ]---------------------------------------
+
+Look into sparse file support (requested by Stelios K. Kyriacou)
+
+Look at Kent Borg's suggestion for restore options and digests.
+
+---------[ Long term ]---------------------------------------
+
+Think about adding Gaudet's idea for keeping track of renamed files.
+
+Look into different inode generation techniques (see treescan, Dean
+Gaudet's other post).
+

branches/r1-2/rdiff-backup/Windows-README.txt

+INSTALLATION:
+
+Thank you for trying rdiff-backup on Windows. Native support for the Windows
+environment is quite new in rdiff-backup. Please read the manual page, FAQ and
+the Wiki thorougly.
+
+To install the provided binary, simply copy rdiff-backup.exe to someplace in
+your PATH. Everything is included in the binary (including Python) for local
+operation. For remote operation, you will need to install a Windows SSH
+program. You will also need to install rdiff-backup on the remote system(s).
+
+You will need the Microsoft Visual C++ 2008 redistributables. If these are
+not installed on your system, rdiff-backup will be unable to run and Windows
+will display a message such as "The system cannot execute the specified
+program". To install the redistributables for all users, install the package
+available from Microsoft.com (search for "visual c 2008 redistributable").
+
+Alternatively, you can install the redistributable in a "side-by-side"
+configuration, which does not require administrator privelges. Simply
+download the DLL package from:
+http://download.savannah.gnu.org/releases/rdiff-backup/Microsoft.VC90.zip
+and copy the four enclosed files to the same directory as rdiff-backup.exe.
+
+You will need to follow either method only once.
+
+
+ADDITIONAL ISSUES:
+
+Currently, rdiff-backup's --include and --exclude options do not support
+Windows paths with \ as the directory separator. Instead, it is necessary to
+use / which is the Unix directory separator.
+
+Additionally, you may need to run rdiff-backup from the same directory as the
+source of your backup, eg:
+
+> cd c:\
+> rdiff-backup.exe --include "c:/My Stuff" --exclude "c:/**" c:/ c:/Backup
+
+will work to backup "c:\My Stuff" to "c:\Backup", but:
+
+> cd "c:\My Stuff"
+> rdiff-backup.exe --include "c:/My Stuff" --exclude "c:/**" c:/ c:/Backup
+
+will not work. UPDATE: With appropriate escaping, it looks like it is
+possible for this to work. Follow this example:
+
+> mkdir c:\foo
+> cd "c:\Documents and Settings"
+> rdiff-backup.exe --include c:\\/foo --exclude c:\\/** c:\/ c:\bar 
+
+The \\ is necessary in the --include and --exclude options because those
+options permit regular-expressions, and \ is the escape character in
+regular-expressions, and thus needs to be escaped itself.
+
+
+TROUBLESHOOTING:
+
+If you have everything installed properly, and it still doesn't work,
+see the enclosed manual, FAQ, the web page at http://rdiff-backup.nongnu.org,
+the Wiki at: http://wiki.rdiff-backup.org, and/or the mailing list. You can
+subscribe to the mailing list at:
+http://lists.nongnu.org/mailman/listinfo/rdiff-backup-users
+
+Recommended Wiki entries:
+http://wiki.rdiff-backup.org/wiki/index.php/BackupFromWindowsToLinux
+
+You can also try searching the mailing list archives:
+http://lists.nongnu.org/archive/html/rdiff-backup-users/

branches/r1-2/rdiff-backup/dist/makedist

+#!/usr/bin/env python
+
+import os, re, shutil, time, sys, getopt
+
+SourceDir = "rdiff_backup"
+DistDir = "dist"
+
+# Various details about the files must also be specified by the rpm
+# spec template.
+spec_template = "dist/rdiff-backup.spec.template"
+# The Fedora distribution has its own spec template
+fedora_spec_template = "dist/rdiff-backup.spec.template-fedora"
+
+def CopyMan(destination, version):
+	"""Create updated man page at the specified location"""
+	fp = open(destination, "w")
+	date = time.strftime("%B %Y", time.localtime(time.time()))
+	version = "Version "+version
+	firstline = ('.TH RDIFF-BACKUP 1 "%s" "%s" "User Manuals"\n' %
+				 (date, version))
+	fp.write(firstline)
+	infp = open(os.path.basename(destination), "r")
+	infp.readline()
+	fp.write(infp.read())
+	fp.close()
+	infp.close()
+
+def MakeHTML(input_prefix, title):
+	"""Create html and wml versions from given html body
+
+	Input expected in <input_prefix>-body.html, and output will be put
+	in <input_prefix>.wml and <input_prefix>.html.
+
+	"""
+	body_fp = open("%s-body.html" % (input_prefix,), "r")
+	body_string = body_fp.read()
+	body_fp.close()
+
+	wml_fp = open("%s.wml" % (input_prefix,), "w")
+	wml_fp.write(
+"""#include 'template.wml' home=. curpage=none title="%s"
+
+<divert body>
+<p><h2>%s</h2>
+
+""" % (title, title))
+	wml_fp.write(body_string)
+	wml_fp.write("\n</divert>\n")
+	wml_fp.close()
+
+	html_fp = open("%s.html" % (input_prefix,), "w")
+	html_fp.write(
+"""<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN">
+
+<html>
+  <head>
+    <title>%s</title>
+  </head>
+
+  <body>
+  <h1>%s</h1>
+""" % (title, title))
+	html_fp.write(body_string)
+	html_fp.write("\n</body></html>")
+	html_fp.close()
+
+def VersionedCopy(source, dest, munge_date = 0):
+	"""Copy source to dest, substituting $version with version
+
+	If munge_date is true, also replace $date with string like "August
+	8, 2003".
+
+	"""
+	fin = open(source, "rb")
+	inbuf = fin.read()
+	assert not fin.close()
+
+	outbuf = re.sub("\$version", Version, inbuf)
+	if outbuf == inbuf: assert 0, "No $version string replaced"
+	assert not re.search("\$version", outbuf), \
+		   "Some $version strings not repleased in %s" % (source,)
+
+	if munge_date:
+		inbuf = outbuf
+		outbuf = re.sub("\$date", time.strftime("%B %d, %Y"), inbuf, 1)
+		if outbuf == inbuf: assert 0, "No $date string replaced"
+		assert not re.search("\$date", outbuf), "Two $date strings found"
+
+	fout = open(dest, "wb")
+	fout.write(outbuf)
+	assert not fout.close()
+
+def MakeTar(specfiles):
+	"""Create rdiff-backup tar file"""
+	tardir = "rdiff-backup-%s" % Version
+	tarfilename = "rdiff-backup-%s.tar.gz" % Version
+	try:
+		os.lstat(tardir)
+		shutil.rmtree(tardir)
+	except OSError: pass
+	os.mkdir(tardir)
+	for filename in ["CHANGELOG", "COPYING", "README", "Windows-README.txt",
+					 "FAQ.html", "examples.html",
+					 SourceDir + "/cmodule.c",
+					 SourceDir + "/_librsyncmodule.c",
+					 DistDir + "/setup.py"] + specfiles:
+		shutil.copyfile(filename,
+						os.path.join(tardir, os.path.basename(filename)))
+
+	os.mkdir(tardir+"/rdiff_backup")
+	for filename in ["eas_acls.py", "backup.py", "connection.py", "compare.py",
+					 "FilenameMapping.py", "fs_abilities.py",
+					 "Hardlink.py", "hash.py", "increment.py", "__init__.py",
+					 "iterfile.py", "lazy.py", "librsync.py",
+					 "log.py", "longname.py", "Main.py", "manage.py",
+					 "metadata.py", "Rdiff.py", "regress.py", "restore.py",
+					 "robust.py", "rorpiter.py", "rpath.py",
+					 "Security.py", "selection.py",
+					 "SetConnections.py", "static.py",
+					 "statistics.py", "TempFile.py", "Time.py",
+					 "user_group.py", "win_acls.py"]:
+		shutil.copyfile(os.path.join(SourceDir, filename),
+						os.path.join(tardir, "rdiff_backup", filename))
+
+	VersionedCopy("%s/Globals.py" % (SourceDir,),
+				  "%s/rdiff_backup/Globals.py" % (tardir,))
+	VersionedCopy("rdiff-backup", "%s/rdiff-backup" % (tardir,), 1)
+	VersionedCopy("rdiff-backup-statistics", "%s/rdiff-backup-statistics"
+				  % (tardir,), 1)
+	VersionedCopy(DistDir + "/setup.py", "%s/setup.py" % (tardir,))
+
+	os.chmod(os.path.join(tardir, "setup.py"), 0755)
+	os.chmod(os.path.join(tardir, "rdiff-backup"), 0644)
+	CopyMan(os.path.join(tardir, "rdiff-backup.1"), Version)
+	CopyMan(os.path.join(tardir, "rdiff-backup-statistics.1"), Version)
+	if os.name != 'nt':
+		os.system("tar -cvzf %s %s" % (tarfilename, tardir))
+	else:
+		import tarfile
+		tar = tarfile.open(tarfilename, 'w:gz')
+		for path in os.listdir(tardir):
+			tar.add(os.path.join(tardir, path))
+		tar.close()
+
+	shutil.rmtree(tardir)
+	return tarfilename
+
+def MakeSpecFile():
+	"""Create spec file using spec template"""
+	specfile, fedora_specfile= "rdiff-backup.spec", "rdiff-backup.spec-fedora"
+	VersionedCopy(spec_template, specfile)
+	VersionedCopy(fedora_spec_template, fedora_specfile)
+	return [specfile, fedora_specfile]
+
+def parse_cmdline(arglist):
+	"""Returns action"""
+	global Version
+	def error():
+		print "Syntax: makedist [--html-only] [version_number]"
+		sys.exit(1)		
+
+	optlist, args = getopt.getopt(arglist, "", ["html-only"])
+	if len(args) != 1: error()
+	else: Version = args[0]
+
+	for opt, arg in optlist:
+		if opt == "--html-only": return "HTML"
+		else: assert 0, "Bad argument"
+	return "All"
+
+def Main():
+	action = parse_cmdline(sys.argv[1:])
+	print "Making HTML"
+	MakeHTML("FAQ", "rdiff-backup FAQ")
+	MakeHTML("examples", "rdiff-backup examples")
+
+	if action != "HTML":
+		assert action == "All"
+		print "Processing version " + Version
+		specfiles = MakeSpecFile()
+		print "Made specfiles ", specfiles
+		tarfile = MakeTar(specfiles)
+		print "Made tar file " + tarfile
+
+
+if __name__ == "__main__" and not globals().has_key('__no_execute__'):
+	Main()
+

branches/r1-2/rdiff-backup/dist/makerpm

+#!/usr/bin/env python
+#
+# Builds two rpms, one for generic release, and the other for the
+# Fedora project.
+
+import os, sys
+
+rpmroot = os.path.join(os.environ['HOME'], 'rpm')
+
+if len(sys.argv) == 2:
+	Version = sys.argv[1]
+	specfile = "rdiff-backup.spec"
+	fedora_specfile = "rdiff-backup.spec-fedora"
+	print "Using specfiles %s, %s" % (specfile, fedora_specfile)
+else:
+	print "Syntax:  %s version_number" % sys.argv[0]
+	sys.exit(1)
+
+base = "rdiff-backup-%s" % (Version,)
+tarfile = base + ".tar.gz"
+rpmbase = base + "-1"
+i386_rpm = rpmbase + ".i386.rpm"
+source_rpm = rpmbase + ".src.rpm"
+
+fedora_rpmbase = base + "-0.fdr.1"
+fedora_i386_rpm = fedora_rpmbase + ".i386.rpm"
+fedora_source_rpm = fedora_rpmbase + ".src.rpm"
+
+# These assume the rpm root directory $HOME/rpm.  The
+# nonstandard location allows for building by non-root user.
+assert not os.system("cp %s %s/SOURCES" % (tarfile, rpmroot))
+assert not os.system("rpmbuild -ba -v --sign " + specfile)
+assert not os.system("mv %s/RPMS/i386/%s ." % (rpmroot, i386_rpm))
+assert not os.system("mv %s/SRPMS/%s ." % (rpmroot, source_rpm))
+
+assert not os.system("rpmbuild -ba -v --sign " + fedora_specfile)
+assert not os.system("mv %s/RPMS/i386/%s ." % (rpmroot, fedora_i386_rpm))
+assert not os.system("mv %s/SRPMS/%s ." % (rpmroot, fedora_source_rpm))

branches/r1-2/rdiff-backup/dist/makeweb

+#!/usr/bin/env python
+
+import sys, os
+
+def RunCommand(cmd, ignore_error = 0):
+	print cmd
+	if ignore_error: os.system(cmd)
+	else: assert not os.system(cmd)
+
+webprefix = "/home/ben/misc/html/mirror/rdiff-backup/"
+
+if not sys.argv[1:]:
+	print 'Call with version number, as in "./makeweb 0.3.1"'
+	print "to move new rpms and tarballs.  Now just remaking FAQ and man page."
+	print
+else:
+	version = sys.argv[1]
+	RunCommand("cp *%s* %s" % (version, webprefix))
+
+RunCommand("rman -f html -r '' rdiff-backup.1 > %srdiff-backup.1.html"
+		   % webprefix)
+RunCommand("cp FAQ.wml CHANGELOG %s" % webprefix)
+
+
+if sys.argv[1:]:
+	RunCommand("mkdir %s/OLD/%s" % (webprefix, version), ignore_error = 1)
+	RunCommand("cp rdiff-backup-%s.tar.gz rdiff-backup-%s*rpm %s/OLD/%s" %
+			   (version, version, webprefix, version))
+os.chdir(webprefix)
+print "cd ", webprefix
+if sys.argv[1:]:
+	for filename in os.listdir('OLD/' + version):
+	    try: os.lstat(filename)
+	    except OSError: pass
+	    else: os.remove(filename)
+	    os.symlink('OLD/%s/%s' % (version, filename), filename)
+	RunCommand("rm latest latest.src.rpm latest.tar.gz", ignore_error = 1)
+	RunCommand("ln -s rdiff-backup-%s-1.src.rpm latest.src.rpm" % (version,))
+	os.symlink("rdiff-backup-%s.tar.gz" % (version,), 'latest.tar.gz')
+	os.symlink('OLD/%s' % (version,), 'latest')
+RunCommand("./Make")

branches/r1-2/rdiff-backup/dist/rdiff-backup-rh7x.patch

+--- rdiff-backup.old	Sat Apr  6 10:05:18 2002
++++ rdiff-backup	Sat Apr  6 10:05:25 2002
+@@ -1,4 +1,4 @@
+-#!/usr/bin/env python
++#!/usr/bin/env python2
+ #
+ # rdiff-backup -- Mirror files while keeping incremental changes
+ # Version 0.7.1 released March 25, 2002

branches/r1-2/rdiff-backup/dist/rdiff-backup.rh7x.spec

+Summary: Convenient and transparent local/remote incremental mirror/backup
+Name: rdiff-backup
+Release: 1
+URL: http://www.stanford.edu/~bescoto/rdiff-backup/
+Source: %{name}-%{version}.tar.gz
+Copyright: GPL
+Group: Applications/Archiving
+BuildRoot: %{_tmppath}/%{name}-root
+requires: librsync, python2 >= 2.2
+Patch: rdiff-backup-rh7x.patch
+
+%description
+rdiff-backup is a script, written in Python, that backs up one
+directory to another and is intended to be run periodically (nightly
+from cron for instance). The target directory ends up a copy of the
+source directory, but extra reverse diffs are stored in the target
+directory, so you can still recover files lost some time ago. The idea
+is to combine the best features of a mirror and an incremental
+backup. rdiff-backup can also operate in a bandwidth efficient manner
+over a pipe, like rsync. Thus you can use rdiff-backup and ssh to
+securely back a hard drive up to a remote location, and only the
+differences from the previous backup will be transmitted.
+
+%prep
+%setup
+%patch
+%build
+
+%install
+rm -rf $RPM_BUILD_ROOT
+mkdir -p $RPM_BUILD_ROOT/usr/bin
+mkdir -p $RPM_BUILD_ROOT/usr/share/man/man1
+
+install -m 755 rdiff-backup $RPM_BUILD_ROOT/usr/bin/rdiff-backup
+install -m 644 rdiff-backup.1 $RPM_BUILD_ROOT/usr/share/man/man1/rdiff-backup.1
+%clean
+
+%files
+%defattr(-,root,root)
+
+/usr/bin/rdiff-backup
+/usr/share/man/man1/rdiff-backup.1.gz
+%doc CHANGELOG COPYING README FAQ.html
+
+%changelog
+* Sat Apr 6 2002 Ben Escoto <bescoto@stanford.edu>
+- Made new version for Redhat 7.x series
+* Sun Nov 4 2001 Ben Escoto <bescoto@stanford.edu>
+- Initial RPM
+

branches/r1-2/rdiff-backup/dist/rdiff-backup.spec.template

+%define PYTHON_NAME %((rpm -q --quiet python2 && echo python2) || echo python)
+%define PYTHON_VERSION %(%{PYTHON_NAME} -c 'import sys; print sys.version[:3],')
+%define NEXT_PYTHON_VERSION %(%{PYTHON_NAME} -c 'import sys; print "%d.%d" % (sys.version_info[0], sys.version_info[1]+1),')
+
+Version: $version
+Summary: Convenient and transparent local/remote incremental mirror/backup
+Name: rdiff-backup
+Release: 1
+Epoch: 0
+URL: http://www.nongnu.org/rdiff-backup/
+Source: http://savannah.nongnu.org/download/rdiff-backup/rdiff-backup-%{version}.tar.gz
+License: GPL
+Group: Applications/Archiving
+BuildRoot:	%{_tmppath}/%{name}-%{version}-%{release}-root-%(%{__id_u} -n)
+Requires: %{PYTHON_NAME} >= %{PYTHON_VERSION}, %{PYTHON_NAME} < %{NEXT_PYTHON_VERSION}
+BuildPrereq: %{PYTHON_NAME}-devel >= 2.2, librsync-devel >= 0.9.7
+
+%description
+rdiff-backup is a script, written in Python, that backs up one
+directory to another and is intended to be run periodically (nightly
+from cron for instance). The target directory ends up a copy of the
+source directory, but extra reverse diffs are stored in the target
+directory, so you can still recover files lost some time ago. The idea
+is to combine the best features of a mirror and an incremental
+backup. rdiff-backup can also operate in a bandwidth efficient manner
+over a pipe, like rsync. Thus you can use rdiff-backup and ssh to
+securely back a hard drive up to a remote location, and only the
+differences from the previous backup will be transmitted.
+
+%prep
+%setup -q
+
+%build
+%{PYTHON_NAME} setup.py build
+
+%install
+%{PYTHON_NAME} setup.py install --root $RPM_BUILD_ROOT
+# Produce .pyo files for %ghost directive later
+%{PYTHON_NAME} -Oc 'from compileall import *; compile_dir("'$RPM_BUILD_ROOT/%{_libdir}/python%{PYTHON_VERSION}/site-packages/rdiff_backup'")'
+rm -rf $RPM_BUILD_ROOT/usr/share/doc/* 
+
+%clean
+rm -rf $RPM_BUILD_ROOT
+
+%files
+%defattr(-,root,root)
+%{_bindir}/rdiff-backup
+%{_bindir}/rdiff-backup-statistics
+%{_mandir}/man1/rdiff-backup*
+%dir %{_libdir}/python%{PYTHON_VERSION}/site-packages/rdiff_backup
+%{_libdir}/python%{PYTHON_VERSION}/site-packages/rdiff_backup/*.py
+%{_libdir}/python%{PYTHON_VERSION}/site-packages/rdiff_backup/*.pyc
+%{_libdir}/python%{PYTHON_VERSION}/site-packages/rdiff_backup/*.so
+%ghost %{_libdir}/python%{PYTHON_VERSION}/site-packages/rdiff_backup/*.pyo
+%doc CHANGELOG COPYING FAQ.html examples.html README
+
+%changelog
+* Wed Nov 15 2006 Gordon Rowell <gordonr@gormand.com.au> 1.1.7-1
+- Update URLs
+
+* Mon Aug 22 2005 Ben Escoto <ben@emerose.org> - 1.0.0-3
+- Matthijs van der Klip's patch to fix python2 support
+
+* Tue Aug 16 2005 Ben Escoto <ben@emerose.org> - 1.0.0-2
+- Removing /usr/share/doc in build for some obscure reason
+
+* Mon Mar 28 2005 Ben Escoto <ben@emerose.org> - 0.13.5-1
+- Set librsync >= 0.9.7 to encourage upgrade
+
+* Sat Dec 15 2003 Ben Escoto <bescoto@stanford.edu> - 0.12.6-2
+- Readded python2/python code; turns out not everyone calls it python
+- A number of changes from Fedora rpm.
+
+* Thu Sep 11 2003 Ben Escoto <bescoto@stanford.edu> - 0.12.4-1
+- Removed code that selected between python2 and python; I think
+  everyone calls it python now.
+
+* Thu Aug 8 2003 Ben Escoto <bescoto@stanford.edu>
+- Set librsync >= 0.9.6, because rsync.h renamed to librsync.h
+
+* Sun Jul 20 2003 Ben Escoto <bescoto@stanford.edu>
+- Minor changes to comply with Fedora standards.
+
+* Sun Jan 19 2002 Troels Arvin <troels@arvin.dk>
+- Builds, no matter if Python 2.2 is called python2-2.2 or python-2.2.
+
+* Sun Nov 4 2001 Ben Escoto <bescoto@stanford.edu>
+- Initial RPM

branches/r1-2/rdiff-backup/dist/rdiff-backup.spec.template-fedora

+%define PYTHON_VERSION %(python -c 'import sys; print sys.version[:3],')
+%define NEXT_PYTHON_VERSION %(python -c 'import sys; print "%d.%d" % (sys.version_info[0], sys.version_info[1]+1),')
+
+Version: $version
+Summary: Convenient and transparent local/remote incremental mirror/backup
+Name: rdiff-backup
+Release: 0.fdr.1
+Epoch: 0
+URL: http://www.nongnu.org/rdiff-backup/
+Source: http://savannah.nongnu.org/download/rdiff-backup/rdiff-backup-%{version}.tar.gz
+License: GPL
+Group: Applications/Archiving
+BuildRoot:	%{_tmppath}/%{name}-%{version}-%{release}-root-%(%{__id_u} -n)
+Requires: python >= 0:%{PYTHON_VERSION}, python < 0:%{NEXT_PYTHON_VERSION}
+BuildRequires: python-devel >= 0:2.2, librsync-devel >= 0:0.9.6
+
+%description
+rdiff-backup is a script, written in Python, that backs up one
+directory to another and is intended to be run periodically (nightly
+from cron for instance). The target directory ends up a copy of the
+source directory, but extra reverse diffs are stored in the target
+directory, so you can still recover files lost some time ago. The idea
+is to combine the best features of a mirror and an incremental
+backup. rdiff-backup can also operate in a bandwidth efficient manner
+over a pipe, like rsync. Thus you can use rdiff-backup and ssh to
+securely back a hard drive up to a remote location, and only the
+differences from the previous backup will be transmitted.
+
+%prep
+%setup -q
+
+%build
+python setup.py build
+
+%install
+python setup.py install --root $RPM_BUILD_ROOT
+# Produce .pyo files for %ghost directive later
+python -Oc 'from compileall import *; compile_dir("'$RPM_BUILD_ROOT/%{_libdir}/python%{PYTHON_VERSION}/site-packages/rdiff_backup'")'
+
+%clean
+rm -rf $RPM_BUILD_ROOT
+
+%files
+%defattr(-,root,root)
+%{_bindir}/rdiff-backup
+%{_bindir}/rdiff-backup-statistics
+%{_mandir}/man1/rdiff-backup*
+%dir %{_libdir}/python%{PYTHON_VERSION}/site-packages/rdiff_backup
+%{_libdir}/python%{PYTHON_VERSION}/site-packages/rdiff_backup/*.py
+%{_libdir}/python%{PYTHON_VERSION}/site-packages/rdiff_backup/*.pyc
+%{_libdir}/python%{PYTHON_VERSION}/site-packages/rdiff_backup/*.so
+%ghost %{_libdir}/python%{PYTHON_VERSION}/site-packages/rdiff_backup/*.pyo
+%doc CHANGELOG COPYING FAQ.html README
+
+%changelog
+* Wed Nov 15 2006 Gordon Rowell <gordonr@gormand.com.au> 0:1.1.7-0.fdr.1
+- update URLs
+
+* Sun Oct 05 2003 Ben Escoto <bescoto@stanford.edu> - 0:0.12.5-0.fdr.1
+- Added epochs to python versions, more concise %%defines, %%ghost files
+
+* Thu Aug 16 2003 Ben Escoto <bescoto@stanford.edu> - 0:0.12.3-0.fdr.4
+- Implemented various suggestions of Fedora QA
+
+* Sun Nov 4 2001 Ben Escoto <bescoto@stanford.edu>
+- Initial RPM

branches/r1-2/rdiff-backup/dist/setup.py

+#!/usr/bin/env python
+
+import sys, os, getopt
+from distutils.core import setup, Extension
+
+version_string = "$version"
+
+if sys.version_info[:2] < (2,2):
+	print "Sorry, rdiff-backup requires version 2.2 or later of python"
+	sys.exit(1)
+
+# Defaults
+lflags_arg = []
+libname = ['rsync']
+incdir_list = libdir_list = None
+extra_options = {}
+
+if os.name == 'posix' or os.name == 'nt':
+	LIBRSYNC_DIR = os.environ.get('LIBRSYNC_DIR', '')
+	LFLAGS = os.environ.get('LFLAGS', [])
+	LIBS = os.environ.get('LIBS', [])
+
+	# Handle --librsync-dir=[PATH] and --lflags=[FLAGS]
+	args = sys.argv[:]
+	for arg in args:
+		if arg.startswith('--librsync-dir='):
+			LIBRSYNC_DIR = arg.split('=')[1]
+			sys.argv.remove(arg)
+		elif arg.startswith('--lflags='):
+			LFLAGS = arg.split('=')[1].split()
+			sys.argv.remove(arg)
+		elif arg.startswith('--libs='):
+			LIBS = arg.split('=')[1].split()
+			sys.argv.remove(arg)
+
+		if LFLAGS or LIBS:
+			lflags_arg = LFLAGS + LIBS
+
+		if LIBRSYNC_DIR:
+			incdir_list = [os.path.join(LIBRSYNC_DIR, 'include')]
+			libdir_list = [os.path.join(LIBRSYNC_DIR, 'lib')]
+		if '-lrsync' in LIBS:
+			libname = []
+
+if os.name == 'nt':
+	try:
+		import py2exe
+	except ImportError:
+		pass
+	else:
+		extra_options = {
+			'console': ['rdiff-backup'],
+		}
+		if '--single-file' in sys.argv[1:]:
+			sys.argv.remove('--single-file')
+			extra_options.update({
+				'options': {'py2exe': {'bundle_files': 1}},
+				'zipfile': None
+			})
+
+setup(name="rdiff-backup",
+	  version=version_string,
+	  description="Local/remote mirroring+incremental backup",
+	  author="Ben Escoto",
+	  author_email="rdiff-backup@emerose.org",
+	  url="http://rdiff-backup.nongnu.org/",
+	  packages = ['rdiff_backup'],
+	  ext_modules = [Extension("rdiff_backup.C", ["cmodule.c"]),
+					 Extension("rdiff_backup._librsync",
+							   ["_librsyncmodule.c"],
+							   include_dirs=incdir_list,
+							   library_dirs=libdir_list,
+							   libraries=libname,
+							   extra_link_args=lflags_arg)],
+	  scripts = ['rdiff-backup', 'rdiff-backup-statistics'],
+	  data_files = [('share/man/man1', ['rdiff-backup.1',
+										'rdiff-backup-statistics.1']),
+					('share/doc/rdiff-backup-%s' % (version_string,),
+					 ['CHANGELOG', 'COPYING', 'README', 'FAQ.html'])],
+					**extra_options)
+

branches/r1-2/rdiff-backup/misc/compress-rdiff-backup-increments

+#!/usr/bin/env python
+#
+# Compresses old rdiff-backup increments.  See
+# http://www.stanford.edu/~bescoto/rdiff-backup for information on
+# rdiff-backup.
+
+from __future__ import nested_scopes, generators
+import os, sys, getopt
+
+rdiff_backup_location = "/usr/bin/rdiff-backup"
+no_compression_regexp_string = None
+__no_execute__ = 1
+
+def print_help():
+	"""Print usage, exit"""
+	print """
+Usage: compress-rdiff-backup-increments [options] mirror_directory
+
+This script will compress the old rdiff-backup increments under
+mirror_directory, in a format compatible with rdiff-backup version
+0.7.1 and later.  So for instance if you were using an old version
+of rdiff-backup like this:
+
+rdiff-backup /foo /backup
+
+and now you want to take advantage of v0.7.1's space saving
+compression, you can run:
+
+compress-rdiff-backup-increments /backup
+
+
+Options:
+
+--rdiff-backup-location location
+    This script reads your rdiff-backup executable.  The default
+    is "/usr/bin/rdiff-backup", so if your rdiff-backup is in a
+    different location, you must use this switch.
+
+--no-compression-regexp regexp
+    Any increments whose base name match this regular expression
+    won't be compressed.  This is generally used to avoid
+    compressing already compressed files.  See the rdiff-backup
+    man page for the default.
+"""
+	sys.exit(1)
+	
+def parse_args(arglist):
+	"""Check and evaluate command line arguments, return dirname"""
+	global rdiff_backup_location
+	global no_compression_regexp_string
+	try: optlist, args = getopt.getopt(arglist, "v:",
+									   ["rdiff-backup-location=",
+										"no-compression-regexp="])
+	except getopt.error: print_help()
+
+	for opt, arg in optlist:
+		if opt == "--no-compression-regexp":
+			no_compression_regexp_string = arg
+		elif opt == "--rdiff-backup-location": rdiff_backup_location = arg
+		else:
+			print "Bad option: ", opt
+			print_help()
+
+	if len(args) != 1:
+		print "Wrong number of arguments"
+		print_help()
+	return args[0]
+
+def exec_rdiff_backup():
+	"""Execs rdiff-backup"""
+	try: execfile(rdiff_backup_location, globals())
+	except IOError:
+		print "Unable to read", rdiff_backup_location
+		print "You may need to use the --rdiff-backup-location argument"
+		sys.exit(1)
+
+	if not map(int, Globals.version.split(".")) >= [0, 7, 1]:
+		print "This script requires rdiff-backup version 0.7.1 or later,",
+		print "found version", Globals.version
+		sys.exit(1)
+
+def gzip_file(rp):
+	"""gzip rp, adding .gz to path and deleting original"""
+	newrp = RPath(rp.conn, rp.base, rp.index[:-1] + (rp.index[-1]+".gz",))
+	if newrp.lstat():
+		print "Warning: %s already exists, skipping" % newrp.path
+		return
+
+	print "gzipping ", rp.path
+	newrp.write_from_fileobj(rp.open("rb"), compress = 1)
+	RPath.copy_attribs(rp, newrp)
+	rp.delete()
+
+def Main():
+	dirname = parse_args(sys.argv[1:])
+	exec_rdiff_backup()
+	if no_compression_regexp_string is not None:
+		no_compression_regexp = re.compile(no_compression_regexp_string, re.I)
+	else: no_compression_regexp = \
+		  re.compile(Globals.no_compression_regexp_string, re.I)
+	Globals.change_source_perms = 1
+	Globals.change_ownership = (os.getuid() == 0)
+
+	# Check to make sure rbdir exists
+	root_rp = RPath(Globals.local_connection, dirname)
+	rbdir = root_rp.append("rdiff-backup-data")
+	if not rbdir.lstat():
+		print "Cannot find %s, exiting" % rbdir.path
+		sys.exit(1)
+
+	for dsrp in DestructiveStepping.Iterate_with_Finalizer(rbdir, 1):
+		if (dsrp.isincfile() and dsrp.isreg() and
+			not dsrp.isinccompressed() and
+			(dsrp.getinctype() == "diff" or dsrp.getinctype() == "snapshot")
+			and dsrp.getsize() != 0 and
+			not no_compression_regexp.match(dsrp.getincbase_str())):
+			gzip_file(dsrp)
+
+Main()
+

branches/r1-2/rdiff-backup/misc/find2dirs

+#!/usr/bin/env python
+
+from __future__ import generators
+import sys, os, stat
+
+def usage():
+	print "Usage: find2dirs dir1 dir2"
+	print
+	print "Given the name of two directories, list all the files in both, one"
+	print "per line, but don't repeat a file even if it is in both directories"
+	sys.exit(1)
+
+def getlist(base, ext = ""):
+	"""Return iterator yielding filenames from directory"""
+	if ext: yield ext
+	else: yield "."
+
+	fullname = os.path.join(base, ext)
+	if stat.S_ISDIR(stat.S_IFMT(os.lstat(fullname)[stat.ST_MODE])):
+		for subfile in os.listdir(fullname):
+			for fn in getlist(base, os.path.join(ext, subfile)): yield fn
+
+def main(dir1, dir2):
+	d = {}
+	for fn in getlist(dir1): d[fn] = 1
+	for fn in getlist(dir2): d[fn] = 1
+	for fn in d.keys(): print fn
+
+if not len(sys.argv) == 3: usage()
+else: main(sys.argv[1], sys.argv[2])

branches/r1-2/rdiff-backup/misc/init_files.py

+#!/usr/bin/env python
+
+"""init_smallfiles.py
+
+This program makes a number of files of the given size in the
+specified directory.
+
+"""
+
+import os, stat, sys, math
+
+if len(sys.argv) > 5 or len(sys.argv) < 4:
+	print "Usage: init_files [directory name] [file size] [file count] [base]"
+	print
+	print "Creates file_count files in directory_name of size file_size."
+	print "The created directory has a tree type structure where each level"
+	print "has at most base files or directories in it.  Default is 50."
+	sys.exit(1)
+
+dirname = sys.argv[1]
+filesize = int(sys.argv[2])
+filecount = int(sys.argv[3])
+block_size = 16384
+block = "." * block_size
+block_change = "." * (filesize % block_size)
+if len(sys.argv) == 4: base = 50
+else: base = int(sys.argv[4])
+
+def make_file(path):
+	"""Make the file at path"""
+	fp = open(path, "w")
+	for i in xrange(int(math.floor(filesize/block_size))): fp.write(block)
+	fp.write(block_change)
+	fp.close()
+
+def find_sublevels(count):
+	"""Return number of sublevels required for count files"""
+	return int(math.ceil(math.log(count)/math.log(base)))
+
+def make_dir(dir, count):
+	"""Make count files in the directory, making subdirectories if necessary"""
+	print "Making directory %s with %d files" % (dir, count)
+	os.mkdir(dir)
+	level = find_sublevels(count)
+	assert count <= pow(base, level)
+	if level == 1:
+		for i in range(count): make_file(os.path.join(dir, "file%d" %i))
+	else:
+		files_per_subdir = pow(base, level-1)
+		full_dirs = int(count/files_per_subdir)
+		assert full_dirs <= base
+		for i in range(full_dirs):
+			make_dir(os.path.join(dir, "subdir%d" % i), files_per_subdir)
+
+		change = count - full_dirs*files_per_subdir
+		assert change >= 0
+		if change > 0:
+			make_dir(os.path.join(dir, "subdir%d" % full_dirs), change)
+
+def start(dir):
+	try: os.stat(dir)
+	except os.error: pass
+	else:
+		print "Directory %s already exists, exiting." % dir
+		sys.exit(1)
+
+	make_dir(dirname, filecount)
+
+start(dirname)

branches/r1-2/rdiff-backup/misc/librsync-many-files.py

+#!/usr/bin/env python
+
+"""Use librsync to transform everything in one dir to another"""
+
+import sys, os, librsync
+
+dir1, dir2 = sys.argv[1:3]
+for i in xrange(1000):
+	dir1fn = "%s/%s" % (dir1, i)
+	dir2fn = "%s/%s" % (dir2, i)
+
+	# Write signature file
+	f1 = open(dir1fn, "rb")
+	sigfile = open("sig", "wb")
+	librsync.filesig(f1, sigfile, 2048)
+	f1.close()
+	sigfile.close()
+
+	# Write delta file
+	f2 = open(dir2fn, "r")
+	sigfile = open("sig", "rb")
+	deltafile = open("delta", "wb")
+	librsync.filerdelta(sigfile, f2, deltafile)
+	f2.close()
+	sigfile.close()
+	deltafile.close()
+
+	# Write patched file
+	f1 = open(dir1fn, "rb")
+	newfile = open("%s/%s.out" % (dir1, i), "wb")
+	deltafile = open("delta", "rb")
+	librsync.filepatch(f1, deltafile, newfile)
+	f1.close()
+	deltafile.close()
+	newfile.close()
+
+	

branches/r1-2/rdiff-backup/misc/make-many-data-files.py

+#!/usr/bin/env python
+
+"""Make 10000 files consisting of data
+
+Syntax:  test.py directory_name number_of_files character filelength"""
+
+import sys, os
+
+dirname = sys.argv[1]
+num_files = int(sys.argv[2])
+character = sys.argv[3]
+filelength = int(sys.argv[4])
+
+os.mkdir(dirname)
+for i in xrange(num_files):
+	fp = open("%s/%s" % (dirname, i), "w")
+	fp.write(character * filelength)
+	fp.close()
+
+fp = open("%s.big" % dirname, "w")
+fp.write(character * (filelength*num_files))
+fp.close()

branches/r1-2/rdiff-backup/misc/myrm

+#!/usr/bin/python
+
+import sys, os
+#sys.path.insert(0, "../src")
+from rdiff_backup.rpath import *
+from rdiff_backup.connection import *
+from rdiff_backup import Globals
+
+lc = Globals.local_connection
+
+for filename in sys.argv[1:]:
+	#print "Deleting %s" % filename
+	rp = RPath(lc, filename)
+	if rp.lstat(): rp.delete()
+	#os.system("rm -rf " + rp.path)

branches/r1-2/rdiff-backup/misc/rdiff-many-files.py

+#!/usr/bin/env python
+
+"""Run rdiff to transform everything in one dir to another"""
+
+import sys, os
+
+dir1, dir2 = sys.argv[1:3]
+for i in xrange(1000):
+	assert not os.system("rdiff signature %s/%s sig" % (dir1, i))
+	assert not os.system("rdiff delta sig %s/%s diff" % (dir2, i))
+	assert not os.system("rdiff patch %s/%s diff %s/%s.out" %
+						 (dir1, i, dir1, i))
+
+	

branches/r1-2/rdiff-backup/misc/remove-comments.py

+#!/usr/bin/env python
+
+"""remove-comments.py
+
+Given a python program on standard input, spit one out on stdout that
+should work the same, but has blank and comment lines removed.
+
+"""
+
+import sys, re
+
+triple_regex = re.compile('"""')
+
+def eattriple(initial_line_stripped):
+	"""Keep reading until end of doc string"""
+	assert initial_line_stripped.startswith('"""')
+	if triple_regex.search(initial_line_stripped[3:]): return
+	while 1:
+		line = sys.stdin.readline()
+		if not line or triple_regex.search(line): break		
+
+while 1:
+	line = sys.stdin.readline()
+	if not line: break
+	stripped = line.strip()
+	if not stripped: continue
+	if stripped[0] == "#": continue
+	if stripped.startswith('"""'):
+		eattriple(stripped)
+		continue
+	sys.stdout.write(line)
+	

branches/r1-2/rdiff-backup/python-rdiff

+#!/usr/bin/env python
+
+import sys
+from rdiff_backup import librsync
+
+blocksize = 64*1024 # just used in copying
+librsync_blocksize = None # If not set, use defaults in _librsync module
+
+def usage():
+	"""Print usage and then exit"""
+	print """
+Usage: %(cmd)s "signature" basis_file signature_file
+       %(cmd)s "delta" signature_file new_file delta_file
+       %(cmd)s "patch" basis_file delta_file new_file
+""" % {'cmd': sys.argv[0]}
+	sys.exit(1)
+
+def copy_and_close(infp, outfp):
+	"""Copy file streams infp to outfp in blocks, closing when done"""
+	while 1:
+		buf = infp.read(blocksize)
+		if not buf: break
+		outfp.write(buf)
+	assert not infp.close() and not outfp.close()
+
+def write_sig(input_path, output_path):
+	"""Open file at input_path, write signature to output_path"""
+	infp = open(input_path, "rb")
+	if librsync_blocksize: sigfp = librsync.SigFile(infp, librsync_blocksize)
+	else: sigfp = librsync.SigFile(infp)
+	copy_and_close(sigfp, open(output_path, "wb"))
+
+def write_delta(sig_path, new_path, output_path):
+	"""Read signature and new file, write to delta to delta_path"""
+	deltafp = librsync.DeltaFile(open(sig_path, "rb"), open(new_path, "rb"))
+	copy_and_close(deltafp, open(output_path, "wb"))
+
+def write_patch(basis_path, delta_path, out_path):
+	"""Patch file at basis_path with delta at delta_path, write to out_path"""
+	patchfp = librsync.PatchedFile(open(basis_path, "rb"),
+								   open(delta_path, "rb"))
+	copy_and_close(patchfp, open(out_path, "wb"))
+
+def check_different(filelist):
+	"""Make sure no files the same"""
+	d = {}
+	for file in filelist: d[file] = file
+	assert len(d) == len(filelist), "Error, must use all different filenames"
+
+def Main():
+	"""Run program"""
+	if len(sys.argv) < 4: usage()
+	mode = sys.argv[1]
+	file_args = sys.argv[2:]
+	check_different(file_args)
+	if mode == "signature":
+		if len(file_args) != 2: usage()
+		write_sig(*file_args)
+	elif mode == "delta":
+		if len(file_args) != 3: usage()
+		write_delta(*file_args)
+	elif mode == "patch":
+		if len(file_args) != 3: usage()
+		write_patch(*file_args)
+	else: usage()
+
+
+if __name__ == "__main__": Main()
+

branches/r1-2/rdiff-backup/rdiff-backup

+#!/usr/bin/env python
+# rdiff-backup -- Mirror files while keeping incremental changes
+# Version $version released $date
+# Copyright (C) 2001-2005  Ben Escoto <rdiff-backup@emerose.org>
+#
+# This program is licensed under the GNU General Public License (GPL).
+# you can redistribute it and/or modify it under the terms of the GNU
+# General Public License as published by the Free Software Foundation,
+# Inc., 59 Temple Place, Suite 330, Boston, MA 02111-1307 USA; either
+# version 2 of the License, or (at your option) any later version.
+# Distributions of rdiff-backup should include a copy of the GPL in a
+# file called COPYING.  The GPL is also available online at
+# http://www.gnu.org/copyleft/gpl.html.
+#
+# See http://rdiff-backup.nongnu.org/ for more information.  Please
+# send mail to me or the mailing list if you find bugs or have any
+# suggestions.
+
+import sys
+import rdiff_backup.Main
+
+try:
+	import msvcrt, os
+	msvcrt.setmode(0, os.O_BINARY)
+	msvcrt.setmode(1, os.O_BINARY)
+except ImportError:
+	pass
+
+if __name__ == "__main__" and not globals().has_key('__no_execute__'):
+	rdiff_backup.Main.error_check_Main(sys.argv[1:])
+
+

branches/r1-2/rdiff-backup/rdiff-backup-statistics.1

+.TH RDIFF-BACKUP-STATISTICS 1 "NOVEMBER 2006" "Version 1.1.6" "User Manuals" \" -*- nroff -*-
+.SH NAME
+rdiff-backup-statistics \- summarize rdiff-backup statistics files
+.SH SYNOPSIS
+.B rdiff-backup-statistics
+.BI [\-\-begin-time " time" ]
+.BI [\-\-end-time " time" ]
+.BI [\-\-minimum-ratio " ratio" ]
+.B [\-\-null-separator]
+.B [\-\-quiet]
+.I repository
+
+.SH DESCRIPTION
+.BI rdiff-backup-statistics
+reads the matching statistics files in a backup repository made by
+.B rdiff-backup
+and prints some summary statistics to the screen.  It does not alter
+the repository in any way.
+
+The required argument is the pathname of the root of an rdiff-backup
+repository.  For instance, if you ran "rdiff-backup in out", you could
+later run "rdiff-backup-statistics out".
+
+The output has two parts.  The first is simply an average of the all
+matching session_statistics files.  The meaning of these fields is
+explained in the FAQ included in the package, and also at
+.IR http://rdiff-backup.nongnu.org/FAQ.html#statistics .
+
+The second section lists some particularly significant files
+(including directories).  These files are either contain a lot of
+data, take up increment space, or contain a lot of changed files.  All
+the files that are above the minimum ratio (default 5%) will be
+listed.
+
+If a file or directory is listed, its contributions are subtracted
+from its parent.  That is why the percentage listed after a directory
+can be larger than the percentage of its parent.  Without this, the
+root directory would always be the largest, and the output would be
+boring.
+
+.SH OPTIONS
+.TP
+.BI \-\-begin-time " time"
+Do not read statistics files older than
+.IR time .
+By default, all statistics files will be read.
+.I time
+should be in the same format taken by \-\-restore-as-of.  (See
+.B TIME FORMATS
+in the rdiff-backup man page for details.)
+.TP
+.BI \-\-end-time " time"
+Like
+.B \-\-begin-time
+but exclude statistics files later than
+.IR time .
+.TP
+.BI \-\-minimum-ratio " ratio"
+Print all directories contributing more than the given ratio to the
+total.  The default value is .05, or 5 percent.
+.TP
+.B \-\-null-separator
+Specify that the lines of the file_statistics file are separated by
+nulls (\\0).  The default is to assume that newlines separate.  Use
+this switch if rdiff-backup was run with the \-\-null-separator when
+making the given repository.
+.TP
+.B \-\-quiet
+Suppress printing of the "Processing statistics from session..."
+output lines.
+
+.SH BUGS
+When aggregating multiple statistics files, some directories above
+(but close to) the minimum ratio may not be displayed.  For this
+reason, you may want to set the minimum-ratio lower than need.
+
+.SH AUTHOR
+Ben Escoto <ben@emerose.org>, based on original script by Dean Gaudet.
+
+.SH SEE ALSO
+.BR rdiff-backup (1),
+.BR python (1).
+The rdiff-backup web page is at
+.IR http://rdiff-backup.nongnu.org/ .

branches/r1-2/rdiff-backup/rdiff_backup/FilenameMapping.py

+# Copyright 2002, 2003 Ben Escoto
+#
+# This file is part of rdiff-backup.
+#
+# rdiff-backup is free software; you can redistribute it and/or modify
+# under the terms of the GNU General Public License as published by the
+# Free Software Foundation; either version 2 of the License, or (at your
+# option) any later version.
+#
+# rdiff-backup is distributed in the hope that it will be useful, but
+# WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the GNU
+# General Public License for more details.
+#
+# You should have received a copy of the GNU General Public License
+# along with rdiff-backup; if not, write to the Free Software
+# Foundation, Inc., 59 Temple Place, Suite 330, Boston, MA 02111-1307
+# USA
+
+"""Coordinate corresponding files with different names
+
+For instance, some source filenames may contain characters not allowed
+on the mirror end.  These files must be called something different on
+the mirror end, so we escape the offending characters with semicolons.
+
+One problem/complication is that all this escaping may put files over
+the 256 or whatever limit on the length of file names.  (We just don't
+handle that error.)
+
+"""
+
+from __future__ import generators
+import os, re, types
+import Globals, log, rpath
+
+# If true, enable character quoting, and set characters making
+# regex-style range.
+chars_to_quote = None
+
+# These compiled regular expressions are used in quoting and unquoting
+chars_to_quote_regexp = None
+unquoting_regexp = None
+
+# Use given char to quote.  Default is set in Globals.
+quoting_char = None
+
+
+class QuotingException(Exception): pass
+
+def set_init_quote_vals():
+	"""Set quoting value from Globals on all conns"""
+	for conn in Globals.connections:
+		conn.FilenameMapping.set_init_quote_vals_local()
+
+def set_init_quote_vals_local():
+	"""Set value on local connection, initialize regexps"""
+	global chars_to_quote, quoting_char
+	chars_to_quote = Globals.chars_to_quote
+	if len(Globals.quoting_char) != 1:
+		log.Log.FatalError("Expected single character for quoting char,"
+						   "got '%s' instead" % (Globals.quoting_char,))
+	quoting_char = Globals.quoting_char
+	init_quoting_regexps()
+
+def init_quoting_regexps():
+	"""Compile quoting regular expressions"""
+	global chars_to_quote_regexp, unquoting_regexp
+	assert chars_to_quote and type(chars_to_quote) is types.StringType, \
+		   "Chars to quote: '%s'" % (chars_to_quote,)
+	try:
+		chars_to_quote_regexp = \
+				 re.compile("[%s]|%s" % (chars_to_quote, quoting_char), re.S)
+		unquoting_regexp = re.compile("%s[0-9]{3}" % quoting_char, re.S)
+	except re.error:
+		log.Log.FatalError("Error '%s' when processing char quote list %r" %
+						   (re.error, chars_to_quote))
+
+def quote(path):
+	"""Return quoted version of given path
+
+	Any characters quoted will be replaced by the quoting char and
+	the ascii number of the character.  For instance, "10:11:12"
+	would go to "10;05811;05812" if ":" were quoted and ";" were
+	the quoting character.
+
+	"""
+	QuotedPath = chars_to_quote_regexp.sub(quote_single, path)
+	if not Globals.must_escape_dos_devices \
+			and not Globals.must_escape_trailing_spaces:
+		return QuotedPath
+
+	# Escape a trailing space or period (invalid in names on FAT32 under DOS,
+	# Windows and modern Linux)
+	if Globals.must_escape_trailing_spaces:
+		if len(QuotedPath) and (QuotedPath[-1] == ' ' or QuotedPath[-1] == '.'):
+			QuotedPath = QuotedPath[:-1] + \
+				"%s%03d" % (quoting_char, ord(QuotedPath[-1]))
+
+		if not Globals.must_escape_dos_devices:
+			return QuotedPath
+
+	# Escape first char of any special DOS device files even if filename has an
+	# extension.  Special names are: aux, prn, con, nul, com0-9, and lpt1-9.
+	if not re.search(r"^aux(\..*)*$|^prn(\..*)*$|^con(\..*)*$|^nul(\..*)*$|" \
+					 r"^com[0-9](\..*)*$|^lpt[1-9]{1}(\..*)*$", QuotedPath, \
+					 re.I):
+		return QuotedPath
+	return "%s%03d" % (quoting_char, ord(QuotedPath[0])) + QuotedPath[1:]
+
+def quote_single(match):
+	"""Return replacement for a single character"""
+	return "%s%03d" % (quoting_char, ord(match.group()))
+
+def unquote(path):
+	"""Return original version of quoted filename"""
+	return unquoting_regexp.sub(unquote_single, path)
+
+def unquote_single(match):
+	"""Unquote a single quoted character"""
+	if not len(match.group()) == 4:
+		raise QuotingException("Quoted group wrong size: " + match.group())
+	try: return chr(int(match.group()[1:]))
+	except ValueError:
+		raise QuotingException("Quoted out of range: " + match.group())
+
+
+class QuotedRPath(rpath.RPath):
+	"""RPath where the filename is quoted version of index
+
+	We use QuotedRPaths so we don't need to remember to quote RPaths
+	derived from this one (via append or new_index).  Note that only
+	the index is quoted, not the base.
+
+	"""
+	def __init__(self, connection, base, index = (), data = None):
+		"""Make new QuotedRPath"""
+		self.quoted_index = tuple(map(quote, index))
+		self.conn = connection
+		self.index = index
+		self.base = base
+		if base is not None:
+			if base == "/": self.path = "/" + "/".join(self.quoted_index)
+			else: self.path = "/".join((base,) + self.quoted_index)
+		self.file = None
+		if data or base is None: self.data = data
+		else: self.setdata()
+
+	def __setstate__(self, rpath_state):
+		"""Reproduce QuotedRPath from __getstate__ output"""
+		conn_number, self.base, self.index, self.data = rpath_state
+		self.conn = Globals.connection_dict[conn_number]
+		self.quoted_index = tuple(map(quote, self.index))
+		self.path = "/".join((self.base,) + self.quoted_index)
+
+	def listdir(self):
+		"""Return list of unquoted filenames in current directory
+
+		We want them unquoted so that the results can be sorted
+		correctly and append()ed to the currect QuotedRPath.
+
+		"""
+		return map(unquote, self.conn.os.listdir(self.path))
+
+	def __str__(self):
+		return "QuotedPath: %s\nIndex: %s\nData: %s" % \
+			   (self.path, self.index, self.data)
+
+	def isincfile(self):
+		"""Return true if path indicates increment, sets various variables"""
+		if not self.index: # consider the last component as quoted
+			dirname, basename = self.dirsplit()
+			temp_rp = rpath.RPath(self.conn, dirname, (unquote(basename),))
+			result = temp_rp.isincfile()
+			if result:
+				self.inc_basestr = unquote(temp_rp.inc_basestr)
+				self.inc_timestr = unquote(temp_rp.inc_timestr)
+		else:
+			result = rpath.RPath.isincfile(self)
+			if result: self.inc_basestr = unquote(self.inc_basestr)
+		return result
+		
+def get_quotedrpath(rp, separate_basename = 0):
+	"""Return quoted version of rpath rp"""
+	assert not rp.index # Why would we starting quoting "in the middle"?
+	if separate_basename:
+		dirname, basename = rp.dirsplit()
+		return QuotedRPath(rp.conn, dirname, (unquote(basename),), rp.data)
+	else: return QuotedRPath(rp.conn, rp.base, (), rp.data)
+
+def get_quoted_sep_base(filename):
+	"""Get QuotedRPath from filename assuming last bit is quoted"""
+	return get_quotedrpath(rpath.RPath(Globals.local_connection, filename), 1)
+
+def update_quoting(rbdir):
+	"""Update the quoting of a repository by renaming any
+	files that should be quoted differently.
+	"""
+
+	def requote(name):
+		unquoted_name = unquote(name)
+		quoted_name = quote(unquoted_name)
+		if name != quoted_name:
+			return quoted_name
+		else:
+			return None
+	
+	def process(dirpath_rp, name, list):
+		new_name = requote(name)
+		if new_name:
+			if list:
+				list.remove(name)
+				list.append(new_name)
+			name_rp = dirpath_rp.append(name)
+			new_rp = dirpath_rp.append(new_name)
+			log.Log("Re-quoting %s to %s" % (name_rp.path, new_rp.path), 5)
+			rpath.move(name_rp, new_rp)
+
+	assert rbdir.conn is Globals.local_connection
+	mirror_rp = rbdir.get_parent_rp()
+	mirror = mirror_rp.path
+
+	log.Log("Re-quoting repository %s" % mirror_rp.path, 3)
+
+	try:
+		os_walk = os.walk
+	except AttributeError:
+		os_walk = walk
+
+	for dirpath, dirs, files in os_walk(mirror):
+		dirpath_rp = mirror_rp.newpath(dirpath)
+
+		for name in dirs: process(dirpath_rp, name, dirs)
+		for name in files: process(dirpath_rp, name, None)
+
+"""
+os.walk() copied directly from Python 2.5.1's os.py
+
+Backported here for Python 2.2 support. os.walk() was first added
+in Python 2.3.
+"""
+def walk(top, topdown=True, onerror=None):
+	from os import error, listdir
+	from os.path import join, isdir, islink
+	# We may not have read permission for top, in which case we can't
+	# get a list of the files the directory contains.  os.path.walk
+	# always suppressed the exception then, rather than blow up for a
+	# minor reason when (say) a thousand readable directories are still
+	# left to visit.  That logic is copied here.
+	try:
+		# Note that listdir and error are globals in this module due
+		# to earlier import-*.
+		names = listdir(top)
+	except error, err:
+		if onerror is not None:
+			onerror(err)
+		return
+
+	dirs, nondirs = [], []
+	for name in names:
+		if isdir(join(top, name)):
+			dirs.append(name)
+		else:
+			nondirs.append(name)
+
+	if topdown:
+		yield top, dirs, nondirs
+	for name in dirs:
+		path = join(top, name)
+		if not islink(path):
+			for x in walk(path, topdown, onerror):
+				yield x
+	if not topdown:
+		yield top, dirs, nondirs

branches/r1-2/rdiff-backup/rdiff_backup/memoryleak.c

+#include <stdio.h>
+#include <rsync.h>
+
+main()
+{
+  FILE *basis_file, *sig_file;
+  char filename[50];
+  rs_stats_t stats;
+  rs_result result;
+  long i;
+
+  for(i=0; i<=100000; i++) {
+	basis_file = fopen("a", "r");
+	sig_file = fopen("sig", "w");
+  
+	result = rs_sig_file(basis_file, sig_file,
+						 RS_DEFAULT_BLOCK_LEN, RS_DEFAULT_STRONG_LEN,
+						 &stats);
+	if (result != RS_DONE) exit(result);
+	fclose(basis_file);
+	fclose(sig_file);
+  }
+}