C implementation of createrepo

Run createrepo -h for usage syntax.

Package build requires - Pkg name in Fedora/Ubuntu:

• bzip2 (http://bzip.org/) - bzip2-devel/libbz2-dev
• cmake (http://www.cmake.org/) - cmake/cmake
• expat (http://expat.sourceforge.net/) - expat-devel/libexpat1-dev
• file (http://www.darwinsys.com/file/) - file-devel/libmagic-dev
• glib2 (http://developer.gnome.org/glib/) - glib2-devel/libglib2.0-dev
• libcurl (http://curl.haxx.se/libcurl/) - libcurl-devel/libcurl4-openssl-dev
• libxml2 (http://xmlsoft.org/) - libxml2-devel/libxml2-dev
• python (http://python.org/) - python2-devel/libpython2.7-dev
• rpm (http://www.rpm.org/) - rpm-devel/librpm-dev
• openssl (http://www.openssl.org/) - openssl-devel/libssl-dev
• sqlite3 (https://sqlite.org/) - sqlite-devel/libsqlite3-dev
• xz (http://tukaani.org/xz/) - xz-devel/liblzma-dev
• zlib (http://www.zlib.net/) - zlib-devel/zlib1g-dev
• Optional: doxygen (http://doxygen.org/) - doxygen/doxygen
• Test requires: check (http://check.sourceforge.net/) - check-devel/check
• Test requires: python-nose (https://nose.readthedocs.org/) - python-nose/python-nose

From your checkout dir:

mkdir build
cd build/
cmake ..
make

To build the documentation, from the build/ directory: make doc

Note: For build with debugging symbols you could use (from the build/ directory):

cmake -DCMAKE_BUILD_TYPE:STRING=DEBUG .. && make

utils/make_tarball.sh [git revision]

Without git revision specified HEAD is used.

Modify createrepo_c.spec and run:

utils/make_rpm.sh

Note: Current .spec for Fedora rawhide

All unit tests run from librepo checkout dir

make tests && make test

Note: For a verbose output of testing use: make ARGS="-V" test

build/tests/run_gtester.sh

Note: The C tests have to be builded by make tests)!

PYTHONPATH=`readlink -f ./build/src/python/` nosetests -s tests/python/tests/

Bugzilla

In original createrepo sha is a nickname for the sha1 checksum. Createrepo_c mimics this behaviour.

• Repodata in repo/ are has checksum xxx
• Params: --update --checksum=yyy repo/

• All package checksums are recalculated into yyy

• Only new and changed packages has yyy checksums other packages has still xxx checksums

• Some packages in repo/ are symlinks
• Params: --skip-symlinks repo/

• Symlinked packages are ignored

• Symlinked packages are processed (https://bugzilla.redhat.com/show_bug.cgi?id=828848)

• A somebody else's repo is somewhere
• The repo items have set a base path to http://foo.com/
• We want to create metadata for our repo
• Some packages in our repo are same as packages in somebody else's repo
• We want to speed up creation of our repodata with combo --update and --update-md-path=somebody_else's_repo
• Params: --update --update-md-path=ftp://somebody.else/repo our_repo/

• All our packages have no base path set (if we don't set --baseurl explicitly)

• Some packages in metadata (which was same in our repo and in somebody else's repo) have base path set to http://foo.com/
• (https://bugzilla.redhat.com/show_bug.cgi?id=875029)

• A repo with old metadata exists
• We want to update metadata
• Params: --update repo/

• All is fine

• Some paths in filelists.xml are crippled (https://bugzilla.redhat.com/show_bug.cgi?id=835565)

• A repo with repodata created with --simple-md-filenames exists
• We want to update repodata to have checksums in filenames
• Params: --update repo/

• All repodata contains checksum in the name

• All repodata contains checksum in the name
• There are old metadata without checksum in the name too
• (https://bugzilla.redhat.com/show_bug.cgi?id=836917)

Modifyrepo_c is compatible with classical Modifyrepo except some misbehaviour:

• TODO: Report bugs and add reference here

When there is need to do several modification to repository (repomd.xml) a batch file could be used.

Batch file is Modifyrepo_c specific. It is not supported by the classical Modifyrepo - at least not yet.

# Add:
#   [<path/to/file>]
#   <options>

# Metadata that use a bunch of config options
[some/path/comps.xml]
type=group
compress=true
compress-type=gz
unique-md-filenames=true
checksum=sha256
new-name=group.xml

# Metadata that use default settings
[some/path/bar.xml]

# Remove:
#   [<metadata name>]
#   remove=true

[updateinfo]
remove=true

• Lines beginning with a '#' and blank lines are considered comments.
• If remove=true is used, no other config options should be used