x/anvil

Joshua Harlow 86bf535a0a Adjust multipip usage.

Use json as the output format and only use stderr for
when the multipip program really fails.

Instead of outputting to the screen all incompatible errors
just output the incompatible versions to the output json
data structure and use this in the main anvil program.

Use defaultdict + list in multipip where appropriate.

Ensure that as documented we select the first matching requirement
that comes out of multipip instead of the last (when incompat. matches
happen).

Adjust documentation for new json output format.

Change-Id: I6403182066ef01cb3f7f26c305ab5577a00043ae

2013-06-05 10:36:34 -07:00

3.1 KiB

Raw Blame History

Anvil utility toolbelt

multipip

pip utility refuses to handle multiple requirements for one package:

$ pip install 'nose>=1.2' 'nose>=2' 'nose<4'
Double requirement given: nose>=2 (already in nose>=1.2, name='nose')

Use multipip to join these requirements:

$ multipip 'nose>=1.2' 'nose>=2' 'nose<4'
{"compatibles": ["nose>=2,<4"], "incompatibles": {}}

Files of requirements can be used as well:

$ cat pip-requires 
nose<4
$ multipip 'nose>=1.2' 'nose>=2' -r pip-requires 
{"compatibles": ["nose>=2,<4"], "incompatibles": {}}

multipip prints error messages for badly formated requirements and exits early and for incompatible requirements provides you which package was incompatible and which versions were found to be problematic:

$ cat pip-requires 
pip==1.3
$ multipip 'pip==1.2' -r pip-requires 
{"compatibles": [], "incompatibles": {"pip": ["pip==1.2", "pip==1.3"]}}

It is possible to filter some packages from printed output. This can be useful for a huge pip-requires file:

$ cat pip-requires 
nose<4
pip==1.2
nose>=1.2
$ multipip -r pip-requires --ignore-packages nose
{"compatibles": ["pip==1.2"], "incompatibles": {}}

Installed packages can be filtered, too (they are taken from pip freeze):

$ cat pip-requires 
nose<4
pip==1.2
nose>=1.2
$ pip freeze | grep nose
nose==1.1.2
$ multipip -r pip-requires --ignore-installed
{"compatibles": ["pip==1.2"], "incompatibles": {}}

py2rpm

Distutils provides an interface for building RPMs:

$ python ./setup.py bdist_rpm

This tool has several problems:

Red Hat based distros use different package names, e.g., python-setuptools instead of distribute, python-nose instead of nose and so on...
Requires and Conflicts sections for generated RPM are incorrect.
Sometimes not all required files are packaged.
Miscellaneous problems with man files;
Package directory in /usr/lib*/python*/site-packages/<pkg> is not owned by any RPM;
Some packages (like selenium) are architecture dependent but bdist_rpm generates BuildArch: noarch for them.

py2rpm is aimed to solve all these problems.

py2rpm accepts a list of archive names or package directories and builds RPMs (current directory is used by default):

$ py2rpm
...
Wrote: /home/guest/rpmbuild/SRPMS/python-multipip-0.1-1.src.rpm
Wrote: /home/guest/rpmbuild/RPMS/noarch/python-multipip-0.1-1.noarch.rpm
...

build-install-node-from-source.sh

Helps build latest node.js from source into rpms.

clean-pip

This utility removes package installed by pip but not by rpm.

clear-dns.sh

Removes leftover nova dnsmasq processes frequently left behind.

img-uploader

Helper tool to upload images to glance using your anvil settings.

validate-yaml

Validates yaml is formatted correctly.

yaml-pretty

Pretty prints yaml into a standard format.

resize.sh

Resizes a images filesystem using guestfish.

euca.sh

Creates ec2 keys for usage with nova.

3.1 KiB Raw Blame History