Getting Started¶
This tutorial will guide you through setting up your first project using dh-virtualenv. Having some knowledge on how Debian packages work might help, but it is not a mandatory requirement when working on simple projects.
You also need some basic build tools, so you should install these packages:
sudo apt-get install build-essential debhelper devscripts equivs
These are only required on the build host, not the target hosts you later install the built packages on.
If you perform your package builds in a Docker container,
you can also skip installing these tools, because then only docker-ce
is needed.
Step 1: Install dh-virtualenv¶
Overview
In order to use it, you need to install dh-virtualenv as a debhelper add-on on the build host. For Debian and Ubuntu, there are pre-built packages for the 1.0 version available – note that some of this info might get outdated over time, so take extra care to check the version numbers you’re actually getting vs. what features you need.
The following paragraphs describe the various installation options, including building from source when your specific environment provides no packages or only older versions.
Using pre-1.1 versions is possible, but you don’t get all features described in this document, and not all projects using dh-virtualenv might work with older versions (check their documentation).
Package installation from OS repositories
On Debian Stretch (stable) it is a simple apt install dh-virtualenv
to get v1.0 installed.
To install on Jessie (oldstable) from their package repositories, use these commands:
echo "deb http://ftp.debian.org/debian jessie-backports main" \
| sudo tee /etc/apt/sources.list.d/jessie-backports.list >/dev/null
sudo apt-get update -qq
sudo apt-get install -t jessie-backports dh-virtualenv
Note that jessie-backports
also only offers the 1.0 version.
Another option to check out for Ubuntu is this PPA, maintained by the author.
It is also possible to get newer versions from Debian testing (sid)
or recent releases in the official Ubuntu repositories.
Since dh-virtualenv has the all
architecture (contains no native code),
that is generally possible, but you might need to take extra care of dependencies.
The recommendation is to only follow that route in Docker container builds,
where manipulating dependencies has no lasting effect
– don’t do that on your workstation.
Build your own package
For all other platforms you have to build and install the tool yourself.
The easiest way (since v1.1) is to build the package using Docker
with the invoke bdist_deb
command in a boot-strapped working directory,
see the README for details on that.
Using Docker also allows cross-distribution builds.
Otherwise, after you have cloned the repository, you must install build tools and dependencies on your worksatation, and then start the build:
# Install needed packages
sudo apt-get install devscripts python-virtualenv python-sphinx \
python-sphinx-rtd-theme git equivs
# Clone git repository
git clone https://github.com/spotify/dh-virtualenv.git
# Change into working directory
cd dh-virtualenv
# This will install build dependencies
sudo mk-build-deps -ri
# Build the *dh-virtualenv* package
dpkg-buildpackage -us -uc -b
# And finally, install it (you might have to solve some
# dependencies when doing this)
sudo dpkg -i ../dh-virtualenv_<version>.deb
Step 2: Set up packaging for your project¶
Grab your favourite Python project you want to use dh-virtualenv
with and set it up. Only requirement is that your project has a
somewhat sane setup.py
and requirements listed in a
requirements.txt
file. Note however that defining any requirements
is not mandatory, if you have none.
Instead of following all the steps outlined below,
you can use cookiecutters (project templates) to quickly create the needed information
in the debian/
directory for any existing project.
- dh-virtualenv-mold is a cookiecutter template to add easy Debianization to any existing Python project.
- debianized-pypi-mold does the same for 3rd party software released to PyPI which you want to package for deployment.
See the related READMEs for details.
For the manual way,
start with defining the Debian packaging metadata for your software.
To do this, create a directory called debian
in the project root.
To be able to build a debian package, a few files are needed. First, we need to define the compatibility level of the project. For this, do:
echo "9" > debian/compat
The 9 is a magic number for latest compatibility level, but we don’t
need to worry about that. Next we need a file that tells what our
project is about, a file called control
.
Create a debian/control
file similar to the following:
Source: my-awesome-python-software
Section: python
Priority: extra
Maintainer: Matt Maintainer <matt@example.com>
Build-Depends: debhelper (>= 9), python, dh-virtualenv (>= 0.8)
Standards-Version: 3.9.5
Package: my-awesome-python-software
Architecture: any
Pre-Depends: dpkg (>= 1.16.1), python2.7 | python2.6, ${misc:Pre-Depends}
Depends: ${misc:Depends}
Description: A short summary of what this is.
Further indented lines can contain extra information.
.
A single dot separates paragraphs.
The control
file is used to define the build dependencies, so if you
are building a package that requires for example lxml
, make sure
you define libxml2-dev
in Build-Depends.
Depends in the 2nd section is used to define run-time dependencies.
The debhelper magic will usually take care of that via the ${misc:Depends}
you see above.
To help keeping your installed virtualenv in sync with the host’s Python
interpreter in case of updates, create a file named
debian/«pkgname».triggers
, where «pkgname»
is what you
named your package in the control
file. It triggers a special script
whenever the Python binary changes; don’t worry, that script is provided
by dh-virtualenv
automatically.
«pkgname».triggers
# Register interest in Python interpreter changes (Python 2 for now); and
# don't make the Python package dependent on the virtualenv package
# processing (noawait)
interest-noawait /usr/bin/python2.6
interest-noawait /usr/bin/python2.7
# Also provide a symbolic trigger for all dh-virtualenv packages
interest dh-virtualenv-interpreter-update
That file must end with a new-line – if your editor is misconfigured to eat the end of the last line in a file, you better fix that.
Note that if you provide a custom postinst
script with your package,
then don’t forget to put the #DEBHELPER#
marker into it, else the trigger
script will be missing.
The same applies to other maintainer scripts.
Next, we need a changelog file. It is basically a documentation of
changes in your package plus the source for version number for Debian
package builder. Here’s a short sample changelog to be entered in
debian/changelog
:
my-awesome-python-software (0.1-1) unstable; urgency=low
* Initial public release
-- Matt Maintainer <matt@example.com> Fri, 01 Nov 2013 17:00:00 +0200
You don’t need to create this file by hand, a handy tool called
dch
exists for entering new changelog entries.
Now, the last bit left is adding the debian/rules
file. This file
is usually an executable Makefile that Debian uses to build the package.
The content for that is fairly simple:
#!/usr/bin/make -f
%:
dh $@ --with python-virtualenv
And there we go, debianization of your new package is ready!
Tip
Do not forget to git add
the debian/
directory before
you build for the first time, because generated files will be added there
that you don’t want in your source code repository.
Step 3: Build your project¶
Now you can just build your project by running
( deactivate ; dpkg-buildpackage -us -uc -b )
.
Enjoy your newly baked dh-virtualenv backed project! ☺