GettingStarted

Differences between revisions 20 and 21
Revision 20 as of 2010-06-23 17:47:04
Size: 9970
Editor: CPE001e6b233d5b-CM001e6b233d5a
Comment: Source package name is no longer user-entered.
Revision 21 as of 2010-07-05 12:43:29
Size: 6773
Editor: i59F7688D
Comment:
Deletions are marked like this. Additions are marked like this.
Line 35: Line 35:
== Writing it ==
The start of the file always looks similar to {{{
== Writing a basic recipe ==
With daily build recipes you have a number of options to get the source in place so it can be built.

 * ''build from trunk as is'', if you need to have the `debian/` directory with the packaging in trunk
 * ''use trunk and merge another branch'', if you don't have the packaging in trunk but in another branch that can be merged in
 * ''use trunk and nest another branch'', if you want to use a separate branch and put it into trunk in a specific location

The third alternative is one that is going to work in the most cases, which is why we'll highlight it here.

'''If you need anything more sophisticated or extensive documentation on all your options, please review our [[DailyBuilds/Recipes|recipe documentation]].'''

=== Simple Example ===

In this example we will use trunk which does not contain any packaging and nest a separate branch that contains JUST the packaging (`./debian/` directory).

{{{
Line 38: Line 52:
}}}

The `# bzr-builder format 0.2` is the same for each, and just specifies the version of the format in use. The current format is `0.2`, and is increased as the format changes.

`deb-version 1.0+{time}` specifies the version to use for the generated package. `{time}` here is a substitution variable, more information on those will be given later.

The next line specifies the branch to base the package on: {{{
lp:bzr
}}}

This says that we will use the trunk of the `bzr` project.

Then there is any number of other lines to specify other branches to include. The usual way to do this is to use the `merge` keyword to specify a simple merge of the branch. {{{
merge fix-build lp:~bzr/bzr/fix-build
}}}

`fix-build` is the id of the branch within this file, it doesn't have to be the same as any part of the branch URL, but it has to be unique within the file. `lp:~bzr/bzr/fix-build` is again the location of the branch. What we are doing here is merging in a branch that we know we need in order to fix the build, but that hasn't landed
in `lp:bzr` yet.

The other way to include code is to use the `nest` keyword. {{{
nest pyfoo lp:pyfoo foo
}}}

The `nest` keyword will get the contents of one branch put inside another branch, instead of merging it. In this case we are nesting `lp:pyfoo` in to `lp:bzr`. We are using `pyfoo` to refer to it in the file, and we want it nested in the `foo` directory, so we specify that last.

It is possible to act on the nested branch in the same way as with the main branch. Any lines that are indented by two spaces under a `nest` line will act on the nested branch, e.g. {{{
  merge branding lp:~bob/pyfoo/ubuntu-branding
}}}

would merge the `ubuntu-branding` branch in to `foo`.

The resulting branch needs to already have the `debian` directory in place with the packaging in it, as it can't be auto-generated. Therefore you will often need to merge one or more packaging branches: {{{
merge packaging lp:~bzr/bzr/packaging
}}}

In total this recipe would look like {{{
# bzr-builder format 0.2 deb-version 1.0+{time}
lp:bzr
merge fix-build lp:~bzr/bzr/fix-build
nest pyfoo lp:pyfoo foo
  merge branding lp:~bob/pyfoo/ubuntu-branding
merge packaging lp:~bzr/bzr/packaging
}}}

=== Specifying revisions ===

Sometimes you want to specify a specific revision of a branch to use, rather than the tip. You can do this by including a revision specifier at the end of any branch line, e.g. {{{
merge packaging lp:~bzr/bzr/packaging revno:2355
}}}

or, for the first branch line {{{
lp:bzr tag:1.0
}}}

would mean that every time the recipe was used it would use the "1.0" tag from that branch.

=== Version numbers ===

The `deb-version` specifier allow you to specify a version number for the resulting package, but it's not very useful if it is only ever a single version number, as you need it to increase.

The example above (`1.0+{time}`), use a substitution variable. This will be replaced when the version number is needed with the current date and time (UTC). This will ensure that later packages get higher version numbers.

There is a second variable that you can use as well: `{revno}`. This will be replaced with the revision number of the revision that was used from the primary branch. You can use the revision number of any branch by using `{revno:<branch id>}`.

You can use as many substitution variables as you like, e.g. {{{
  deb-version 1.0+{revno}-0ubuntu0+{revno:packaging}+{time}
}}}

Which would expand to something like {{{
  deb-version 1.0+4264-0ubuntu0+2145+200907201627
}}}

 * `{time}` will be substituted with the current date and time, such as 200908191512.
 * `{revno}` will be the revno of the base branch (the first specified).
 * `{revno:<branch name>}` will be substituted with the revno for the branch named <branch name> in the recipe.
 * `{debupstream}` will be replaced by the upstream portion of the versionnumber taken from `debian/changelog` in the final tree. If when the tree is built the top of `debian/changelog` has a version number of "1.0-1" then this would evaluate to "1.0".
lp:foo
nest foopackaging lp:~hacker/+junk/packaging debian}}}

This is still in beta phase and only available on edge.launchpad.net (beta testing). If you run into bugs, talk to the people in #launchpad on irc.freenode.net. (Known limitations)


Overview

Here's the quick run-down of what you need to do, to set up your daily builds.

  • Have source code in launchpad (either use code.launchpad.net or have source import)
  • Select branch used for daily build
  • Write recipe
  • Test build locally
  • trigger builds via launchpadlib

Prerequisites

Code in Launchpad

Launchpad's Daily Builds only works on code that exists in Launchpad. Either you make use of Launchpad Code yourself (easier), or you set up Launchpad to import code from somewhere else.

Packaging

Somebody needs to have packaged your software before. If your software for example is in Ubuntu or Debian, you are sorted out. If there's another branch in Launchpad, that contains packaging for your software, you are sorted out. With the "recipe" (more on the topic below), you can sort-of-merge the packaging into your daily branch.

If nobody ever attemped to package your software for Debian or Ubuntu, you might want to have a look at PackagingGuide/PackagingOverview to get your initial packaging set up.

Make sure that the build process in your packaging can deal with what's in your branch. For example, if you work on a C project with autotools, you might have to run autoreconf -i at some stage during the build to make sure that all the auto-generated files (which are not in version control) are present.

Recipe

"recipes" are descriptions of the steps needed to construct a package from the various bzr branches. It relies on a certain format that specifies

  • where to use the code from (trunk branch, beta branch, etc.), where to get the packaging from (separate branch? ubuntu branch?)
  • the correct package version (so users will still be able to upgrade to the stable version of the distro once it gets released)
  • what to modify to make the source build properly

In this first step, just write it in a text editor. Later on, you'll test it locally, then enable it in Launchpad.

Writing a basic recipe

With daily build recipes you have a number of options to get the source in place so it can be built.

  • build from trunk as is, if you need to have the debian/ directory with the packaging in trunk

  • use trunk and merge another branch, if you don't have the packaging in trunk but in another branch that can be merged in

  • use trunk and nest another branch, if you want to use a separate branch and put it into trunk in a specific location

The third alternative is one that is going to work in the most cases, which is why we'll highlight it here.

If you need anything more sophisticated or extensive documentation on all your options, please review our recipe documentation.

Simple Example

In this example we will use trunk which does not contain any packaging and nest a separate branch that contains JUST the packaging (./debian/ directory).

# bzr-builder format 0.2 deb-version 1.0+{time}
lp:foo
nest foopackaging lp:~hacker/+junk/packaging debian

Testing locally

Testing the recipe

It's very important to test your recipe locally, else your build might fail in Launchpad over and over again without you noticing. Also might the package versioning be broken. Make sure you test locally first!

Save your recipe file to <project>.recipe.

  • If you run Windows or Mac, check out how to run Ubuntu in a virtual machine for the test.

  • If you want to test on a specific version, check out this documentation for how to do that in a safe and sane manner.

Once you're happy with the specific Ubuntu version you want to test this in, please install

In order to build the recipe you need to use the bzr dailydeb command.

$ bzr dailydeb package.recipe working-dir

This will perform the steps specified in <project>.recipe. It will create working-dir and put the resulting source tree and the source package there.

Testing the build

Now we have a source package. Now let's test the build process.

First we set up pbuilder, a tool that sets up a clean, minimal environment for the build, so we can be sure it builds everywhere.

  1. sudo apt-get install pbuilder

  2. edit ~/.pbuilderrc and add

    COMPONENTS="main universe multiverse restricted"
  3. sudo pbuilder create

To kick off the test-build, run

sudo pbuilder build <working-dir>/<project>_<version>.dsc

If the build succeeds, you can test-install the resulting package from /var/cache/pbuilder/result/.

Setting up the recipe in Launchpad

Now that you confirmed the recipe to work, the rest is very simple.

create-recipe.png

Browse to the branch you want to build in Launchpad. Click on "(+) Create packaging recipe".

Now fill in all the necessary details:

  • Name: simple name of the recipe. Remember: you might want more than one.

  • Description: please make it clear what users of this build sign up for.

  • Owner: select who drives these builds.

  • Default Distribution Series: select all the Ubuntu releases you want to build the package for. Make sure all these builds work before you sign up for them!

  • Recipe text: paste your recipe in here.

Building

Via Launchpad API

To trigger builds regularly, you can use this simple launchpadlib snippet:

Toggle line numbers
   1 person = launchpad.people["person-who-owns-the-recipe"]
   2 recipe = person.getRecipe(name="name-of-the-recipe")
   3 ubuntu = launchpad.distributions["ubuntu"]
   4 ppa    = person.getPPAByName("name-of-ppa")
   5 for series in ubuntu.current_series:
   6     recipe.requestBuild(archive=ppa, distroseries=series, pocket="Release")

Via Web UI

Also, you can use Launchpad's Web UI.

request-build.png

DailyBuilds/GettingStarted (last edited 2010-07-13 14:05:16 by i59F717E4)