Commit Graph

902 Commits

Author SHA1 Message Date
Ralph Bean 95761c69e1 Update fedmsg notification hook to use appropriate config.
Signed-off-by: Ralph Bean <rbean@redhat.com>
2015-12-08 12:30:16 -05:00
Dennis Gilmore 4b374278e4 we need to ensure that we send all the tasks to koji on the correct arch
Signed-off-by: Dennis Gilmore <dennis@ausil.us>
2015-12-08 09:04:32 -06:00
Lubomír Sedlář 4a96e8e313 Run lorax in separate dirs for each variant
Lorax fails when run on an existing non-empty directory. This patch runs
it in separate subdirectiories base on variant. Running with
buildinstall should not be changed at all.

Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2015-12-07 09:45:33 +01:00
Dennis Gilmore bdb1bcb35c Merge #84 `Allow specifying --installpkgs for lorax` 2015-12-04 19:41:28 +00:00
Dennis Gilmore 4a26b99a24 Merge #83 `Fix recently discovered bugs` 2015-12-04 19:39:49 +00:00
Dennis Gilmore 31fe85038b Merge #82 `indentation fixs correcting dvd creation` 2015-12-04 19:39:05 +00:00
Dennis Gilmore 77aca8a00a Merge #69 `Move messaging into cli options and simplify it` 2015-12-04 19:38:07 +00:00
Lubomír Sedlář cdec198b6d Start lorax for each variant separately
The buildinstall phase now starts lorax for each variant separately.
Running with buildinstall should not be affected in any way.

Only variants of type=variant are considered. The side-effect of this is
that if an architecture is only used by variants of other types, lorax
will not be called at all.

Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2015-12-03 15:19:12 +01:00
Lubomír Sedlář 94f519d01c Update lorax wrapper to use --installpkgs
The lorax wrapper class now understands the --installpkgs argument and
can use it to pass multiple package names to the command.

There is a simple test to make sure the commands includes all specified
options. A bug is fixed where the bug URL would not be correctly
included.

Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2015-12-03 15:19:12 +01:00
Lubomír Sedlář 791448cc32 Allow specifying which packages to install in variants xml
This patch updates the variants DTD and parsing to allow specifying
multiple build install packages for each variant.

Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2015-12-03 15:19:12 +01:00
Lubomír Sedlář cfda99e6fe Add basic tests for buildinstall phase
The test only checks that commands are created with correct arguments
and that a proper number of threads is started. There is no validation
for what the threads are actually doing.

Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2015-12-03 15:19:12 +01:00
Lubomír Sedlář b6d9b5632e Fix generating checksum files
This patch modifies how checksums are stored - it uses BSD-style
checksums.

The filename with the checksum can now be customized depending on actual
compose run and metadata. This required adding another option to the
checksumming phase. Documentation is updated and includes example for
creating names used in Fedora.

Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2015-12-03 10:54:09 +01:00
Lubomír Sedlář 539736a11e Use lowercase hashed directories
On case-insensitive filesystems it is not such a good idea to have
directories that only differ in case. Packages should be always split
into lowercased directories.

The test data is modified to include some packages starting with
uppercase letters. The example in code can be verified by running
`nosetests --with-doctest`.

Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2015-12-03 09:08:15 +01:00
Dennis Gilmore 290f8f6540 indentation fixs correcting dvd creation
getting the commands together to run the iso creation process was
incorrectly moved when jigdo creation was made optional, patch fixes
https://pagure.io/pungi/issue/77

Signed-off-by: Dennis Gilmore <dennis@ausil.us>
2015-12-02 13:00:06 -06:00
Dennis Gilmore e9699b7327 remove glibc32 from the runroot tasks
a workaround has been put in place on os's that need it. dnf errors
when a package is listed that is not available. breaking rawhide
composes.

Signed-off-by: Dennis Gilmore <dennis@ausil.us>
2015-12-02 08:51:18 -06:00
Dennis Gilmore a2ace9e05c fix up the pungi-fedmesg-notification script name
fix up spec so that the package builds
2015-12-02 08:50:32 -06:00
Dennis Gilmore 1ab4144dfb fix up the paths to the docs
Signed-off-by: Dennis Gilmore <dennis@ausil.us>
2015-12-01 11:27:24 -06:00
Dennis Gilmore fd5d3ababb add a script to update the docs repo
Signed-off-by: Dennis Gilmore <dennis@ausil.us>
2015-12-01 11:24:11 -06:00
Lubomír Sedlář bd8d814230 Move messaging into cli options
The messaging is not really part of compose settings. It is an
infrastructure part. As such, it should really be set up as part of
pungi invocation, not compose configuration.

The documentation is updated to reflect this. Some updates to the
documentation are done as well: listing messages about ISOs and minor
formatting updates.

The test_compose.sh script can now accept additional command line
options and pass them on to pungi-koji to simplify testing.

Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2015-11-27 10:35:08 +01:00
Dennis Gilmore 6f00f20b3d Merge #68 `Add support for sending messages` 2015-11-25 14:56:51 +00:00
Lubomír Sedlář 7ce5c76673 Send more messages in createiso phase
When phase starts, a message is sent with list of images that are going
to be built. As each images is finished (or fails), another message
announces that status.

Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2015-11-25 15:46:50 +01:00
Lubomír Sedlář 066855a039 Add ability to send messages about progress
With this patch, Pungi can invoke an arbitrary command on various
moments of the compose process. The invoked command can the decide on
what message to send (and using what messaging system).

The actual command is specified in the config file.

There is a script provided that sends the messages via fedmsg.

The documentation is updated to have details about the new config option
as well as the interface for the messaging script.

Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2015-11-25 15:46:50 +01:00
Lubomír Sedlář 129e654690 Compute checksums in ImageChecksumPhase
The phase goes through all images declared in image manifest, computes
their checksums, stores them in appropriate files and updates the
manifest so that it includes the actual checksums.

The documentation contains details about new configuration options.

The test suite now needs Python's mock package.

Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2015-11-24 09:36:22 +01:00
Lubomír Sedlář 660c8bc2b3 Remove computing checksums from phases
These phases were computing checksums for images:

 * buildinstall
 * createiso
 * image_build
 * live_images
 * product_img

In each phase the checksummed thing would ultimately end-up in image
manifest.

Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2015-11-24 09:36:19 +01:00
Lubomír Sedlář 359eb444e5 Move image checksum collecting to separate phase
The checksums are still generated in the ImageBuild and CreatISO phases,
but collecting of them into single file is moved from pungi-koji script
into a separate phase.

Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2015-11-24 09:36:13 +01:00
Dennis Gilmore 5ff5ffc259 compose.config is in self
Signed-off-by: Dennis Gilmore <dennis@ausil.us>
2015-10-28 21:18:15 -05:00
Daniel Mach 3897671190 Merge #60 `fix conditional deps (this can't be easily covered with unit tests; tested on huge package set using various in-place YUM hacks)` 2015-09-10 09:38:09 -04:00
Jon Disnard fd537e5070 Merge #61 `make jigdo optional (iii)` 2015-09-15 13:39:15 -05:00
Jon Disnard 656b081565 insignificant white space fix
Signed-off-by: Jon Disnard <jdisnard@redhat.com>
2015-09-15 13:39:15 -05:00
Jon Disnard 9798454cb3 Upodate config docs for jigdo
Signed-off-by: Jon Disnard <jdisnard@redhat.com>
2015-09-15 13:37:27 -05:00
Jon Disnard 2114369e9c Default True for configurable jigdo ISOs.
Signed-off-by: Jon Disnard <jdisnard@redhat.com>
2015-09-15 13:23:54 -05:00
Daniel Mach 15811107bb gather: Check if txmbr.isDep is set for conditional deps. 2015-09-10 09:38:09 -04:00
Tomas Mlcoch 5c8694b286 Merge #57 `Initialize phases in their usage order` 2015-09-09 08:00:21 -04:00
Tomas Mlcoch ecc6b0f62a Initialize phases in their usage order 2015-09-09 08:00:21 -04:00
Tomas Mlcoch 36fff71059 Merge #56 `doc/contributing.rst update` 2015-09-09 03:58:30 -04:00
Tomas Mlcoch 4d93221005 Add missing config check for phases: createrepo, extrafiles, liveimages and imate_build 2015-09-10 07:12:08 -04:00
Tomas Mlcoch 1d97ce5ea1 Add live_images option to live_images phase 2015-09-10 07:10:41 -04:00
Tomas Mlcoch b4fd280d80 Fix expected type of createrepo_checksum config option 2015-09-10 07:09:37 -04:00
Tomas Mlcoch 291c509c2f Doc: Replace fetch & fetch tags & merge combo with pull --rebase
$ git pull --rebase upstream master
will work also when there are commits on master branch - it will
just rebase the changes seamlessly in opposite to git merge.

Moreover by using git pull --rebase we will save two calls of git.
2015-09-09 03:58:30 -04:00
Tomas Mlcoch 3df5a11a89 Fix KojiWrapper initialization in live_images phase 2015-09-09 03:40:30 -04:00
Tomas Mlcoch 02e55b67b3 Remove createiso phase's dependency on pkgset_koji_url config option 2015-09-09 03:40:29 -04:00
Dennis Gilmore 2599a42a14 4.0.3 release
Signed-off-by: Dennis Gilmore <dennis@ausil.us>
2015-09-08 22:06:45 -05:00
Lubos Kocman fd64bba4dd Merge #54 `fix log_info for image_build (fails if image_build is skipped)` 2015-09-07 15:41:27 +00:00
Lubos Kocman 3efd29e465 image_build: self.log_info -> self.compose.log_info 2015-09-07 15:41:27 +00:00
Dennis Gilmore da0405a0f5 Revert "Added params needed for Atomic compose to LoraxWrapper"
This reverts commit 919a4fc619.
2015-09-04 12:12:36 -05:00
Dennis Gilmore d982cd585f Revert "fix up if/elif in _handle_optional_arg_type"
This reverts commit 1373fe5178.
2015-09-04 12:12:28 -05:00
Jon Disnard 6e773f8676 Disable jigdo by default, saves a lot of time.
Signed-off-by: Jon Disnard <jdisnard@redhat.com>
2015-09-01 17:14:46 -05:00
Lubos Kocman abb2ff1584 live_images: replace hardcoded path substition with translate_path() call
Signed-off-by: Lubos Kocman <lkocman@redhat.com>
2015-09-01 08:23:42 +00:00
Lubos Kocman 158d1834a6 live_images fix reference from koji to koji_wrapper
Signed-off-by: Lubos Kocman <lkocman@redhat.com>
2015-09-01 08:23:24 +00:00
Lubos Kocman 8e90a2a32a Add image-build support
Signed-off-by: Lubos Kocman <lkocman@redhat.com>
2015-09-01 08:03:34 +00:00