Commit Graph

1196 Commits

Author SHA1 Message Date
Lubomír Sedlář
cfda99e6fe Add basic tests for buildinstall phase
The test only checks that commands are created with correct arguments
and that a proper number of threads is started. There is no validation
for what the threads are actually doing.

Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2015-12-03 15:19:12 +01:00
Lubomír Sedlář
b6d9b5632e Fix generating checksum files
This patch modifies how checksums are stored - it uses BSD-style
checksums.

The filename with the checksum can now be customized depending on actual
compose run and metadata. This required adding another option to the
checksumming phase. Documentation is updated and includes example for
creating names used in Fedora.

Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2015-12-03 10:54:09 +01:00
Lubomír Sedlář
539736a11e Use lowercase hashed directories
On case-insensitive filesystems it is not such a good idea to have
directories that only differ in case. Packages should be always split
into lowercased directories.

The test data is modified to include some packages starting with
uppercase letters. The example in code can be verified by running
`nosetests --with-doctest`.

Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2015-12-03 09:08:15 +01:00
Dennis Gilmore
290f8f6540 indentation fixs correcting dvd creation
getting the commands together to run the iso creation process was
incorrectly moved when jigdo creation was made optional, patch fixes
https://pagure.io/pungi/issue/77

Signed-off-by: Dennis Gilmore <dennis@ausil.us>
2015-12-02 13:00:06 -06:00
Dennis Gilmore
e9699b7327 remove glibc32 from the runroot tasks
a workaround has been put in place on os's that need it. dnf errors
when a package is listed that is not available. breaking rawhide
composes.

Signed-off-by: Dennis Gilmore <dennis@ausil.us>
2015-12-02 08:51:18 -06:00
Dennis Gilmore
a2ace9e05c fix up the pungi-fedmesg-notification script name
fix up spec so that the package builds
2015-12-02 08:50:32 -06:00
Lubomír Sedlář
211bd6eef7 Add overview of Pungi to documentation
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2015-12-02 10:28:11 +01:00
Dennis Gilmore
1ab4144dfb fix up the paths to the docs
Signed-off-by: Dennis Gilmore <dennis@ausil.us>
2015-12-01 11:27:24 -06:00
Dennis Gilmore
fd5d3ababb add a script to update the docs repo
Signed-off-by: Dennis Gilmore <dennis@ausil.us>
2015-12-01 11:24:11 -06:00
Lubomír Sedlář
bd8d814230 Move messaging into cli options
The messaging is not really part of compose settings. It is an
infrastructure part. As such, it should really be set up as part of
pungi invocation, not compose configuration.

The documentation is updated to reflect this. Some updates to the
documentation are done as well: listing messages about ISOs and minor
formatting updates.

The test_compose.sh script can now accept additional command line
options and pass them on to pungi-koji to simplify testing.

Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2015-11-27 10:35:08 +01:00
Lubomír Sedlář
ba396ea401 Extend contributing guide
Add information on setting up development environment, running tests and
generating documentation.

Also update .gitignore to list files that will be generated during
testing.

Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2015-11-27 10:27:43 +01:00
Lubomír Sedlář
496563aaef Load multilib configuration from local dir in development
It doesn't have to be installed during development.

Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2015-11-27 10:27:43 +01:00
Lubomír Sedlář
ba8ae15eb1 Allow running scripts with any python in PATH
Instead of hardcoding /usr/bin/python in shebangs, use /usr/bin/env.
This allows Pungi to work with dependencies installed in virtualenv.

Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2015-11-27 08:38:47 +01:00
Dennis Gilmore
6f00f20b3d Merge #68 Add support for sending messages 2015-11-25 14:56:51 +00:00
Lubomír Sedlář
7ce5c76673 Send more messages in createiso phase
When phase starts, a message is sent with list of images that are going
to be built. As each images is finished (or fails), another message
announces that status.

Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2015-11-25 15:46:50 +01:00
Lubomír Sedlář
066855a039 Add ability to send messages about progress
With this patch, Pungi can invoke an arbitrary command on various
moments of the compose process. The invoked command can the decide on
what message to send (and using what messaging system).

The actual command is specified in the config file.

There is a script provided that sends the messages via fedmsg.

The documentation is updated to have details about the new config option
as well as the interface for the messaging script.

Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2015-11-25 15:46:50 +01:00
Lubomír Sedlář
129e654690 Compute checksums in ImageChecksumPhase
The phase goes through all images declared in image manifest, computes
their checksums, stores them in appropriate files and updates the
manifest so that it includes the actual checksums.

The documentation contains details about new configuration options.

The test suite now needs Python's mock package.

Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2015-11-24 09:36:22 +01:00
Lubomír Sedlář
660c8bc2b3 Remove computing checksums from phases
These phases were computing checksums for images:

 * buildinstall
 * createiso
 * image_build
 * live_images
 * product_img

In each phase the checksummed thing would ultimately end-up in image
manifest.

Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2015-11-24 09:36:19 +01:00
Lubomír Sedlář
359eb444e5 Move image checksum collecting to separate phase
The checksums are still generated in the ImageBuild and CreatISO phases,
but collecting of them into single file is moved from pungi-koji script
into a separate phase.

Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2015-11-24 09:36:13 +01:00
Dennis Gilmore
5ff5ffc259 compose.config is in self
Signed-off-by: Dennis Gilmore <dennis@ausil.us>
2015-10-28 21:18:15 -05:00
Daniel Mach
3897671190 Merge #60 fix conditional deps (this can't be easily covered with unit tests; tested on huge package set using various in-place YUM hacks) 2015-09-10 09:38:09 -04:00
Jon Disnard
fd537e5070 Merge #61 make jigdo optional (iii) 2015-09-15 13:39:15 -05:00
Jon Disnard
656b081565 insignificant white space fix
Signed-off-by: Jon Disnard <jdisnard@redhat.com>
2015-09-15 13:39:15 -05:00
Jon Disnard
9798454cb3 Upodate config docs for jigdo
Signed-off-by: Jon Disnard <jdisnard@redhat.com>
2015-09-15 13:37:27 -05:00
Jon Disnard
2114369e9c Default True for configurable jigdo ISOs.
Signed-off-by: Jon Disnard <jdisnard@redhat.com>
2015-09-15 13:23:54 -05:00
Daniel Mach
15811107bb gather: Check if txmbr.isDep is set for conditional deps. 2015-09-10 09:38:09 -04:00
Tomas Mlcoch
5c8694b286 Merge #57 Initialize phases in their usage order 2015-09-09 08:00:21 -04:00
Tomas Mlcoch
ecc6b0f62a Initialize phases in their usage order 2015-09-09 08:00:21 -04:00
Tomas Mlcoch
36fff71059 Merge #56 doc/contributing.rst update 2015-09-09 03:58:30 -04:00
Tomas Mlcoch
4d93221005 Add missing config check for phases: createrepo, extrafiles, liveimages and imate_build 2015-09-10 07:12:08 -04:00
Tomas Mlcoch
1d97ce5ea1 Add live_images option to live_images phase 2015-09-10 07:10:41 -04:00
Tomas Mlcoch
b4fd280d80 Fix expected type of createrepo_checksum config option 2015-09-10 07:09:37 -04:00
Tomas Mlcoch
291c509c2f Doc: Replace fetch & fetch tags & merge combo with pull --rebase
$ git pull --rebase upstream master
will work also when there are commits on master branch - it will
just rebase the changes seamlessly in opposite to git merge.

Moreover by using git pull --rebase we will save two calls of git.
2015-09-09 03:58:30 -04:00
Tomas Mlcoch
3df5a11a89 Fix KojiWrapper initialization in live_images phase 2015-09-09 03:40:30 -04:00
Tomas Mlcoch
02e55b67b3 Remove createiso phase's dependency on pkgset_koji_url config option 2015-09-09 03:40:29 -04:00
Dennis Gilmore
2599a42a14 4.0.3 release
Signed-off-by: Dennis Gilmore <dennis@ausil.us>
2015-09-08 22:06:45 -05:00
Lubos Kocman
fd64bba4dd Merge #54 fix log_info for image_build (fails if image_build is skipped) 2015-09-07 15:41:27 +00:00
Lubos Kocman
3efd29e465 image_build: self.log_info -> self.compose.log_info 2015-09-07 15:41:27 +00:00
Dennis Gilmore
da0405a0f5 Revert "Added params needed for Atomic compose to LoraxWrapper"
This reverts commit 919a4fc619.
2015-09-04 12:12:36 -05:00
Dennis Gilmore
d982cd585f Revert "fix up if/elif in _handle_optional_arg_type"
This reverts commit 1373fe5178.
2015-09-04 12:12:28 -05:00
Jon Disnard
6e773f8676 Disable jigdo by default, saves a lot of time.
Signed-off-by: Jon Disnard <jdisnard@redhat.com>
2015-09-01 17:14:46 -05:00
Lubos Kocman
abb2ff1584 live_images: replace hardcoded path substition with translate_path() call
Signed-off-by: Lubos Kocman <lkocman@redhat.com>
2015-09-01 08:23:42 +00:00
Lubos Kocman
158d1834a6 live_images fix reference from koji to koji_wrapper
Signed-off-by: Lubos Kocman <lkocman@redhat.com>
2015-09-01 08:23:24 +00:00
Lubos Kocman
8e90a2a32a Add image-build support
Signed-off-by: Lubos Kocman <lkocman@redhat.com>
2015-09-01 08:03:34 +00:00
Lubos Kocman
4fb20198db Add translate path support. Useful for passing pungi repos to image-build
Signed-off-by: Lubos Kocman <lkocman@redhat.com>
2015-09-01 08:01:37 +00:00
Lubos Kocman
449b4e4c87 import duplicate import of errno from buildinstall
Signed-off-by: Lubos Kocman <lkocman@redhat.com>
2015-08-31 22:51:22 -05:00
Lubos Kocman
831352b2ea handle openning missing images.json (image-less compose re-run)
Signed-off-by: Lubos Kocman <lkocman@redhat.com>
2015-08-31 22:51:22 -05:00
Lubos Kocman
0e18ffcf31 compose: Add compose_label_major_version(). 2015-08-25 08:20:52 -04:00
Pavol Babincak
853c27d1be pungi-koji: Don't print traceback if error occurred.
If compose directory was created and logger setup properly traceback is
written in traceback.log. Otherwise traceback is printed on stdout.
2015-08-25 08:11:14 -04:00
Tomas Kopecek
9235844529 More detailed message for unsigned rpms. 2015-08-25 08:07:05 -04:00