d4f8e32a80
Fix handling globs in input packages
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:49 +01:00
a9415eb0e5
Simplify add_multilib_package method
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:49 +01:00
cd80d6ef5a
Stop caching provides of added packages
...
This only works in non-greedy mode. When greedy, the same provides can
be linked to multiple packages that should be pulled in.
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:49 +01:00
7343daba24
Clean up logging excluded packages
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:49 +01:00
e06e9165fc
Add checking of flags for dnf depsolving
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:49 +01:00
8cc912c5aa
Install new executable
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:49 +01:00
ec67eac1cc
Use enum for flags
...
This adds an extra dependency on python-enum34.
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:49 +01:00
d5e6639a6d
Reduce duplication in code
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:49 +01:00
9fd8e6319f
Handle fulltree_excludes list
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:49 +01:00
9a1674f3bf
Improve error message for non-matching patterns
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:48 +01:00
b53e4a84d3
Fix fulltree when greedy
...
When greedy, fulltree should pull in all native and multilib packages.
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:48 +01:00
3a6653fbc2
Clean up main loop
...
Greatly reduce duplication by moving common code into a method.
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:48 +01:00
0a44b2fd07
Filter source packages
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:48 +01:00
5ef630d6d4
Simplify code
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:48 +01:00
99699b85aa
Use same tests for yum and dnf depsolving
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:48 +01:00
a155674269
Set persistdir to a temporary location
...
We don't want to even touch any system directory.
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:48 +01:00
9b2f0349de
Define dnf_gather option in schema
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:48 +01:00
e753891e27
Remove FSF address from copyright headers
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:48 +01:00
b9fd755a05
Add only one handler to logger
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:48 +01:00
4f4fd845d9
Fix PEP8 complaints
...
* Remove dead imports
* Remove dead code
* Fix extra empty lines
* Fix formatting
* Break too long lines
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:48 +01:00
fdda8fe491
Fix multilib blacklist/whitelist when no multilib_method is set.
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:48 +01:00
22a6291c8a
Remove hardcoded blacklists and whitelists from multilib_dnf.
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:48 +01:00
26cac77639
Add default logging handler to gather_dnf.
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:47 +01:00
94d16d8c32
Rewrite gathering to use new hawkey code that's part of libhif.
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:47 +01:00
dfef1837ea
gather_dnf: don't add srpm deps if --nodeps is set
...
Signed-off-by: Lubos Kocman <lkocman@redhat.com>
2017-03-24 09:24:47 +01:00
14784847d4
add dnf_arch wrapper to workaround dnf.arch.basearch -> dnf.rpm.basearch change
...
Signed-off-by: Lubos Kocman <lkocman@redhat.com>
2017-03-24 09:24:47 +01:00
1a8f0bb0f9
gather_dnf.py: use self.logger for printing output
...
Signed-off-by: Lubos Kocman <lkocman@redhat.com>
2017-03-24 09:24:47 +01:00
320d2a8ae2
Boost add_initial_packages() by using query cache for 'build' greedy method.
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:47 +01:00
c02d801988
Boost prepopulate by using query cache.
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:47 +01:00
321d471125
Additional profiling in Gather.add_initial_packages().
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:47 +01:00
5a2c4f5e0f
Improve working with query cache.
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:47 +01:00
06635a3917
Add profiler to pungi-gather.
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:47 +01:00
61e76d5824
Improve depsolving speed by pre-computing provides query.
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:47 +01:00
026e49e259
speedup filter(sourcerpm=XXX)
...
originally 6519 calls 18, i.e. 2% out of 15 mins
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:47 +01:00
835460ce8f
speedup filter(name=XXX, version=YYY, release=ZZZ)
...
originally 3109 calls 54s, i.e. 6% out of 15 mins
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:47 +01:00
110fe7647c
speedup filter(pkg=XXX, arch__neq=WWW)
...
originally 17976 calls 157s, i.e. 17% out of 15 mins
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:46 +01:00
ec56ee75e2
speedup filter(name=XXX, version=YYY, release=ZZZ, arch__neq=WWW)
...
the second most demanding filter
it is called 8297 times and gets 189s out of 15min run which is 21%
spent here
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:46 +01:00
d8fcaf95f7
speedup filter(sourcerpm=XXX, arch__neq=YYY)
...
this is most demanding filter
it is called 10826 times and gets 210.277010s out of 15min run which is
23% spent here
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:46 +01:00
36f57b26b8
Add scripts to compare YUM and DNF gathering
...
There are scripts to re-run depsolving with any backend based on config
and log file.
There is a new script to compare logs from two runs and report
differences. This script will be installed system wide in final RPM.
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:24:46 +01:00
99b68ca96b
Simplify ks group handling.
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:12:23 +01:00
7cb9e9dc20
Add support for mirrorlists in DNF gathering code.
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:12:23 +01:00
ddba26edd7
Don't run fulltree on packages added via fulltree.
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:12:23 +01:00
a5d302d036
Enable --fulltree, --selfhosting and --nodeps in pungi-gather.
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:12:23 +01:00
aff6ac906c
Enable langpack gathering in DNF gather.
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:12:23 +01:00
43d8d02cb1
Integrate DNF gathering code with Pungi.
...
Set 'dnf_gather = True' (temporary option) in config file to enable DNF
gathering.
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 09:12:23 +01:00
9764acbc4d
Cache pkg.sourcerpm to get additional >5% boost.
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 08:51:38 +01:00
13ed3f2b1d
Performance improvements of DNF gathering.
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 08:51:38 +01:00
caf11f55d4
New gathering (depsolving) module based on DNF.
...
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-24 08:51:38 +01:00
9fcd71f831
Add support for modular composes
...
Signed-off-by: Jan Kaluza <jkaluza@redhat.com>
2017-03-22 15:55:52 +01:00
4b90822115
Add a script for modifying ISO images
...
With this script it's possible to add additional files into an ISO file.
If the file happens to be ks.cfg, the boot configs are tweaked so that
the kickstart is actually used.
Resolves : #503
Signed-off-by: Lubomír Sedlář <lsedlar@redhat.com>
2017-03-21 07:55:19 +01:00
Lubomír Sedlář
Daniel Mach
Lubos Kocman
Michael Mraka
Jan Kaluza