pungi/pungi
JamesKunstle 3349585d78 Adding multithreading support for pungi/phases/image_checksum.py
Multithreading was added to parallelize the
computation of image checksums. Resulting memory structures
are protected via synchronization primitives. Max number of
threads is uncapped- experiments were done to determine
whether a maximum number of threads would yield greater
efficiency and there were no gains from this.

Likewise, experiments were done to determine whether pools of
threads computed in separate processes could likewise decrease
compute-time. Evidence did not suggest that this was the
case. This indicate that the checksum operation is bounded
by I/O read/write times.

Merges: https://pagure.io/pungi/pull-request/1520
Jira: RHELCMP-5967
Signed-off-by: James Kunstle jkunstle@redhat.com
2021-08-12 10:13:15 +02:00
..
compose_metadata Format code base with black 2020-02-05 17:35:47 +08:00
ostree ostree: set umask to be more permissive for ostree operations 2020-04-17 09:20:24 +02:00
phases Adding multithreading support for pungi/phases/image_checksum.py 2021-08-12 10:13:15 +02:00
scripts Cancel koji tasks when pungi terminated 2021-03-23 14:47:48 +08:00
wrappers show and log command when using the run_blocking_cmd() method [RHELCMP-2243] 2021-08-03 10:58:18 +00:00
__init__.py Format code base with black 2020-02-05 17:35:47 +08:00
arch.py Format code base with black 2020-02-05 17:35:47 +08:00
arch_utils.py Format code 2021-03-02 18:31:45 +08:00
checks.py Use cachedir when createrepo 2021-07-27 09:23:47 +08:00
common.py Format code base with black 2020-02-05 17:35:47 +08:00
compose.py Store extended traceback for gather errors 2021-02-17 11:11:26 +01:00
config.py Format code base with black 2020-02-05 17:35:47 +08:00
createiso.py Use xorrisofs for creating ISOs when needed 2020-11-20 09:47:49 +08:00
dnf_wrapper.py Format code base with black 2020-02-05 17:35:47 +08:00
errors.py Move UnsignedPackagesError to a separate file 2021-02-08 10:16:32 +00:00
gather.py Format code 2021-03-02 18:31:45 +08:00
gather_dnf.py Fix can't link XDEV using repos as pkgset_sources 2021-04-22 14:03:12 +02:00
graph.py Format code 2021-03-02 18:31:45 +08:00
ks.py Format code base with black 2020-02-05 17:35:47 +08:00
linker.py Hardlink or copy scratch builds always 2020-08-07 18:00:19 +08:00
media_split.py Format code base with black 2020-02-05 17:35:47 +08:00
metadata.py Include images info in composeinfo.json 2020-10-14 17:57:30 +08:00
module_util.py Move import of modulemd to a separate module 2019-10-03 10:40:31 +02:00
multilib_dnf.py Format code base with black 2020-02-05 17:35:47 +08:00
multilib_yum.py Format code base with black 2020-02-05 17:35:47 +08:00
notifier.py notification: Add compose_path into the messages 2020-06-09 06:40:26 +00:00
pathmatch.py Remove FSF address from comments 2016-09-23 10:26:43 +02:00
paths.py Cancel koji tasks when pungi terminated 2021-03-23 14:47:48 +08:00
profiler.py Format code base with black 2020-02-05 17:35:47 +08:00
runroot.py Cancel koji tasks when pungi terminated 2021-03-23 14:47:48 +08:00
util.py util: Strip file:// from local urls 2021-05-06 12:37:55 +02:00