pylorax package

Submodules

pylorax.base module

class pylorax.base.BaseLoraxClass[source]

Bases: builtins.object

pcritical(msg, fobj=<_io.TextIOWrapper name='<stdout>' mode='w' encoding='UTF-8'>)[source]
pdebug(msg, fobj=<_io.TextIOWrapper name='<stdout>' mode='w' encoding='UTF-8'>)[source]
perror(msg, fobj=<_io.TextIOWrapper name='<stdout>' mode='w' encoding='UTF-8'>)[source]
pinfo(msg, fobj=<_io.TextIOWrapper name='<stdout>' mode='w' encoding='UTF-8'>)[source]
pwarning(msg, fobj=<_io.TextIOWrapper name='<stdout>' mode='w' encoding='UTF-8'>)[source]
class pylorax.base.DataHolder(**kwargs)[source]

Bases: builtins.dict

copy()[source]

pylorax.buildstamp module

class pylorax.buildstamp.BuildStamp(product, version, bugurl, isfinal, buildarch)[source]

Bases: builtins.object

write(outfile)[source]

pylorax.decorators module

pylorax.decorators.singleton(cls)[source]

pylorax.discinfo module

class pylorax.discinfo.DiscInfo(release, basearch)[source]

Bases: builtins.object

write(outfile)[source]

pylorax.dnfhelper module

class pylorax.dnfhelper.LoraxDownloadCallback[source]

Bases: builtins.DownloadProgress

end(payload, status, err_msg)[source]
progress(payload, done)[source]
start(total_files, total_size)[source]
class pylorax.dnfhelper.LoraxRpmCallback(queue)[source]

Bases: builtins.LoggingTransactionDisplay

event(package, action, te_current, te_total, ts_current, ts_total)[source]

pylorax.executils module

class pylorax.executils.ExecProduct(rc, stdout, stderr)[source]

Bases: builtins.object

pylorax.executils.augmentEnv()[source]
pylorax.executils.execWithCapture(command, argv, stdin=None, root='/', log_output=True, filter_stderr=False, raise_err=False, callback=None)[source]

Run an external program and capture standard out and err. :param command: The command to run :param argv: The argument list :param stdin: The file object to read stdin from. :param root: The directory to chroot to before running command. :param log_output: Whether to log the output of command :param filter_stderr: Whether stderr should be excluded from the returned output :param raise_err: whether to raise a CalledProcessError if the returncode is non-zero :return: The output of the command

pylorax.executils.execWithRedirect(command, argv, stdin=None, stdout=None, root='/', env_prune=None, log_output=True, binary_output=False, raise_err=False, callback=None)[source]

Run an external program and redirect the output to a file. :param command: The command to run :param argv: The argument list :param stdin: The file object to read stdin from. :param stdout: Optional file object to redirect stdout and stderr to. :param root: The directory to chroot to before running command. :param env_prune: environment variable to remove before execution :param log_output: whether to log the output of command :param binary_output: whether to treat the output of command as binary data :param raise_err: whether to raise a CalledProcessError if the returncode is non-zero :param callback: method to call while waiting for process to finish, passed Popen object :return: The return code of the command

pylorax.executils.runcmd(cmd, **kwargs)[source]

run execWithRedirect with raise_err=True

pylorax.executils.runcmd_output(cmd, **kwargs)[source]

run execWithCapture with raise_err=True

pylorax.executils.setenv(name, value)[source]

Set an environment variable to be used by child processes.

This method does not modify os.environ for the running process, which is not thread-safe. If setenv has already been called for a particular variable name, the old value is overwritten.

Parameters:
  • name (str) – The name of the environment variable
  • value (str) – The value of the environment variable
pylorax.executils.startProgram(argv, root='/', stdin=None, stdout=-1, stderr=-2, env_prune=None, env_add=None, reset_handlers=True, reset_lang=True, **kwargs)[source]

Start an external program and return the Popen object.

The root and reset_handlers arguments are handled by passing a preexec_fn argument to subprocess.Popen, but an additional preexec_fn can still be specified and will be run. The user preexec_fn will be run last.

Parameters:
  • argv – The command to run and argument
  • root – The directory to chroot to before running command.
  • stdin – The file object to read stdin from.
  • stdout – The file object to write stdout to.
  • stderr – The file object to write stderr to.
  • env_prune – environment variables to remove before execution
  • env_add – environment variables to add before execution
  • reset_handlers – whether to reset to SIG_DFL any signal handlers set to SIG_IGN
  • reset_lang – whether to set the locale of the child process to C
  • kwargs – Additional parameters to pass to subprocess.Popen
Returns:

A Popen object for the running command.

pylorax.imgutils module

class pylorax.imgutils.DMDev(dev, size, name=None)[source]

Bases: builtins.object

class pylorax.imgutils.LoopDev(filename, size=None)[source]

Bases: builtins.object

class pylorax.imgutils.Mount(dev, opts='', mnt=None)[source]

Bases: builtins.object

class pylorax.imgutils.PartitionMount(disk_img, mount_ok=None)[source]

Bases: builtins.object

Mount a partitioned image file using kpartx

pylorax.imgutils.compress(command, rootdir, outfile, compression='xz', compressargs=None)[source]

Make a compressed archive of the given rootdir. command is a list of the archiver commands to run compression should be “xz”, “gzip”, “lzma”, “bzip2”, or None. compressargs will be used on the compression commandline.

pylorax.imgutils.copytree(src, dest, preserve=True)[source]

Copy a tree of files using cp -a, thus preserving modes, timestamps, links, acls, sparse files, xattrs, selinux contexts, etc. If preserve is False, uses cp -R (useful for modeless filesystems) raises CalledProcessError if copy fails.

pylorax.imgutils.dm_attach(dev, size, name=None)[source]

Attach a devicemapper device to the given device, with the given size. If name is None, a random name will be chosen. Returns the device name. raises CalledProcessError if dmsetup fails.

pylorax.imgutils.dm_detach(dev)[source]

Detach the named devicemapper device. Returns False if dmsetup fails.

pylorax.imgutils.do_grafts(grafts, dest, preserve=True)[source]

Copy each of the items listed in grafts into dest. If the key ends with ‘/’ it’s assumed to be a directory which should be created, otherwise just the leading directories will be created.

pylorax.imgutils.estimate_size(rootdir, graft=None, fstype=None, blocksize=4096, overhead=128)[source]
pylorax.imgutils.get_loop_name(path)[source]

Return the loop device associated with the path. Raises RuntimeError if more than one loop is associated

pylorax.imgutils.loop_attach(outfile)[source]

Attach a loop device to the given file. Return the loop device name. Raises CalledProcessError if losetup fails.

pylorax.imgutils.loop_detach(loopdev)[source]

Detach the given loop device. Return False on failure.

pylorax.imgutils.mkbtrfsimg(rootdir, outfile, size=None, label='', mountargs='', graft=None)[source]
pylorax.imgutils.mkcpio(rootdir, outfile, compression='xz', compressargs=None)[source]
pylorax.imgutils.mkdosimg(rootdir, outfile, size=None, label='', mountargs='shortname=winnt, umask=0077', graft=None)[source]
pylorax.imgutils.mkext4img(rootdir, outfile, size=None, label='', mountargs='', graft=None)[source]
pylorax.imgutils.mkfsimage(fstype, rootdir, outfile, size=None, mkfsargs=None, mountargs='', graft=None)[source]

Generic filesystem image creation function. fstype should be a filesystem type - “mkfs.${fstype}” must exist. graft should be a dict: {“some/path/in/image”: “local/file/or/dir”};

if the path ends with a ‘/’ it’s assumed to be a directory.

Will raise CalledProcessError if something goes wrong.

pylorax.imgutils.mkhfsimg(rootdir, outfile, size=None, label='', mountargs='', graft=None)[source]
pylorax.imgutils.mkqcow2(outfile, size, options=None)[source]

use qemu-img to create a file of the given size. options is a list of options passed to qemu-img

Default format is qcow2, override by passing “-f”, fmt in options.

pylorax.imgutils.mkrootfsimg(rootdir, outfile, label, size=2, sysroot='')[source]

Make rootfs image from a directory

Parameters:
  • rootdir (str) – Root directory
  • outfile (str) – Path of output image file
  • label (str) – Filesystem label
  • size (int) – Size of the image in GiB, if None computed automatically
  • sysroot (str) – path to system (deployment) root relative to physical root
pylorax.imgutils.mksparse(outfile, size)[source]

use os.ftruncate to create a sparse file of the given size.

pylorax.imgutils.mksquashfs(rootdir, outfile, compression='default', compressargs=None)[source]

Make a squashfs image containing the given rootdir.

pylorax.imgutils.mktar(rootdir, outfile, compression='xz', compressargs=None)[source]
pylorax.imgutils.mount(dev, opts='', mnt=None)[source]

Mount the given device at the given mountpoint, using the given opts. opts should be a comma-separated string of mount options. if mnt is none, a temporary directory will be created and its path will be returned. raises CalledProcessError if mount fails.

pylorax.imgutils.round_to_blocks(size, blocksize)[source]

If size isn’t a multiple of blocksize, round up to the next multiple

pylorax.imgutils.umount(mnt, lazy=False, maxretry=3, retrysleep=1.0)[source]

Unmount the given mountpoint. If lazy is True, do a lazy umount (-l). If the mount was a temporary dir created by mount, it will be deleted. raises CalledProcessError if umount fails.

pylorax.ltmpl module

class pylorax.ltmpl.LoraxTemplate(directories=None)[source]

Bases: builtins.object

parse(template_file, variables)[source]
class pylorax.ltmpl.LoraxTemplateRunner(inroot, outroot, dbo=None, fatalerrors=True, templatedir=None, defaults=None)[source]

Bases: builtins.object

This class parses and executes Lorax templates. Sample usage:

# install a bunch of packages runner = LoraxTemplateRunner(inroot=rundir, outroot=rundir, dbo=dnf_obj) runner.run(“install-packages.ltmpl”)

# modify a runtime dir runner = LoraxTemplateRunner(inroot=rundir, outroot=newrun) runner.run(“runtime-transmogrify.ltmpl”)

NOTES:

  • Parsing procedure is roughly: 1. Mako template expansion (on the whole file) 2. For each line of the result,

    1. Whitespace splitting (using shlex.split())
    2. Brace expansion (using brace_expand())
    3. If the first token is the name of a function, call that function with the rest of the line as arguments
  • Parsing and execution are separate passes - so you can’t use the result of a command in an %if statement (or any other control statements)!

  • Commands that run external programs (systemctl, gconfset) currently use the host‘s copy of that program, which may cause problems if there’s a big enough difference between the host and the image you’re modifying.

  • The commands are not executed under a real chroot, so absolute symlinks will point outside the inroot/outroot. Be careful with symlinks!

ADDING NEW COMMANDS:

  • Each template command is just a method of the LoraxTemplateRunner object - so adding a new command is as easy as adding a new function.
  • Each function gets arguments that correspond to the rest of the tokens on that line (after word splitting and brace expansion)
  • Commands should raise exceptions for errors - don’t use sys.exit()
append(filename, data)[source]
append FILE STRING

Append STRING (followed by a newline character) to FILE. Python character escape sequences (‘n’, ‘t’, etc.) will be converted to the appropriate characters. Examples:

append /etc/depmod.d/dd.conf “search updates built-in” append /etc/resolv.conf “”
chmod(fileglob, mode)[source]
chmod FILEGLOB OCTALMODE
Change the mode of all the files matching FILEGLOB to OCTALMODE.
copy(src, dest)[source]
copy SRC DEST
Copy SRC to DEST. If DEST is a directory, SRC will be copied inside it. If DEST doesn’t exist, SRC will be copied to a file with that name, if the path leading to it exists.
createaddrsize(addr, src, dest)[source]
createaddrsize INITRD_ADDRESS INITRD ADDRSIZE

Create the initrd.addrsize file required in LPAR boot process. Examples:

createaddrsize ${INITRD_ADDRESS} ${outroot}/${BOOTDIR}/initrd.img ${outroot}/${BOOTDIR}/initrd.addrsize
gconfset(path, keytype, value, outfile=None)[source]
gconfset PATH KEYTYPE VALUE [OUTFILE]

Set the given gconf PATH, with type KEYTYPE, to the given value. OUTFILE defaults to /etc/gconf/gconf.xml.defaults if not given. Example:

gconfset /apps/metacity/general/num_workspaces int 1
get_token_checked(process, token_queue)[source]

Try to get token from queue checking that process is still alive

hardlink SRC DEST
Create a hardlink at DEST which is linked to SRC.
install(srcglob, dest)[source]
install SRC DEST

Copy the given file (or files, if a glob is used) from the input tree to the given destination in the output tree. The path to DEST must exist in the output tree. If DEST is a directory, SRC will be copied into that directory. If DEST doesn’t exist, SRC will be copied to a file with that name, assuming the rest of the path exists. This is pretty much like how the ‘cp’ command works. Examples:

install usr/share/myconfig/grub.conf /boot install /usr/share/myconfig/grub.conf.in /boot/grub.conf
installimg(srcdir, destfile)[source]
installimg SRCDIR DESTFILE

Create a compressed cpio archive of the contents of SRCDIR and place it in DESTFILE.

If SRCDIR doesn’t exist or is empty nothing is created.

Examples:
installimg ${LORAXDIR}/product/ images/product.img installimg ${LORAXDIR}/updates/ images/updates.img
installinitrd(section, src, dest)[source]
installinitrd SECTION SRC DEST
Same as installkernel, but for “initrd”.
installkernel(section, src, dest)[source]
installkernel SECTION SRC DEST

Install the kernel from SRC in the input tree to DEST in the output tree, and then add an item to the treeinfo data store, in the named SECTION, where “kernel” = DEST.

Equivalent to:
install SRC DEST treeinfo SECTION kernel DEST
installpkg(*pkgs)[source]
installpkg [–required] PKGGLOB [PKGGLOB ...]
Request installation of all packages matching the given globs. Note that this is just a request - nothing is actually installed until the ‘run_pkg_transaction’ command is given.
installupgradeinitrd(section, src, dest)[source]
installupgradeinitrd SECTION SRC DEST
Same as installkernel, but for “upgrade”.
log(msg)[source]
log MESSAGE

Emit the given log message. Be sure to put it in quotes! Example:

log “Reticulating splines, please wait...”
mkdir(*dirs)[source]
mkdir DIR [DIR ...]

Create the named DIR(s). Will create leading directories as needed. Example:

mkdir /images
move(src, dest)[source]
move SRC DEST
Move SRC to DEST.
remove(*fileglobs)[source]
remove FILEGLOB [FILEGLOB ...]
Remove all the named files or directories. Will not raise exceptions if the file(s) are not found.
removefrom(pkg, *globs)[source]
removefrom PKGGLOB [–allbut] FILEGLOB [FILEGLOB...]

Remove all files matching the given file globs from the package (or packages) named. If ‘–allbut’ is used, all the files from the given package(s) will be removed except the ones which match the file globs. Examples:

removefrom usbutils /usr/bin/* removefrom xfsprogs –allbut /sbin/*
removekmod(*globs)[source]
removekmod GLOB [GLOB...] [–allbut] KEEPGLOB [KEEPGLOB...]

Remove all files and directories matching the given file globs from the kernel modules directory.

If ‘–allbut’ is used, all the files from the modules will be removed except the ones which match the file globs. There must be at least one initial GLOB to search and one KEEPGLOB to keep. The KEEPGLOB is expanded to be KEEPGLOB so that it will match anywhere in the path.

This only removes files from under /lib/modules/*/kernel/

Examples:
removekmod sound drivers/media drivers/hwmon drivers/video removekmod drivers/char –allbut virtio_console hw_random
removepkg(*pkgs)[source]
removepkg PKGGLOB [PKGGLOB...]

Delete the named package(s). IMPLEMENTATION NOTES:

RPM scriptlets (%preun/%postun) are not run. Files are deleted, but directories are left behind.
replace(pat, repl, *fileglobs)[source]
replace PATTERN REPLACEMENT FILEGLOB [FILEGLOB ...]

Find-and-replace the given PATTERN (Python-style regex) with the given REPLACEMENT string for each of the files listed. Example:

replace @VERSION@ ${product.version} /boot/grub.conf /boot/isolinux.cfg
run(templatefile, **variables)[source]
run_pkg_transaction()[source]

Actually install all the packages requested by previous ‘installpkg’ commands.

runcmd(*cmdlist)[source]
runcmd CMD [ARG ...]

Run the given command with the given arguments.

NOTE: All paths given MUST be COMPLETE, ABSOLUTE PATHS to the file or files mentioned. ${root}/${inroot}/${outroot} are good for constructing these paths.

FURTHER NOTE: Please use this command only as a last resort! Whenever possible, you should use the existing template commands. If the existing commands don’t do what you need, fix them!

Examples:

(this should be replaced with a “find” function) runcmd find ${root} -name “.pyo” -type f -delete %for f in find(root, name=”.pyo”):

remove ${f}

%endfor

symlink SRC DEST
Create a symlink at DEST which points to SRC.
systemctl(cmd, *units)[source]
systemctl [enable|disable|mask] UNIT [UNIT...]

Enable, disable, or mask the given systemd units. Examples:

systemctl disable lvm2-monitor.service systemctl mask fedora-storage-init.service fedora-configure.service
treeinfo(section, key, *valuetoks)[source]
treeinfo SECTION KEY ARG [ARG ...]

Add an item to the treeinfo data store. The given SECTION will have a new item added where KEY = ARG ARG ... Example:

treeinfo images-${kernel.arch} boot.iso images/boot.iso
pylorax.ltmpl.brace_expand(s)[source]
pylorax.ltmpl.rexists(pathname, root='')[source]
pylorax.ltmpl.rglob(pathname, root='/', fatal=False)[source]
pylorax.ltmpl.split_and_expand(line)[source]

pylorax.output module

pylorax.sysutils module

pylorax.sysutils.joinpaths(*args, **kwargs)[source]
pylorax.sysutils.touch(fname)[source]
pylorax.sysutils.replace(fname, find, sub)[source]
pylorax.sysutils.chown_(path, user=None, group=None, recursive=False)[source]
pylorax.sysutils.chmod_(path, mode, recursive=False)[source]
pylorax.sysutils.remove(target)[source]
pylorax.sysutils.linktree(src, dst)[source]

pylorax.treebuilder module

class pylorax.treebuilder.RuntimeBuilder(product, arch, dbo, templatedir=None, installpkgs=None, add_templates=None, add_template_vars=None)[source]

Bases: builtins.object

Builds the anaconda runtime image.

cleanup()[source]

Remove unneeded packages and files with runtime-cleanup.tmpl

create_runtime(outfile='/var/tmp/squashfs.img', compression='xz', compressargs=None, size=2)[source]
finished()[source]

Done using RuntimeBuilder

Close the dnf base object

generate_module_data()[source]
install()[source]

Install packages and do initial setup with runtime-install.tmpl

postinstall()[source]

Do some post-install setup work with runtime-postinstall.tmpl

writepkglists(pkglistdir)[source]

debugging data: write out lists of package contents

writepkgsizes(pkgsizefile)[source]

debugging data: write a big list of pkg sizes

class pylorax.treebuilder.TreeBuilder(product, arch, inroot, outroot, runtime, isolabel, domacboot=True, doupgrade=True, templatedir=None, add_templates=None, add_template_vars=None, workdir=None)[source]

Bases: builtins.object

Builds the arch-specific boot images. inroot should be the installtree root (the newly-built runtime dir)

build()[source]
copy_dracut_hooks(hooks)[source]

Copy the hook scripts in hooks into the installroot’s /tmp/ and return a list of commands to pass to dracut when creating the initramfs

hooks is a list of tuples with the name of the hook script and the target dracut hook directory (eg. [(“99anaconda-copy-ks.sh”, “/lib/dracut/hooks/pre-pivot”)])

dracut_hooks_path[source]

Return the path to the lorax dracut hooks scripts

Use the configured share dir if it is setup, otherwise default to /usr/share/lorax/dracut_hooks

implantisomd5()[source]
kernels[source]
rebuild_initrds(add_args=None, backup='', prefix='')[source]

Rebuild all the initrds in the tree. If backup is specified, each initrd will be renamed with backup as a suffix before rebuilding. If backup is empty, the existing initrd files will be overwritten. If suffix is specified, the existing initrd is untouched and a new image is built with the filename “${prefix}-${kernel.version}.img”

pylorax.treebuilder.findkernels(root='/', kdir='boot')[source]
pylorax.treebuilder.generate_module_info(moddir, outfile=None)[source]
pylorax.treebuilder.string_lower(string)[source]

Return a lowercase string.

Parameters:string – String to lowercase

This is used as a filter in the templates.

pylorax.treebuilder.udev_escape(label)[source]

pylorax.treeinfo module

class pylorax.treeinfo.TreeInfo(product, version, variant, basearch, packagedir='')[source]

Bases: builtins.object

add_section(section, data)[source]
write(outfile)[source]

Module contents

class pylorax.ArchData(buildarch)[source]

Bases: pylorax.base.DataHolder

bcj_arch = {'x86_64': 'x86', 'ppc': 'powerpc', 'ppc64': 'powerpc', 'arm': 'arm', 'i386': 'x86', 'ppc64le': 'powerpc', 'armhfp': 'arm'}
lib64_arches = ('x86_64', 'ppc64', 'ppc64le', 's390x', 'ia64', 'aarch64')
class pylorax.Lorax[source]

Bases: pylorax.base.BaseLoraxClass

configure(conf_file='/etc/lorax/lorax.conf')[source]
init_file_logging(logdir, logname='pylorax.log')[source]
init_stream_logging()[source]
run(dbo, product, version, release, variant='', bugurl='', isfinal=False, workdir=None, outputdir=None, buildarch=None, volid=None, domacboot=True, doupgrade=True, remove_temp=False, installpkgs=None, size=2, add_templates=None, add_template_vars=None, add_arch_templates=None, add_arch_template_vars=None)[source]
pylorax.get_buildarch(dbo)[source]