kexec-tools/tests
Coiby Xu 62578ace21 selftest: ignore all spaces when compare the dmesg files
For the log entry that has multiple lines, "makedumpfile --dump-dmesg"
would indent the remaining lines while vmcore-dmesg doesn't. For
example, vmcore-dmesg.txt and vmcore-dmesg.txt.2 are the outputs of
vmcore-dmesg and "makedumpfile --dump-dmesg" respectively,

    ```
    diff -u vmcore-dmesg.txt vmcore-dmesg.txt.2
    --- vmcore-dmesg.txt    2021-03-28 22:13:09.986000000 -0400
    +++ vmcore-dmesg.txt.2  2021-03-28 22:13:39.920106131 -0400
    @@ -397,9 +397,9 @@
     [    1.710742] vc vcsa: hash matches
     [    1.711938] RAS: Correctable Errors collector initialized.
     [    1.713736] Unstable clock detected, switching default tracing clock to "global"
    -If you want to keep using the local clock, then add:
    -  "trace_clock=local"
    -on the kernel command line
    +               If you want to keep using the local clock, then add:
    +                 "trace_clock=local"
    +               on the kernel command line
     [    1.750539] ata1.01: NODEV after polling detection
     [    1.750973] ata1.00: ATA-7: QEMU HARDDISK, 2.5+, max UDMA/100
     [    1.752885] ata1.00: 8388608 sectors, multi 16: LBA48
    ```

Quite often, all three tests could fail because of the above difference. So
let's ignore all the spaces. This patch could fix bz1952299 [1].

[1] https://bugzilla.redhat.com/show_bug.cgi?id=1952299

Signed-off-by: Coiby Xu <coxu@redhat.com>
Acked-by: Kairui Song <kasong@redhat.com>
2021-06-08 22:21:47 +08:00
..
scripts selftest: ignore all spaces when compare the dmesg files 2021-06-08 22:21:47 +08:00
Makefile selftest: Make test_base_image depends on EXTRA_RPMS 2021-06-08 22:21:47 +08:00
README selftest: Add document for selftests 2020-09-17 10:42:58 +08:00

=====================
Kexec Kdump Self-test
=====================


Introduction
============
The self-tests here are useful for quick sanity tests for new patches, and also helpful for debugging issues.


How it works
============
All tests are run within VMs using qemu. By default, VM images are based on Fedora Cloud image, and the image for each test run is a layered qcow2 snapshot on top of the base image.
Test images are managed by Makefile, so if there are any code change in the kexec-tools repository, `make` command will detect that and only rebuild the top image layer. This makes the test runs boot fast and each test run is clean.


Basic usage
===========
Before you start, you can make the self-tests use your own base image by running following command:

`make clean && make BASE_IMAGE=<path/to/your/image>`

This is helpful if you have a slow network, else self-test will try to download the cloud image from Fedora's official website using `wget`.

- Use the following command to run all tests:
  $ make test-run

  All available tests will be executed.

  Test artifacts are stored in output/<testcase>

- For easier debugging, you can run only on test with the following command:
  $ make TEST_CASE=<testcase> test-run

  This way, VM's console is directly connected to stdin/out so debugging will be easier.
  If there are multiple VMs used in a test case, the VM performing actual kdump/kexec operation will be connected to stdin/out.

Test Cases
==========
Each test case is a folder under scripts/testcases/, a test case folder will contain at least one executable shell script, and each script should contain two functions: "on_build" and "on_test".

"on_build" is called when building the test image, which can instruct the self-test framework to install packages or create files, etc.
"on_test" is called when VM finished booting, which can get the boot count by calling "get_test_boot_count" and determine what to do. It should call "test_passed" on success, and call "test_failed" on failure. "test_aborted" is called when unexpected behavior occurs.

When there are multiple scripts in a single test case folder, they will spawn VMs in lexical order, and the last VM is considered the VM performing the actual test. Other VMs could be hosting test required service. This is useful for the network dump test. However, "test_passed" or "test_failed" or "test_aborted" could be called in any of these VMs, so during network kdump test, the dump target can also terminate the test and mark it passed when a valid vmcore is detected.


Debugging
=========

- When the test VM boots, you can append "no_test" to kernel args in grub, which tells the test services to quit early.

- You can launch the VMs manually or inspect the image after ran a test.

  Test images are located as:

    output/<testcase>/<vm-name>.img

  Test images' corresponding qemu command are located as:

    output/<testcase>/<vm-name>.qemu_cmd

  To repeat/debug a test manually, you should launch all VMs in output/<testcase> menu in lexical order, and append 'no_test' in the last VM's grub cmdline, then VM will hang on login prompt, login with root/fedora. Test script is located as /kexec-kdump-test/test.sh

- If you just want to inspect the images file content, you can also use scripts/spawn-image-shell.sh <test-image> to spawn a shell in the image quickly.