Split the test in two. For Fedora CI we run on x86_64 emulating ppc64le using qemu+mock. For RHEL/CentOS run natively.
gcc switched to ieee128 as the default in Fedora >=36, so clang needs to do this to maintain ABI compatibility.