Add tests/Regression/python-probing covering rhbz2027683. Also do minor updates to help the other tests behave correctly. Related: #2027683