devel/testing/functional.rst

1 .. _checkfunctional-ref:
19 that there is no TAP-incompatible output written to stdio, e.g. either by
27    ``self.vm`` attribute (a QEMUMachine instance)
40 -------------
46   make check-functional
53   make check-functional-x86_64
59 to the QEMU binary that should be used for the test. The current working
63   $ export QEMU_TEST_QEMU_BINARY=$PWD/qemu-system-x86_64
73 -------
84   the ``self.log.info()`` or ``self.log.debug()`` functions).
91 -----------------------------
105       def test_qmp_human_info_version(self):
106           self.vm.launch()
107           res = self.vm.cmd('human-monitor-command',
109           self.assertRegex(res, r'^(\d+\.\d+\.\d)')
116 can also be run stand-alone, without a test runner. OTOH when run via a test
128 instance, available at ``self.vm``.  Because many tests will tweak the
129 QEMU command line, launching the QEMUMachine (by using ``self.vm.launch()``)
133 QEMUMachine. The way to get machines is through the ``self.get_vm()``
134 method which will return a QEMUMachine instance. The ``self.get_vm()``
145       def test_multiple_machines(self):
146           first_machine = self.get_vm()
147           second_machine = self.get_vm()
148           self.get_vm(name='third_machine').launch()
154               'human-monitor-command',
158               'human-monitor-command',
161           third_res = self.get_vm(name='third_machine').cmd(
162               'human-monitor-command',
165           self.assertEqual(first_res, second_res, third_res)
171 -----------
174 device-crash-test and other Python scripts.  It's a wrapper around the
190 The QEMU binary used for the ``self.vm`` QEMUMachine instance will
202 to a UNIX socket name. The ``qmp-shell`` command can then be
206 -------------------
239 qemu-system-* binaries.
263 --------------
273 speed mode in the meson.build file, while the "quick" speed mode is
277 run only ``make check-functional``, the "thorough" tests will be
281   make -j$(nproc) check SPEED=thorough
288 the tests are run. This pre-caching is done with the qemu_test.Asset
301     def test_function(self):
302         file_path = self.ASSET_somename.fetch()
304 The pre-caching will be done automatically when running
305 ``make check-functional`` (but not when running e.g.
306 ``make check-functional-<target>``). In case you just want to download
309     make precache-functional
316 --------------
324   https://docs.python.org/3/library/unittest.html#skipping-tests-and-expected-failures
354 Some tests are not working reliably and thus are disabled by default.
363   # See https://gitlab.com/qemu-project/qemu/-/issues/nnnn
365   def test(self):