112e33526SPatrick Williams## Features of OpenBMC Test Automation 224c9f88dSGeorge Keishing 324c9f88dSGeorge Keishing**Interface Feature List** 412e33526SPatrick Williams 512e33526SPatrick Williams- REST 612e33526SPatrick Williams- DMTF Redfish 712e33526SPatrick Williams- Out-of-band IPMI 812e33526SPatrick Williams- SSH to BMC and Host OS 924c9f88dSGeorge Keishing 1024c9f88dSGeorge Keishing**Key Feature List** 1112e33526SPatrick Williams 1212e33526SPatrick Williams- Power on/off 1312e33526SPatrick Williams- Reboot Host 1412e33526SPatrick Williams- Reset BMC 1512e33526SPatrick Williams- Code update BMC and host 1612e33526SPatrick Williams- Power management 1712e33526SPatrick Williams- Fan controller 1812e33526SPatrick Williams- HTX bootme 1912e33526SPatrick Williams- XCAT execution 2012e33526SPatrick Williams- Network 2112e33526SPatrick Williams- IPMI support (generic and DCMI compliant) 2212e33526SPatrick Williams- Factory reset 2312e33526SPatrick Williams- RAS (Reliability, availability and serviceability) 2412e33526SPatrick Williams- Web UI testing 2512e33526SPatrick Williams- Secure boot 2612e33526SPatrick Williams- SNMP (Simple Network Management Protocol) 2712e33526SPatrick Williams- Remote Logging via Rsyslog 2812e33526SPatrick Williams- LDAP (Lightweight Directory Access Protocol) 2912e33526SPatrick Williams- Certificate 3012e33526SPatrick Williams- Local User Management(Redfish/IPMI) 3112e33526SPatrick Williams- DateTime 3212e33526SPatrick Williams- Event Logging 3312e33526SPatrick Williams- PLDM (Platform Level Data Model) via pldmtool 3424c9f88dSGeorge Keishing 3524c9f88dSGeorge Keishing**Debugging Supported List** 3624c9f88dSGeorge Keishing 3712e33526SPatrick Williams- SOL collection 3812e33526SPatrick Williams- FFDC collection 3912e33526SPatrick Williams- Error injection from host 40b29d2e84SChris Austen 4112e33526SPatrick Williams## Installation Setup Guide 4212e33526SPatrick Williams 4312e33526SPatrick Williams- [Robot Framework Install Instruction](https://github.com/robotframework/robotframework/blob/master/INSTALL.rst) 4412e33526SPatrick Williams 4512e33526SPatrick Williams- Miscellaneous Packages required to be installed for OpenBmc Automation. 46a5c6e9d6SGeorge Keishing Install the packages and it's dependencies via `pip` 47a5c6e9d6SGeorge Keishing 4812e33526SPatrick WilliamsIf using Python 3.x, use the corresponding `pip3` to install packages. Note: 4912e33526SPatrick WilliamsOlder Python 2.x is not actively supported. 5012bbe002SGeorge Keishing 51a5c6e9d6SGeorge KeishingREST base packages: 5212e33526SPatrick Williams 53a5c6e9d6SGeorge Keishing``` 54a5c6e9d6SGeorge Keishing $ pip install -U requests 55a5c6e9d6SGeorge Keishing $ pip install -U robotframework-requests 561da95695SGeorge Keishing $ pip install -U robotframework-httplibrary 57a5c6e9d6SGeorge Keishing``` 58aba958dcSGeorge Keishing 5912e33526SPatrick WilliamsPython redfish library packages: For more detailed intstructions see 6012e33526SPatrick Williams[python-redfish-library](https://github.com/DMTF/python-redfish-library) 6112e33526SPatrick Williams 624e64eaddSGeorge Keishing``` 634e64eaddSGeorge Keishing $ pip install redfish 644e64eaddSGeorge Keishing``` 654e64eaddSGeorge Keishing 6612e33526SPatrick WilliamsSSH and SCP base packages: For more detailed installation instructions see 6712e33526SPatrick Williams[robotframework-sshlibrary](https://pypi.python.org/pypi/robotframework-sshlibrary) 6812e33526SPatrick Williams 69a5c6e9d6SGeorge Keishing``` 70a5c6e9d6SGeorge Keishing $ pip install robotframework-sshlibrary 71a5c6e9d6SGeorge Keishing $ pip install robotframework-scplibrary 72a5c6e9d6SGeorge Keishing``` 732de157e4SGeorge Keishing 7412bbe002SGeorge KeishingInstalling requirement dependencies: 7512e33526SPatrick Williams 7612bbe002SGeorge Keishing``` 7712bbe002SGeorge Keishing $ pip install -r requirements.txt 7812bbe002SGeorge Keishing``` 7912e33526SPatrick Williams 8012bbe002SGeorge Keishingyou'll find this file once your clone openbmc-test-automation repository. 8112bbe002SGeorge Keishing 82*8b1024d5SGeorge KeishingFor Web UI ( GUI ) Testing setup instructions see 83*8b1024d5SGeorge Keishing[OpenBMC GUI Test Setup Guide](https://github.com/openbmc/openbmc-test-automation/blob/master/docs/gui_setup_reference.md) 84*8b1024d5SGeorge Keishing 85aba958dcSGeorge KeishingInstalling tox: 8612e33526SPatrick Williams 87aba958dcSGeorge Keishing``` 88aba958dcSGeorge Keishing $ pip install -U tox 89aba958dcSGeorge Keishing``` 90aba958dcSGeorge Keishing 9177ac2bd9SPeter D PhanInstalling expect: 9212e33526SPatrick Williams 9377ac2bd9SPeter D Phan``` 9477ac2bd9SPeter D Phan $ sudo apt-get install expect (Ubuntu example) 9577ac2bd9SPeter D Phan``` 9677ac2bd9SPeter D Phan 9712e33526SPatrick Williams## OpenBMC Test Development 982de157e4SGeorge Keishing 992de157e4SGeorge KeishingThese documents contain details on developing OpenBMC test code and debugging. 1002de157e4SGeorge Keishing 101448e0669SGeorge Keishing- [MAINTAINERS](OWNERS): OpenBMC test code maintainers information. 1022de157e4SGeorge Keishing- [CONTRIBUTING.md](CONTRIBUTING.md): Coding guidelines. 10312e33526SPatrick Williams- [Code Check Tools](https://github.com/openbmc/openbmc-test-automation/blob/master/docs/code_standards_check.md): 10412e33526SPatrick Williams To check common code misspellings, syntax and standard checks. 10512e33526SPatrick Williams- [REST-cheatsheet.md](https://github.com/openbmc/docs/blob/master/REST-cheatsheet.md): 10612e33526SPatrick Williams Quick reference for some common curl commands required for legacy REST 10712e33526SPatrick Williams testing. 10812e33526SPatrick Williams- [REDFISH-cheatsheet.md](https://github.com/openbmc/docs/blob/master/REDFISH-cheatsheet.md): 10912e33526SPatrick Williams Quick reference for some common curl commands required for redfish testing. 11012e33526SPatrick Williams- [README.md](https://github.com/openbmc/phosphor-webui/blob/master/README.md): 11112e33526SPatrick Williams Web UI setup reference. 11212e33526SPatrick Williams- [Corporate CLA and Individual CLA](https://github.com/openbmc/docs/blob/master/CONTRIBUTING.md#submitting-changes-via-gerrit-server): 11312e33526SPatrick Williams Submitting changes via Gerrit server 1142de157e4SGeorge Keishing 11512e33526SPatrick Williams## OpenBMC Test Documentation 1168c7eec37SGeorge Keishing 11712e33526SPatrick Williams- [Tools](https://github.com/openbmc/openbmc-test-automation/blob/master/docs/openbmc_test_tools.md): 11812e33526SPatrick Williams Reference information for helper tools. 11912e33526SPatrick Williams- [Code Update](https://github.com/openbmc/openbmc-test-automation/blob/master/docs/code_update.md): 12012e33526SPatrick Williams Currently supported BMC and PNOR update. 12112e33526SPatrick Williams- [Certificate Generate](https://github.com/openbmc/openbmc-test-automation/blob/master/docs/certificate_generate.md): 12212e33526SPatrick Williams Steps to create and install CA signed certificate. 1238c7eec37SGeorge Keishing 12412e33526SPatrick Williams## Supported Systems Architecture 12587a3ff53SGeorge Keishing 12687a3ff53SGeorge KeishingOpenBMC test infrastructure is proven capable of running on: 12787a3ff53SGeorge Keishing 12812e33526SPatrick Williams- POWER 12912e33526SPatrick Williams- x86 systems running OpenBMC firmware stack. 13012e33526SPatrick Williams 13112e33526SPatrick Williams## Testing Setup Steps 1323df030faSGeorge Keishing 1333df030faSGeorge KeishingTo verify the installation setup is completed and ready to execute. 1343df030faSGeorge Keishing 13512e33526SPatrick Williams- Download the openbmc-test-automation repository: 1363df030faSGeorge Keishing ``` 1373df030faSGeorge Keishing $ git clone https://github.com/openbmc/openbmc-test-automation 1383df030faSGeorge Keishing $ cd openbmc-test-automation 1393df030faSGeorge Keishing ``` 14012e33526SPatrick Williams- Execute basic setup test run: 1413df030faSGeorge Keishing ``` 1423df030faSGeorge Keishing $ robot -v OPENBMC_HOST:xx.xx.xx.xx templates/test_openbmc_setup.robot 1433df030faSGeorge Keishing ``` 1443df030faSGeorge Keishing where xx.xx.xx.xx is the BMC hostname or IP. 145a5c6e9d6SGeorge Keishing 14612e33526SPatrick Williams## Test Layout 1475977d2aeSGeorge Keishing 1485977d2aeSGeorge KeishingThere are several sub-directories within the openbmc-test-automation base which 14912e33526SPatrick Williamscontain test suites, tools, templates, etc. These sub-directories are classified 15012e33526SPatrick Williamsas follows: 1515977d2aeSGeorge Keishing 1525977d2aeSGeorge Keishing`tests/`: Contains the general test cases for OpenBMC stack functional 15312e33526SPatrick Williamsverification. The "tests" subdirectory uses legacy REST and will be deprecated 15412e33526SPatrick Williamsat some point and therefore no longer supported. 1555977d2aeSGeorge Keishing 15612e33526SPatrick Williams`extended/`: Contains test cases for boot testing, code update testing using 15712e33526SPatrick Williamslegacy REST, etc. 1585977d2aeSGeorge Keishing 159b7ec2790SGeorge Keishing`systest/`: Contains test cases for HTX bootme testing. 1605977d2aeSGeorge Keishing 1615977d2aeSGeorge Keishing`xcat/`: Contains test cases for XCAT automation. 1625977d2aeSGeorge Keishing 16312e33526SPatrick Williams`gui/test/`: Contains test cases for testing web-based interface built on 16412e33526SPatrick WilliamsAngularJS. 165038e0049SRahul Maheshwari 16612e33526SPatrick Williams`gui/gui_test/`: Contains test cases for testing web-based user interface built 16712e33526SPatrick Williamson Vue.js. 16829814f0eSGeorge Keishing 16912e33526SPatrick Williams`pldm/`: Contains test cases for platform management subsystem (base, bios, fru, 17012e33526SPatrick Williamsplatform, OEM). 171cb858f7aSGeorge Keishing 1720465b9cdSGeorge Keishing`snmp/`: Contains test cases for SNMP (Simple Network Management Protocol) 1730465b9cdSGeorge Keishingconfiguration testing. 1740465b9cdSGeorge Keishing 1750465b9cdSGeorge Keishing`openpower/ras/`: Contains test cases for RAS (Reliability, Availability and 1760465b9cdSGeorge KeishingServiceability) for an OpenPOWER system. 1770465b9cdSGeorge Keishing 17812e33526SPatrick Williams`openpower/secureboot/`: Contains test cases for secure boot testing on a secure 17912e33526SPatrick Williamsboot feature enabled OpenPOWER system only. 18038f566bbSGeorge Keishing 1815977d2aeSGeorge Keishing`tools/`: Contains various tools. 1825977d2aeSGeorge Keishing 1835977d2aeSGeorge Keishing`templates/`: Contains sample code examples and setup testing. 184acb3c1efSGeorge Keishing 18512e33526SPatrick Williams`test_list/`: Contains the argument files used for skipping test cases (e.g 18612e33526SPatrick Williams"skip_test", "skip_test_extended", etc.) or grouping them (e.g "HW_CI", 18712e33526SPatrick Williams"CT_basic_run", etc.). 188aba958dcSGeorge Keishing 18912e33526SPatrick Williams## Redfish Test Layout 190acb3c1efSGeorge Keishing 19112e33526SPatrick WilliamsOpenBMC is moving steadily towards DTMF Redfish, which is an open industry 19212e33526SPatrick Williamsstandard specification and schema that meets the expectations of end users for 19312e33526SPatrick Williamssimple, modern and secure management of scalable platform hardware. 194acb3c1efSGeorge Keishing 19512e33526SPatrick Williams`redfish/`: Contains test cases for DMTF Redfish-related feature supported on 19612e33526SPatrick WilliamsOpenBMC. 197acb3c1efSGeorge Keishing 19812e33526SPatrick Williams`redfish/extended/`: Contains test cases for combined legacy REST and DMTF 19912e33526SPatrick WilliamsRedfish-related feature supported on OpenBMC. 2003292d4acSGeorge Keishing 20112e33526SPatrick WilliamsNote: Work in progress test development parameter 20212e33526SPatrick Williams`-v REDFISH_SUPPORT_TRANS_STATE:1` to force the test suites to execute in 20312e33526SPatrick Williamsredfish mode only. 204f32ee4cbSGeorge Keishing 20512e33526SPatrick Williams## Quickstart 206acb3c1efSGeorge Keishing 2075977d2aeSGeorge KeishingTo run openbmc-automation first you need to install the prerequisite Python 20812e33526SPatrick Williamspackages which will help to invoke tests through tox (Note that tox version 20912e33526SPatrick Williams2.3.1 or greater is required) or via Robot CLI command. 2105977d2aeSGeorge Keishing 2115977d2aeSGeorge Keishing**Robot Command Line** 2125977d2aeSGeorge Keishing 21312e33526SPatrick Williams- Execute all test suites for `tests/`: 21412e33526SPatrick Williams 2155977d2aeSGeorge Keishing ``` 2165977d2aeSGeorge Keishing $ robot -v OPENBMC_HOST:xx.xx.xx.xx tests 2175977d2aeSGeorge Keishing ``` 218aba958dcSGeorge Keishing 21912e33526SPatrick Williams- Execute a test suite: 22012e33526SPatrick Williams 2215977d2aeSGeorge Keishing ``` 222088da102SGeorge Keishing $ robot -v OPENBMC_HOST:xx.xx.xx.xx redfish/extended/test_basic_ci.robot 2235977d2aeSGeorge Keishing ``` 224b29d2e84SChris Austen 22512e33526SPatrick Williams- Initialize the following test variables which will be used during test 22612e33526SPatrick Williams execution: 22749a80604SGeorge Keishing 22849a80604SGeorge Keishing User can forward declare as environment variables: 22912e33526SPatrick Williams 230a7c46e39SGeorge Keishing ``` 23149a80604SGeorge Keishing $ export OPENBMC_HOST=<openbmc machine IP address/hostname> 2327a212a09SRahul Maheshwari $ export OPENBMC_USERNAME=<openbmc username> 23349a80604SGeorge Keishing $ export OPENBMC_PASSWORD=<openbmc password> 2347a212a09SRahul Maheshwari $ export IPMI_COMMAND=<Dbus/External> 23549a80604SGeorge Keishing ``` 23649a80604SGeorge Keishing 23749a80604SGeorge Keishing or 23849a80604SGeorge Keishing 23949a80604SGeorge Keishing User can input as robot variables as part of the CLI command: 24012e33526SPatrick Williams 24149a80604SGeorge Keishing ``` 24249a80604SGeorge Keishing -v OPENBMC_HOST:<openbmc machine IP address/hostname> 24349a80604SGeorge Keishing -v OPENBMC_USERNAME:<openbmc username> 24449a80604SGeorge Keishing -v OPENBMC_PASSWORD:<openbmc password> 245359f8039SGeorge Keishing ``` 246b29d2e84SChris Austen 24712e33526SPatrick Williams- For QEMU tests, set the following environment variables as well: 24812e33526SPatrick Williams 249a7c46e39SGeorge Keishing ``` 2504d6c1dabSGeorge Keishing $ export SSH_PORT=<ssh port number> 2514d6c1dabSGeorge Keishing $ export HTTPS_PORT=<https port number> 252a7c46e39SGeorge Keishing ``` 253b29d2e84SChris Austen 25412e33526SPatrick Williams- Run tests: 25512e33526SPatrick Williams 256a7c46e39SGeorge Keishing ``` 2575e021124SAlvin Wang $ tox tests 258b29d2e84SChris Austen ``` 259b29d2e84SChris Austen 26012e33526SPatrick Williams- How to run individual test: 26188acd8daSGeorge Keishing 262a7c46e39SGeorge Keishing One specific test: 26312e33526SPatrick Williams 264a7c46e39SGeorge Keishing ``` 265a7c46e39SGeorge Keishing $ tox -e default -- --include Power_On_Test tests/test_basic_poweron.robot 266a7c46e39SGeorge Keishing ``` 26712e33526SPatrick Williams 268a7c46e39SGeorge Keishing No preset environment variables, default configuration for all supported 269a7c46e39SGeorge Keishing systems: 27012e33526SPatrick Williams 271a7c46e39SGeorge Keishing ``` 272a7c46e39SGeorge Keishing $ OPENBMC_HOST=x.x.x.x tox -e default -- tests 273a7c46e39SGeorge Keishing ``` 274a7c46e39SGeorge Keishing 27512e33526SPatrick Williams No preset environment variables, one test case from a test suite: 27612e33526SPatrick Williams 27712e33526SPatrick Williams ``` 27812e33526SPatrick Williams $ OPENBMC_HOST=x.x.x.x tox -e default -- --include Power_On_Test tests/test_basic_poweron.robot 27912e33526SPatrick Williams ``` 28012e33526SPatrick Williams 28112e33526SPatrick Williams No preset environment variables, the entire test suite: 28212e33526SPatrick Williams 28312e33526SPatrick Williams ``` 28412e33526SPatrick Williams $ OPENBMC_HOST=x.x.x.x tox -e default -- tests 28512e33526SPatrick Williams ``` 28612e33526SPatrick Williams 28712e33526SPatrick Williams No preset environment variables, the entire test suite excluding test cases 28812e33526SPatrick Williams using argument file: 28912e33526SPatrick Williams 290a7c46e39SGeorge Keishing ``` 291a7c46e39SGeorge Keishing $ OPENBMC_HOST=x.x.x.x tox -e default -- --argumentfile test_lists/skip_test tests 292a7c46e39SGeorge Keishing ``` 293ddf0cc2aSGeorge Keishing 294ddf0cc2aSGeorge Keishing Exclude test list for supported systems: 29512e33526SPatrick Williams 296a7c46e39SGeorge Keishing ``` 297ddf0cc2aSGeorge Keishing Palmetto: test_lists/skip_test_palmetto 298ddf0cc2aSGeorge Keishing Witherspoon: test_lists/skip_test_witherspoon 299b29d2e84SChris Austen ``` 300b29d2e84SChris Austen 30112e33526SPatrick Williams- Run IPMI tests: 3027eea8ed0SRahul Maheshwari 3037eea8ed0SRahul Maheshwari Running only out-of-band IPMI tests: 30412e33526SPatrick Williams 3057eea8ed0SRahul Maheshwari ``` 3067eea8ed0SRahul Maheshwari $ robot -v IPMI_COMMAND:External -v OPENBMC_HOST:x.x.x.x --argumentfile test_lists/witherspoon/skip_inband_ipmi tests/ipmi/ 3077eea8ed0SRahul Maheshwari ``` 3087eea8ed0SRahul Maheshwari 3097eea8ed0SRahul Maheshwari Running only inband IPMI tests: 31012e33526SPatrick Williams 3117eea8ed0SRahul Maheshwari ``` 3127eea8ed0SRahul Maheshwari $ robot -v IPMI_COMMAND:Inband -v OPENBMC_HOST:x.x.x.x -v OS_HOST:x.x.x.x -v OS_USERNAME:xxxx -v OS_PASSWORD:xxxx --argumentfile test_lists/witherspoon/skip_oob_ipmi tests/ipmi/ 3137eea8ed0SRahul Maheshwari ``` 3147eea8ed0SRahul Maheshwari 31512e33526SPatrick Williams- Run GUI tests: 3167eea8ed0SRahul Maheshwari 31712e33526SPatrick Williams By default, GUI runs with Firefox browser and headless mode. Example with 31812e33526SPatrick Williams chrome browser and header mode: 319dd38aef3SRahul Maheshwari 320dd38aef3SRahul Maheshwari ``` 321eeb93c31SRahul Maheshwari $ robot -v OPENBMC_HOST:x.x.x.x -v GUI_BROWSER:gc -v GUI_MODE:header gui/test/ 322dd38aef3SRahul Maheshwari ``` 323dd38aef3SRahul Maheshwari 3242bd32ff1SRahul Maheshwari Run GUI default CI test bucket: 32512e33526SPatrick Williams 3262bd32ff1SRahul Maheshwari ``` 327eeb93c31SRahul Maheshwari $ robot -v OPENBMC_HOST:x.x.x.x --argumentfile test_lists/BMC_WEB_CI gui/test/ 3282bd32ff1SRahul Maheshwari ``` 3292bd32ff1SRahul Maheshwari 33012e33526SPatrick Williams- Run LDAP tests: 3315d00a3c8SSivas SRR 33212e33526SPatrick Williams Before using LDAP test functions, be sure appropriate LDAP user(s) and 33312e33526SPatrick Williams group(s) have been created on your LDAP server. Note: There are multiple ways 33412e33526SPatrick Williams to create LDAP users / groups and all depend on your LDAP server. One common 33512e33526SPatrick Williams way for openldap is ldapadd / ldapmodify refer 33612e33526SPatrick Williams https://linux.die.net/man/1/ldapadd For ldapsearch, refer to 33712e33526SPatrick Williams "https://linux.die.net/man/1/ldapsearch". Microsoft ADS: refer to 33812e33526SPatrick Williams https://searchwindowsserver.techtarget.com/definition/Microsoft-Active-Directory-Domain-Services-AD-DS 339962ff298SSivas SRR 34012e33526SPatrick Williams Note: Currently, LDAP test automation for Redfish API is in progress. The 34112e33526SPatrick Williams format to invoke LDAP test is as follows: 34212e33526SPatrick Williams 3435d00a3c8SSivas SRR ``` 344962ff298SSivas SRR $ cd redfish/account_service/ 345962ff298SSivas SRR $ robot -v OPENBMC_HOST:x.x.x.x -v LDAP_SERVER_URI:<ldap(s)//LDAP Hostname / IP> -v LDAP_BIND_DN:<LDAP Bind DN> -v LDAP_BASE_DN:<LDAP Base DN> -v LDAP_BIND_DN_PASSWORD:<LDAP Bind password> -v LDAP_SEARCH_SCOPE:<LDAP search scope> -v LDAP_SERVER_TYPE:<LDAP server type> -v LDAP_USER:<LDAP user-id> -v LDAP_USER_PASSWORD:<LDAP PASSWORD> -v GROUP_NAME:<Group Name> -v GROUP_PRIVILEGE:<Privilege> ./test_ldap_configuration.robot 3465d00a3c8SSivas SRR ``` 3475d00a3c8SSivas SRR 34812e33526SPatrick Williams- How to run CI and CT bucket test: 349d7c26840SGeorge Keishing 350d7c26840SGeorge Keishing Default CI test bucket list: 35112e33526SPatrick Williams 352d7c26840SGeorge Keishing ``` 353d7c26840SGeorge Keishing $ OPENBMC_HOST=x.x.x.x tox -e default -- --argumentfile test_lists/HW_CI tests 354d7c26840SGeorge Keishing ``` 355d7c26840SGeorge Keishing 356d7c26840SGeorge Keishing Default CI smoke test bucket list: 35712e33526SPatrick Williams 358d7c26840SGeorge Keishing ``` 359d7c26840SGeorge Keishing $ OPENBMC_HOST=x.x.x.x tox -e default -- --argumentfile test_lists/CT_basic_run tests 360d7c26840SGeorge Keishing ``` 361d7c26840SGeorge Keishing 36212e33526SPatrick Williams- Run extended tests: 363aba958dcSGeorge Keishing 364aba958dcSGeorge Keishing For-loop test (default iteration is 10): 36512e33526SPatrick Williams 366aba958dcSGeorge Keishing ``` 367aba958dcSGeorge Keishing $ robot -v OPENBMC_HOST:x.x.x.x -v OPENBMC_SYSTEMMODEL:xxxxxx -v ITERATION:n -v LOOP_TEST_COMMAND:xxxxxx extended/full_suite_regression.robot 368aba958dcSGeorge Keishing ``` 369aba958dcSGeorge Keishing 370aba958dcSGeorge Keishing Example using tox testing a test suite for 5 iterations "witherspoon": 37112e33526SPatrick Williams 372aba958dcSGeorge Keishing ``` 373aba958dcSGeorge Keishing OPENBMC_HOST=x.x.x.x LOOP_TEST_COMMAND="tests/test_fw_version.robot" ITERATION=5 OPENBMC_SYSTEMMODEL=witherspoon tox -e witherspoon -- ./extended/full_suite_regression.robot 374aba958dcSGeorge Keishing ``` 375aba958dcSGeorge Keishing 37612e33526SPatrick Williams- Host CPU architecture 377d61a64baSKonstantin Aladyshev 37812e33526SPatrick Williams By default openbmc-test-automation framework assumes that host CPU is based on 37912e33526SPatrick Williams the POWER architecture. If your host CPU is x86 add 38012e33526SPatrick Williams `-v PLATFORM_ARCH_TYPE:x86` variable setting to your CLI commands or set an 38112e33526SPatrick Williams environment variable: 38212e33526SPatrick Williams 383c056c2bbSKonstantin Aladyshev ``` 384c056c2bbSKonstantin Aladyshev $ export PLATFORM_ARCH_TYPE=x86 385c056c2bbSKonstantin Aladyshev ``` 386d61a64baSKonstantin Aladyshev 387aba958dcSGeorge Keishing**Jenkins jobs tox commands** 38812e33526SPatrick Williams 38912e33526SPatrick Williams- HW CI tox command: 390aba958dcSGeorge Keishing ``` 391aba958dcSGeorge Keishing $ OPENBMC_HOST=x.x.x.x tox -e default -- --argumentfile test_lists/HW_CI tests 392aba958dcSGeorge Keishing ``` 393