Correct tox config for whitelist

tox changed the whitelist_externals to allowlist_externals
and as of tox 4.x the older name no longer works.

Change-Id: I8d5b196fc276205ede1666f0d71d0cd6550fdc22
Si

Correct tox config for whitelist

tox changed the whitelist_externals to allowlist_externals
and as of tox 4.x the older name no longer works.

Change-Id: I8d5b196fc276205ede1666f0d71d0cd6550fdc22
Signed-off-by: Matt Fischer <matthew.fischer@hpe.com>

show more ...

Replaced cipher 3 with 17 as cipher 3 support is removed

Change-Id: I881d25ae24513f056a9cc208407d6e35e624eec4
Signed-off-by: Rahul Maheshwari <rahulmaheshwari@in.ibm.com>

Remove Barreleye footprint from test

Changes:
- Replace examples and code with Witherspoon.
- Delete data/Barreleye.py file.
- Remove command from tox.ini.

Change-Id: Ib61723dc0a0f39

Remove Barreleye footprint from test

Changes:
- Replace examples and code with Witherspoon.
- Delete data/Barreleye.py file.
- Remove command from tox.ini.

Change-Id: Ib61723dc0a0f3961da6d72f1dd65914c9c62079b
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Remove "Garrison" code and references from automation

Refer: https://gerrit.openbmc-project.xyz/#/c/10956/
Garrison was never fully working, and has no maintainer.

Resolves openbmc/openbmc-test-au

Remove "Garrison" code and references from automation

Refer: https://gerrit.openbmc-project.xyz/#/c/10956/
Garrison was never fully working, and has no maintainer.

Resolves openbmc/openbmc-test-automation#1379

Change-Id: I5049ca893a144a611f022884db633a658f8164fd
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Remove "Firestone" reference and code from automation

Refer: https://gerrit.openbmc-project.xyz/#/c/10957/
Firestone was never fully working, and has no maintainer.

Resolves openbmc/openbmc-test-a

Remove "Firestone" reference and code from automation

Refer: https://gerrit.openbmc-project.xyz/#/c/10957/
Firestone was never fully working, and has no maintainer.

Resolves openbmc/openbmc-test-automation#1378

Change-Id: I8369150bc652aab34811a9ede00f962febe48e95
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Clear executable bits on README.md, Tools.md and tox.ini

They are not executable files.

Change-Id: I65cc69be89e382b8db197ff09a3cf75c7eac4d59
Signed-off-by: Andrew Jeffery <andrew@aj.id.au>

Add IPMI cipher default in tox.ini profile

and https://gerrit.openbmc-project.xyz/#/c/10387/ changes bellow

IPMI cipher level integrity test

Changes:
- Added test to execute all cipher suppor

Add IPMI cipher default in tox.ini profile

and https://gerrit.openbmc-project.xyz/#/c/10387/ changes bellow

IPMI cipher level integrity test

Changes:
- Added test to execute all cipher supported level.
- Added local IPMI test suite keyword to execute command
with a given cipher level value.
- Added new IPMI_CIPHER_LEVEL global variable.
- Added new default variable IPMI_CIPHER_LEVEL and set
value to 3.
- Added IPMI chipher supported list variable.

Change-Id: Ib8083c55028cea31275df46594cde7c187d36496
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Update QEMU CI to do basic validation

QEMU CI only gets to ready state so update tests
to reflect that

Change-Id: Ifca2f2afdee1914902f87899299444d2e0675aa6
Signed-off-by: Andrew Geissler <geissonat

Update QEMU CI to do basic validation

QEMU CI only gets to ready state so update tests
to reflect that

Change-Id: Ifca2f2afdee1914902f87899299444d2e0675aa6
Signed-off-by: Andrew Geissler <geissonator@yahoo.com>

show more ...

Added basic support for Romulus system.

This change includes:
- Added support in tox.ini for running automation on Romulus
system.
- Added data/romulus.py file from skeleton which requ

Added basic support for Romulus system.

This change includes:
- Added support in tox.ini for running automation on Romulus
system.
- Added data/romulus.py file from skeleton which required for
running sensor related test cases.
- Fixed initializing inventory_root variable in data/romulus.py.

Resolves openbmc/openbmc-test-automation#639

Change-Id: I5afe5eb59a6fc41909982880def8b027871a994b
Signed-off-by: Rahul Maheshwari <rahulmaheshwari@in.ibm.com>

show more ...

Default configuration tox env name change

Currently tox configuration has env by name "custom", renaming it
to "default" to generalize for all supported system.

Going forward there will be no syste

Default configuration tox env name change

Currently tox configuration has env by name "custom", renaming it
to "default" to generalize for all supported system.

Going forward there will be no system model concept supported from
the test env or from developement skeleton model.

Resolves openbmc/openbmc-test-automation#645

Change-Id: I0b678ffc10e373214bd1dec425182462955acb2c
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Set external IPMI as default for IPMI commands.

Resolves openbmc/openbmc-test-automation#405

Change-Id: I87628d1ca6a8b607452762d2f92ba6f44af57d39
Signed-off-by: Rahul Maheshwari <rahulmaheshwari@in

Set external IPMI as default for IPMI commands.

Resolves openbmc/openbmc-test-automation#405

Change-Id: I87628d1ca6a8b607452762d2f92ba6f44af57d39
Signed-off-by: Rahul Maheshwari <rahulmaheshwari@in.ibm.com>

show more ...

Changed to using ssh to log os console.

- Created ssh_pw program.
- Modified "Stop OS Console Logging" and "Start OS Console Logging" to
work with new ssh_pw program.
- Created 2 supporting keywor

Changed to using ssh to log os console.

- Created ssh_pw program.
- Modified "Stop OS Console Logging" and "Start OS Console Logging" to
work with new ssh_pw program.
- Created 2 supporting keywords:
- "Create OS Console File Path"
- "Create OS Console Command String"
- Removed "Stop OBMC Console Client" keyword which is no longer needed.
- Modified tox.ini to be able to find ssh_pw.

Change-Id: Ifd8fc95db16fcbcbbe0a36d7e4d09383e2d1e161
Signed-off-by: David Shaw <dlshaw@us.ibm.com>

show more ...

Remove bmcreboot and chassisboot exclusion tags from tox.ini

These tags are excluded till now and are valid set of tests
that needs to be executed as part of the standard test bucket.

Change-Id: I5

Remove bmcreboot and chassisboot exclusion tags from tox.ini

These tags are excluded till now and are valid set of tests
that needs to be executed as part of the standard test bucket.

Change-Id: I5f86f4d4aad23ff5d8605810537c2adc669f18ff
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

tox force upgrade disable

Change-Id: I1338ff0dd010e609a6a352410ec0e396d7e85ec6
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

Updated tox file to take Dbus as default type for IPMI Command
Also corrected command in Readme to exclude test case

Change-Id: I3acea6002894ec2c4e6bf4a036a1037d60195cd6
Signed-off-by: Rahul Maheshw

Updated tox file to take Dbus as default type for IPMI Command
Also corrected command in Readme to exclude test case

Change-Id: I3acea6002894ec2c4e6bf4a036a1037d60195cd6
Signed-off-by: Rahul Maheshwari <rahulmaheshwari@in.ibm.com>

show more ...

tox.ini warning fix

This fixes the follwing warning thrown onto console
- Invalid -W option ignored: invalid action: '"ignore'
- /bin/mkdir: cannot create directory .tox/palmetto/tmp: File exist

tox.ini warning fix

This fixes the follwing warning thrown onto console
- Invalid -W option ignored: invalid action: '"ignore'
- /bin/mkdir: cannot create directory .tox/palmetto/tmp: File exists

Resolves openbmc/openbmc-test-automation#106

Change-Id: I2b3e6ff5222564c61a741da62b725a78e8304052
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Enable Witherspoon data model for automation
- Add Witherspoon.py model in data
- Update tox.ini entry for witherspoon

Resolves openbmc/openbmc-test-automation#93

Change-Id: Ia18eac3377ba19

Enable Witherspoon data model for automation
- Add Witherspoon.py model in data
- Update tox.ini entry for witherspoon

Resolves openbmc/openbmc-test-automation#93

Change-Id: Ia18eac3377ba19286198d482326fa147a9da4a04
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Test suite support for QEMU boot features

QEMU does not have a host nor can it reboot. There are test cases
that force the BMC to reboot and others that issue power on
commands. I am implementing

Test suite support for QEMU boot features

QEMU does not have a host nor can it reboot. There are test cases
that force the BMC to reboot and others that issue power on
commands. I am implementing two tags that descrbie what the
test will need to do. The "bmcreboot" and "chassisboot" tags
will be used to skip tests that issue bmc reboots and chassis
boots.

Change-Id: I66b4039d6246be74285a6ea8071b49f9d6201041
Signed-off-by: Chris Austen <austenc@us.ibm.com>

show more ...

Add CI approved test cases tag infrastructure

Use Robot Test Framework's use of Tags to create a subset of tests that
can be run on real and simulated hardware for a basic set of validations
against

Add CI approved test cases tag infrastructure

Use Robot Test Framework's use of Tags to create a subset of tests that
can be run on real and simulated hardware for a basic set of validations
against each commit.

Our yocto qemu session has real basic support and can not pass very many
of the robot tests. Not because there is a bug but simply because the
simulation does not support many of the openbmc rest interfaces (i.e.
inventory, sensors). I found some REST and Event Log test suites that
are available in QEMU to start testing now with. When we move the QEMU
simulation to more of a palmetto based model more test cases will get
the CI tag. Eventually we will be able to go to a negative model where
we mark the tests that should not be part of a CI run rather then this
small set of includes.

The tag of 'CI' was chosen over a 'QEMUCI' because I fear the use of
tags could get out of hand (BARRELEYECI vs WEDGECI vs BARRELEYE_SIM_CI,
etc).

Invoking....

To test in QEMU first launch the session, find the IP and then run...
OPENBMC_HOST=<ip> tox -e qemu -- --include CI tests

You can also run the CI suite against real hardware...
OPENBMC_HOST=<ip> tox -e barreleye -- --include CI tests

Change-Id: I2c5fbcf2457d958edf7b89c70d7990f5f97e8b75
Signed-off-by: Chris Austen <austenc@us.ibm.com>

show more ...

Support multiple users running robot tests

You can use robot with jenkins. What I saw was the argument file was
explictly written to /tmp. The Jenkins is a different user then my
user id so when J

Support multiple users running robot tests

You can use robot with jenkins. What I saw was the argument file was
explictly written to /tmp. The Jenkins is a different user then my
user id so when Jenkins owned the /tmp/argument_file.txt my user id
trying to do things manually got a file permission error... and
visa versa. So I am moving the argument_file.txt to a location
based off of the workspace where the test is being executed.
That allows multiple users on the same system to run the suite.

Change-Id: I81525c7f20708dbd24d219c8424cad59144ba4ab
Signed-off-by: Chris Austen <austenc@us.ibm.com>

show more ...

Port suite from mkumatag personal repo w/o history

All these files came from https://github.com/mkumatag/openbmc-automation
The decision to remove the commit history was because most of the 122
comm

Port suite from mkumatag personal repo w/o history

All these files came from https://github.com/mkumatag/openbmc-automation
The decision to remove the commit history was because most of the 122
commits did not follow commit comment AND content best practices.
The ability to remove the commit history was possible because all
contributors where from the same company (IBM) making the coordination /
notification/acceptence easy. See all the gory details about the
first try to commit with history here...
https://github.com/openbmc/openbmc-test-automation/pull/1

This suite of tests will run against an OpenBMC based server. It will
run good/bad path testing against the REST interface. There are tests
that will also run ipmitool on the victim BMC too.

If you want to support a new system in to the suite you should only
have to edit two files...
data/<system>.py
tox.ini

The README.md contains details on how to setup for the first time along
with how to execute the test suite

NOTE: some test cases require tools that do not exist on the system.
Currently the ipmitool is needed and if you do not manually copy / link
it in to the tools directory some suites will fail.

show more ...