Update QEMU_CI test bucket list

Changes:
- Removed test Redfish_Login_With_Invalid_Credentials
as this is blocking the QEMU CI test run.
On comparison testing with HW Witherspoon we

Update QEMU_CI test bucket list

Changes:
- Removed test Redfish_Login_With_Invalid_Credentials
as this is blocking the QEMU CI test run.
On comparison testing with HW Witherspoon we
were able to run it clean but on QEMU we could not
identify the root cause. This is a bad path testing,
removing from QEMU list.

Tested:
- NA

Change-Id: I449b59625fcbca69f2e533ef9e1e460f6a389987
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

QEMU CI Test: Certificate test removed

Changes:
- Certificate test is failing on QEMU_CI test bucket.
Removing from the list.

Tested:
- NA

Change-Id: I65bbcc9602ca17da23ac53c7e027b9cab8

QEMU CI Test: Certificate test removed

Changes:
- Certificate test is failing on QEMU_CI test bucket.
Removing from the list.

Tested:
- NA

Change-Id: I65bbcc9602ca17da23ac53c7e027b9cab893799f
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

QEMU_CI: Update test list

Changes:
- Added certificate test
- Remove redundant redfish test w.r.t redfish
validator type of test.

Tested:
- Ran from sandbox

Change-Id: I380d7

QEMU_CI: Update test list

Changes:
- Added certificate test
- Remove redundant redfish test w.r.t redfish
validator type of test.

Tested:
- Ran from sandbox

Change-Id: I380d792dc525715079d4df04d7098eacb83097d6
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

QEMU_CI: skip BMC Time Test

Been dealing with intermittent fails due to this test in CI for over a
year now. There was an attempt at a fix in openbmc/bmcweb#264 but we're
still seeing intermittent f

QEMU_CI: skip BMC Time Test

Been dealing with intermittent fails due to this test in CI for over a
year now. There was an attempt at a fix in openbmc/bmcweb#264 but we're
still seeing intermittent failures.

Unfortunately, this most recent fail is happening in a way that we're
no longer collecting FFDC for the fails so there's no easy way to
debug.

CI is meant to catch regressions, but here it's catching an existing
issue and causing a lot of churn on CI. The issue is timing related and
could be QEMU specific. Because of this it has been difficult to
commit much debug resource to it.

Change-Id: I0aa0a8f3cc34caf46d727bef24e1ee3ecc3bf788
Signed-off-by: Andrew Geissler <geissonator@yahoo.com>

show more ...

Increase QEMU_CI Coverage

Add a few more test cases to the QEMU_CI coverage.

Change-Id: I6551999cf66b8295bbcc1ce7e4c253ec79cef8a0
Signed-off-by: Matt Fischer <matthew.fischer@hpe.com>

test_lists: use long options

Short options are good for interactive shells to cut down on typing.
Use long options elsewhere to improve comprehension for new robot users.

Signed-off-by: Brad Bishop

test_lists: use long options

Short options are good for interactive shells to cut down on typing.
Use long options elsewhere to improve comprehension for new robot users.

Signed-off-by: Brad Bishop <bradleyb@fuzziesquirrel.com>
Change-Id: I203fe3511c6af3825bf1440cff97881ca27f4bcd

show more ...

Update QEMU_CI test and remove comments in JSON files

Change-Id: I8060455347b702278370632263426fc2971c8f77
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

Update QEMU test list

Changes to QEMU is same as that of test_lists/HW_CI without
power on/off and BMC reset.

Change-Id: If9f762c525662352c55fe53d2daefbcc2a4bb1f4
Signed-off-by: George Keishing <gk

Update QEMU test list

Changes to QEMU is same as that of test_lists/HW_CI without
power on/off and BMC reset.

Change-Id: If9f762c525662352c55fe53d2daefbcc2a4bb1f4
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Revert "REST post response compliant test"

This reverts commit 02e8965896bd56e20569e2d0fbd6db5f107cf067.

This caused a failure in our QEMU run:
"500 != 200"
https://openpower.xyz/job/openbmc-test-q

Revert "REST post response compliant test"

This reverts commit 02e8965896bd56e20569e2d0fbd6db5f107cf067.

This caused a failure in our QEMU run:
"500 != 200"
https://openpower.xyz/job/openbmc-test-qemu-ci/2025/robot/report/log.html#s1-s3-t8

Change-Id: I9ba6613fae25619c412e4428f9d89a1bce4260a3
Signed-off-by: Andrew Geissler <geissonator@yahoo.com>

show more ...

REST post response compliant test

Changes:
- Replace older logic with new "Post" gard clear.

Resolves openbmc/openbmc-test-automation#1330

Change-Id: I35925900c726f8ad1bf027b4967df68377d1f104

REST post response compliant test

Changes:
- Replace older logic with new "Post" gard clear.

Resolves openbmc/openbmc-test-automation#1330

Change-Id: I35925900c726f8ad1bf027b4967df68377d1f104
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Remove REST post tags from include HW and QEMU list

Change-Id: Ib392cf4cb87ddf9ea2ce7d30753f6761e0b03742
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

Add check to wait for BMC standby

This extra check is for QEMU use case when the simulator
is getting started. The check won't be problem for HW
system but a helper for simulator to wait till it boo

Add check to wait for BMC standby

This extra check is for QEMU use case when the simulator
is getting started. The check won't be problem for HW
system but a helper for simulator to wait till it boots up.

Change-Id: Ifb82a99f2a41c09e79d980cd39284157ab2eb802
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Update QEMU CI to do basic validation

QEMU CI only gets to ready state so update tests
to reflect that

Change-Id: Ifca2f2afdee1914902f87899299444d2e0675aa6
Signed-off-by: Andrew Geissler <geissonat

Update QEMU CI to do basic validation

QEMU CI only gets to ready state so update tests
to reflect that

Change-Id: Ifca2f2afdee1914902f87899299444d2e0675aa6
Signed-off-by: Andrew Geissler <geissonator@yahoo.com>

show more ...

Duplicate HW_CI test list to QEMU_CI

This commit extends the CI test bucket by creating a list of tests to
run during a QEMU CI run. This list begins with the same content as the
existing HW_CI, but

Duplicate HW_CI test list to QEMU_CI

This commit extends the CI test bucket by creating a list of tests to
run during a QEMU CI run. This list begins with the same content as the
existing HW_CI, but could diverge in the future as needed.

Resolves openbmc/openbmc#2682

Change-Id: I8cf5911d196effcbdc5f6897aefb5c5c3f3f0295
Signed-off-by: Michael Tritz <mtritz@us.ibm.com>

show more ...