QEMU CI Test: Certificate test removed

Changes:
- Certificate test is failing on QEMU_CI test bucket.
Removing from the list.

Tested:
- NA

Change-Id: I65bbcc9602ca17da23ac53c7e027b9cab8

QEMU CI Test: Certificate test removed

Changes:
- Certificate test is failing on QEMU_CI test bucket.
Removing from the list.

Tested:
- NA

Change-Id: I65bbcc9602ca17da23ac53c7e027b9cab893799f
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

QEMU_CI: Update test list

Changes:
- Added certificate test
- Remove redundant redfish test w.r.t redfish
validator type of test.

Tested:
- Ran from sandbox

Change-Id: I380d7

QEMU_CI: Update test list

Changes:
- Added certificate test
- Remove redundant redfish test w.r.t redfish
validator type of test.

Tested:
- Ran from sandbox

Change-Id: I380d792dc525715079d4df04d7098eacb83097d6
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

QEMU_CI: skip BMC Time Test

Been dealing with intermittent fails due to this test in CI for over a
year now. There was an attempt at a fix in openbmc/bmcweb#264 but we're
still seeing intermittent f

QEMU_CI: skip BMC Time Test

Been dealing with intermittent fails due to this test in CI for over a
year now. There was an attempt at a fix in openbmc/bmcweb#264 but we're
still seeing intermittent failures.

Unfortunately, this most recent fail is happening in a way that we're
no longer collecting FFDC for the fails so there's no easy way to
debug.

CI is meant to catch regressions, but here it's catching an existing
issue and causing a lot of churn on CI. The issue is timing related and
could be QEMU specific. Because of this it has been difficult to
commit much debug resource to it.

Change-Id: I0aa0a8f3cc34caf46d727bef24e1ee3ecc3bf788
Signed-off-by: Andrew Geissler <geissonator@yahoo.com>

show more ...

Increase QEMU_CI Coverage

Add a few more test cases to the QEMU_CI coverage.

Change-Id: I6551999cf66b8295bbcc1ce7e4c253ec79cef8a0
Signed-off-by: Matt Fischer <matthew.fischer@hpe.com>

Redfish update test suite Force tags as per standard

Changes:
- Update Tags names for the test suite

Note: Refer CONTRIBUTING.md for under Tags section
documentation.

Tested:
- NA

Cha

Redfish update test suite Force tags as per standard

Changes:
- Update Tags names for the test suite

Note: Refer CONTRIBUTING.md for under Tags section
documentation.

Tested:
- NA

Change-Id: Ice5fa1a185876774d9e9bce4ff53f834b2a1f652
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Update test suite Force tags as per standard

Changes:
- Update Tags names for the test suite

Note: Refer CONTRIBUTING.md for under Tags section
documentation.

Tested:
- NA

Change-Id:

Update test suite Force tags as per standard

Changes:
- Update Tags names for the test suite

Note: Refer CONTRIBUTING.md for under Tags section
documentation.

Tested:
- NA

Change-Id: Ica7afcdfead250c98f636b5442cbf4f68849fc67
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

HW_CI_NETWORK: Test bucket for Network stability

Changes:
- Added basic Network test cases

Tested:
- Ran with latest upstream master build on Witherspoon

Change-Id: I6f734e9502459cb188212e

HW_CI_NETWORK: Test bucket for Network stability

Changes:
- Added basic Network test cases

Tested:
- Ran with latest upstream master build on Witherspoon

Change-Id: I6f734e9502459cb188212e032baaf57710b745b0
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

test_lists: use long options

Short options are good for interactive shells to cut down on typing.
Use long options elsewhere to improve comprehension for new robot users.

Signed-off-by: Brad Bishop

test_lists: use long options

Short options are good for interactive shells to cut down on typing.
Use long options elsewhere to improve comprehension for new robot users.

Signed-off-by: Brad Bishop <bradleyb@fuzziesquirrel.com>
Change-Id: I203fe3511c6af3825bf1440cff97881ca27f4bcd

show more ...

Fix typo in tags used in test suites

Resolves openbmc/openbmc-test-automation#2149

Change-Id: I0d05267743acb4ee5283717a253cb11665659920
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

Update QEMU_CI test and remove comments in JSON files

Change-Id: I8060455347b702278370632263426fc2971c8f77
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

Update QEMU test list

Changes to QEMU is same as that of test_lists/HW_CI without
power on/off and BMC reset.

Change-Id: If9f762c525662352c55fe53d2daefbcc2a4bb1f4
Signed-off-by: George Keishing <gk

Update QEMU test list

Changes to QEMU is same as that of test_lists/HW_CI without
power on/off and BMC reset.

Change-Id: If9f762c525662352c55fe53d2daefbcc2a4bb1f4
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Remove GET_Redfish_Hypermedia_Without_Login tag from test list

Change-Id: I41e6d67470ddf8192576a188825803557ef54c30
Refer: https://gerrit.openbmc-project.xyz/c/openbmc/openbmc/+/46057
Signed-off-by:

Remove GET_Redfish_Hypermedia_Without_Login tag from test list

Change-Id: I41e6d67470ddf8192576a188825803557ef54c30
Refer: https://gerrit.openbmc-project.xyz/c/openbmc/openbmc/+/46057
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Fix dump verify logic and enable in HW CI list

Change-Id: I70d674c099da3a7be72fa87db06a44054cf2b0c6
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

Disable dump check in HW_CI temporarily

Change-Id: I80b173854c225d5061b35a5429859f80fce6843c
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

Update HW CI list and others

Changes:
- Replace existing with new test in HW_CI, HW_CI_DEV and CT_basic_run
- Move suite to new location redfish/test_xit.robot

Change-Id: Iab83e36cca022e6

Update HW CI list and others

Changes:
- Replace existing with new test in HW_CI, HW_CI_DEV and CT_basic_run
- Move suite to new location redfish/test_xit.robot

Change-Id: Iab83e36cca022e6431c264b83b81673c08a7af97
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Remove Verify_Redfish_BMC_Manager_Properties

Signed-off-by: Michael Shepos <shepos@us.ibm.com>
Change-Id: Iaec76bbfa26483bf042642bb55ec4024737a9080

Development test HW CI

Changes:
- Added robot user variable parameter to skip OCC and
Power check, by default enabled.
- New HW_CI_DEV list.

Usage:
robot -v OPENBMC_HOST:xx.xx

Development test HW CI

Changes:
- Added robot user variable parameter to skip OCC and
Power check, by default enabled.
- New HW_CI_DEV list.

Usage:
robot -v OPENBMC_HOST:xx.xx.xx.xx
-v additional_power_check:0 -v check_performance:0
-v BOOT_TABLE_PATH:data/boot_table_redfish.json
--argumentfile test_list/HW_CI_DEV redfish/ ipmi/ tests/

Change-Id: I1288a8f9cfb057c00342cfa414b5ec9ca861e7b7
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Check for application failure on HW_CI group test at the end

Changes:
- Add a code check for application failure.
- Update tag in test_lists/HW_CI
- Update tag in test_lists/CT_basic_run

Check for application failure on HW_CI group test at the end

Changes:
- Add a code check for application failure.
- Update tag in test_lists/HW_CI
- Update tag in test_lists/CT_basic_run

Change-Id: Ic7a3d2de9eb2fb6709858b282a2c66910d031a53
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Enable hardware CI for Vue GUI

What changes are made:
- Added following basic test cases for Vue GUI testing:
- Verify Header Text
- Verify GUI Logout
- Vue GUI tests are add

Enable hardware CI for Vue GUI

What changes are made:
- Added following basic test cases for Vue GUI testing:
- Verify Header Text
- Verify GUI Logout
- Vue GUI tests are added in new "gui_test" folder
- Added new file WEBUI_CI to run hardware CI for Vue GUI

Change-Id: Id341a5984b3e5c91f38e41017dae24deeee0b738
Signed-off-by: Rahul Maheshwari <rahulmaheshwari@in.ibm.com>

show more ...

Remove TODO comments which no longer valid or going to worked on

Change-Id: Ic25bcc44c3f14e12fa69a18bcfc7f9bfe668a8ed
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

Remove Date time test from HW CI list

Refernce:
https://gerrit.openbmc-project.xyz/#/c/openbmc/meta-phosphor/+/32017/

Change-Id: I189a79511562157460578eafb35f5231cfc691f1
Signed-off-by: George Keis

Remove Date time test from HW CI list

Refernce:
https://gerrit.openbmc-project.xyz/#/c/openbmc/meta-phosphor/+/32017/

Change-Id: I189a79511562157460578eafb35f5231cfc691f1
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Update HW_CI test list

Changes:
- Remove REST GET response check since redfish use cases ideally takes
care of them and non of them are ideally used in GUI or other which
impacts the

Update HW_CI test list

Changes:
- Remove REST GET response check since redfish use cases ideally takes
care of them and non of them are ideally used in GUI or other which
impacts the user.
- Added new use cases to expand the scope of test.

Change-Id: I39f63a6b7272f85770c899c0b45b9c20d42600f7
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Update regression test list

Change-Id: I15e5891381189bf7242582c2528f81be2326508e
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

Update Witherspoon regression list

Change-Id: I970971fe89635dab778d8868148c4bc725bff819
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

Replacing Verify_Refresh_Button with another test

Removing Verify_Refresh_Button test as it doing many operations.
And it not a candidate for CI.

Change-Id: I44e5434bcf00176cd7fd8b7044a83c5637f1b6a

Replacing Verify_Refresh_Button with another test

Removing Verify_Refresh_Button test as it doing many operations.
And it not a candidate for CI.

Change-Id: I44e5434bcf00176cd7fd8b7044a83c5637f1b6ac
Signed-off-by: Rahul Maheshwari <rahulmaheshwari@in.ibm.com>

show more ...