Key Error exception during login

Changes:
- Add exception handling for Key error.
A session creation error usually causes this
exception due to invalid and empty credentials.
R

Key Error exception during login

Changes:
- Add exception handling for Key error.
A session creation error usually causes this
exception due to invalid and empty credentials.
Raise a custom exception to handle gracefully
such an exception during login failure.
- Add back the removed test case failing in QEMU_CI

Tested:
- Tested on CI infrastructure, Jenkins, and
local setup environment

Change-Id: I55d43ae6c62dd88faa700d895683e58c9279e6bc
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Create input argument instead of default value

Changes:
Remove default value and provide input argument

Tested:
NA

Change-Id: I662850a59f3d844502829dbb9d04c9e56f6e37a8
Signed-off-by: Sridevi Rames

Create input argument instead of default value

Changes:
Remove default value and provide input argument

Tested:
NA

Change-Id: I662850a59f3d844502829dbb9d04c9e56f6e37a8
Signed-off-by: Sridevi Ramesh <sridevra@in.ibm.com>

show more ...

Update QEMU_CI test bucket list

Changes:
- Removed test Redfish_Login_With_Invalid_Credentials
as this is blocking the QEMU CI test run.
On comparison testing with HW Witherspoon we

Update QEMU_CI test bucket list

Changes:
- Removed test Redfish_Login_With_Invalid_Credentials
as this is blocking the QEMU CI test run.
On comparison testing with HW Witherspoon we
were able to run it clean but on QEMU we could not
identify the root cause. This is a bad path testing,
removing from QEMU list.

Tested:
- NA

Change-Id: I449b59625fcbca69f2e533ef9e1e460f6a389987
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

QEMU CI Test: Certificate test removed

Changes:
- Certificate test is failing on QEMU_CI test bucket.
Removing from the list.

Tested:
- NA

Change-Id: I65bbcc9602ca17da23ac53c7e027b9cab8

QEMU CI Test: Certificate test removed

Changes:
- Certificate test is failing on QEMU_CI test bucket.
Removing from the list.

Tested:
- NA

Change-Id: I65bbcc9602ca17da23ac53c7e027b9cab893799f
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

QEMU_CI: Update test list

Changes:
- Added certificate test
- Remove redundant redfish test w.r.t redfish
validator type of test.

Tested:
- Ran from sandbox

Change-Id: I380d7

QEMU_CI: Update test list

Changes:
- Added certificate test
- Remove redundant redfish test w.r.t redfish
validator type of test.

Tested:
- Ran from sandbox

Change-Id: I380d792dc525715079d4df04d7098eacb83097d6
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

QEMU_CI: skip BMC Time Test

Been dealing with intermittent fails due to this test in CI for over a
year now. There was an attempt at a fix in openbmc/bmcweb#264 but we're
still seeing intermittent f

QEMU_CI: skip BMC Time Test

Been dealing with intermittent fails due to this test in CI for over a
year now. There was an attempt at a fix in openbmc/bmcweb#264 but we're
still seeing intermittent failures.

Unfortunately, this most recent fail is happening in a way that we're
no longer collecting FFDC for the fails so there's no easy way to
debug.

CI is meant to catch regressions, but here it's catching an existing
issue and causing a lot of churn on CI. The issue is timing related and
could be QEMU specific. Because of this it has been difficult to
commit much debug resource to it.

Change-Id: I0aa0a8f3cc34caf46d727bef24e1ee3ecc3bf788
Signed-off-by: Andrew Geissler <geissonator@yahoo.com>

show more ...

Increase QEMU_CI Coverage

Add a few more test cases to the QEMU_CI coverage.

Change-Id: I6551999cf66b8295bbcc1ce7e4c253ec79cef8a0
Signed-off-by: Matt Fischer <matthew.fischer@hpe.com>

Redfish update test suite Force tags as per standard

Changes:
- Update Tags names for the test suite

Note: Refer CONTRIBUTING.md for under Tags section
documentation.

Tested:
- NA

Cha

Redfish update test suite Force tags as per standard

Changes:
- Update Tags names for the test suite

Note: Refer CONTRIBUTING.md for under Tags section
documentation.

Tested:
- NA

Change-Id: Ice5fa1a185876774d9e9bce4ff53f834b2a1f652
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Update test suite Force tags as per standard

Changes:
- Update Tags names for the test suite

Note: Refer CONTRIBUTING.md for under Tags section
documentation.

Tested:
- NA

Change-Id:

Update test suite Force tags as per standard

Changes:
- Update Tags names for the test suite

Note: Refer CONTRIBUTING.md for under Tags section
documentation.

Tested:
- NA

Change-Id: Ica7afcdfead250c98f636b5442cbf4f68849fc67
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

HW_CI_NETWORK: Test bucket for Network stability

Changes:
- Added basic Network test cases

Tested:
- Ran with latest upstream master build on Witherspoon

Change-Id: I6f734e9502459cb188212e

HW_CI_NETWORK: Test bucket for Network stability

Changes:
- Added basic Network test cases

Tested:
- Ran with latest upstream master build on Witherspoon

Change-Id: I6f734e9502459cb188212e032baaf57710b745b0
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

test_lists: use long options

Short options are good for interactive shells to cut down on typing.
Use long options elsewhere to improve comprehension for new robot users.

Signed-off-by: Brad Bishop

test_lists: use long options

Short options are good for interactive shells to cut down on typing.
Use long options elsewhere to improve comprehension for new robot users.

Signed-off-by: Brad Bishop <bradleyb@fuzziesquirrel.com>
Change-Id: I203fe3511c6af3825bf1440cff97881ca27f4bcd

show more ...

Fix typo in tags used in test suites

Resolves openbmc/openbmc-test-automation#2149

Change-Id: I0d05267743acb4ee5283717a253cb11665659920
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

Update QEMU_CI test and remove comments in JSON files

Change-Id: I8060455347b702278370632263426fc2971c8f77
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

Update QEMU test list

Changes to QEMU is same as that of test_lists/HW_CI without
power on/off and BMC reset.

Change-Id: If9f762c525662352c55fe53d2daefbcc2a4bb1f4
Signed-off-by: George Keishing <gk

Update QEMU test list

Changes to QEMU is same as that of test_lists/HW_CI without
power on/off and BMC reset.

Change-Id: If9f762c525662352c55fe53d2daefbcc2a4bb1f4
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Remove GET_Redfish_Hypermedia_Without_Login tag from test list

Change-Id: I41e6d67470ddf8192576a188825803557ef54c30
Refer: https://gerrit.openbmc-project.xyz/c/openbmc/openbmc/+/46057
Signed-off-by:

Remove GET_Redfish_Hypermedia_Without_Login tag from test list

Change-Id: I41e6d67470ddf8192576a188825803557ef54c30
Refer: https://gerrit.openbmc-project.xyz/c/openbmc/openbmc/+/46057
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Fix dump verify logic and enable in HW CI list

Change-Id: I70d674c099da3a7be72fa87db06a44054cf2b0c6
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

Disable dump check in HW_CI temporarily

Change-Id: I80b173854c225d5061b35a5429859f80fce6843c
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

Update HW CI list and others

Changes:
- Replace existing with new test in HW_CI, HW_CI_DEV and CT_basic_run
- Move suite to new location redfish/test_xit.robot

Change-Id: Iab83e36cca022e6

Update HW CI list and others

Changes:
- Replace existing with new test in HW_CI, HW_CI_DEV and CT_basic_run
- Move suite to new location redfish/test_xit.robot

Change-Id: Iab83e36cca022e6431c264b83b81673c08a7af97
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Remove Verify_Redfish_BMC_Manager_Properties

Signed-off-by: Michael Shepos <shepos@us.ibm.com>
Change-Id: Iaec76bbfa26483bf042642bb55ec4024737a9080

Development test HW CI

Changes:
- Added robot user variable parameter to skip OCC and
Power check, by default enabled.
- New HW_CI_DEV list.

Usage:
robot -v OPENBMC_HOST:xx.xx

Development test HW CI

Changes:
- Added robot user variable parameter to skip OCC and
Power check, by default enabled.
- New HW_CI_DEV list.

Usage:
robot -v OPENBMC_HOST:xx.xx.xx.xx
-v additional_power_check:0 -v check_performance:0
-v BOOT_TABLE_PATH:data/boot_table_redfish.json
--argumentfile test_list/HW_CI_DEV redfish/ ipmi/ tests/

Change-Id: I1288a8f9cfb057c00342cfa414b5ec9ca861e7b7
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Check for application failure on HW_CI group test at the end

Changes:
- Add a code check for application failure.
- Update tag in test_lists/HW_CI
- Update tag in test_lists/CT_basic_run

Check for application failure on HW_CI group test at the end

Changes:
- Add a code check for application failure.
- Update tag in test_lists/HW_CI
- Update tag in test_lists/CT_basic_run

Change-Id: Ic7a3d2de9eb2fb6709858b282a2c66910d031a53
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Enable hardware CI for Vue GUI

What changes are made:
- Added following basic test cases for Vue GUI testing:
- Verify Header Text
- Verify GUI Logout
- Vue GUI tests are add

Enable hardware CI for Vue GUI

What changes are made:
- Added following basic test cases for Vue GUI testing:
- Verify Header Text
- Verify GUI Logout
- Vue GUI tests are added in new "gui_test" folder
- Added new file WEBUI_CI to run hardware CI for Vue GUI

Change-Id: Id341a5984b3e5c91f38e41017dae24deeee0b738
Signed-off-by: Rahul Maheshwari <rahulmaheshwari@in.ibm.com>

show more ...

Remove TODO comments which no longer valid or going to worked on

Change-Id: Ic25bcc44c3f14e12fa69a18bcfc7f9bfe668a8ed
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

Remove Date time test from HW CI list

Refernce:
https://gerrit.openbmc-project.xyz/#/c/openbmc/meta-phosphor/+/32017/

Change-Id: I189a79511562157460578eafb35f5231cfc691f1
Signed-off-by: George Keis

Remove Date time test from HW CI list

Refernce:
https://gerrit.openbmc-project.xyz/#/c/openbmc/meta-phosphor/+/32017/

Change-Id: I189a79511562157460578eafb35f5231cfc691f1
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Update HW_CI test list

Changes:
- Remove REST GET response check since redfish use cases ideally takes
care of them and non of them are ideally used in GUI or other which
impacts the

Update HW_CI test list

Changes:
- Remove REST GET response check since redfish use cases ideally takes
care of them and non of them are ideally used in GUI or other which
impacts the user.
- Added new use cases to expand the scope of test.

Change-Id: I39f63a6b7272f85770c899c0b45b9c20d42600f7
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...