Switch from Force Tags to Test Tags

Force Tags is deprecated in Robot 7.0 and will eventually
warn and then after that stop working. Test Tags performs
the same function per docs.

Change-Id: I7cf30

Switch from Force Tags to Test Tags

Force Tags is deprecated in Robot 7.0 and will eventually
warn and then after that stop working. Test Tags performs
the same function per docs.

Change-Id: I7cf305754b247b995a05d8da3b9de9ed613ecae2
Signed-off-by: Matt Fischer <matthew.fischer@hpe.com>

show more ...

Robot Framework 7.0 changes

Update robot code syntax overall in the repo

Changes:
- Update the requirement.txt package version for robot
- The '[Return]' setting is deprecated.
Use the

Robot Framework 7.0 changes

Update robot code syntax overall in the repo

Changes:
- Update the requirement.txt package version for robot
- The '[Return]' setting is deprecated.
Use the 'RETURN' statement instead.
- Singular section headers like '*** Test Case ***'
are deprecated. Use plural format like
'*** Test Cases ***' instead.
- Singular section headers like '*** Variable ***'
are deprecated

Tested:
- Ran from sandbox with the version
$ robot --version
Robot Framework 7.0 (Python 3.10.12 on linux)

and also tested on latest python version

Robot Framework 7.0 (Python 3.11.9 on linux)

Change-Id: I54e85f9d799556c63b9a39f79483f83e9b980768
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Move TC from the error log suite to the IPMI suite

Changes:
   - Move TC Verify IPMI SEL Event Entries from
test_event_logging.robot to test_ipmi_sel.robot
   - Replace count with count + 1

Move TC from the error log suite to the IPMI suite

Changes:
   - Move TC Verify IPMI SEL Event Entries from
test_event_logging.robot to test_ipmi_sel.robot
   - Replace count with count + 1
- Added IPMI SEL Clear command to clear the entries

Tested:
  - Ran and tested on BMC Environment

Change-Id: Iff31d4e83ba060309174144760bbc576561684b6
Signed-off-by: Vidya-Kalasappanavar <Vidya.Kalasappanavar@ibm.com>

show more ...

Fix errorlog automation testcase

Changes: - Modified entry ID check for test case "Test Event
Entry Numbering Reset On Restart".

Tested: - Ran the testcase from sandbox successfully.

C

Fix errorlog automation testcase

Changes: - Modified entry ID check for test case "Test Event
Entry Numbering Reset On Restart".

Tested: - Ran the testcase from sandbox successfully.

Change-Id: I78f644ca675dab9277e5c15bb964c2b43fbb7d98
Signed-off-by: manashsarma <manashsarma@in.ibm.com>

show more ...

Move tests from the error log suite to the IPMI suite

Changes:
- Created a new keyword
- Below test case moved to test_ipmi_sel.robot
Verify_IPMI_SEL_Event_Last_Add_Time
Delete Non-E

Move tests from the error log suite to the IPMI suite

Changes:
- Created a new keyword
- Below test case moved to test_ipmi_sel.robot
Verify_IPMI_SEL_Event_Last_Add_Time
Delete Non-Existing SEL Event Entry
Delete Invalid SEL Event Entry
- Removed above test cases from test_event_logging.robot
Tested:
- Ran and tested on BMC Environment.

Change-Id: I5db573687ed551e533c6b641ea1891da90e8d0d6
Signed-off-by: Vidya-Kalasappanavar <Vidya.Kalasappanavar@ibm.com>

show more ...

Set system, chassis, and bmc as global variables

Changes:
- Add SYSTEM_ID as a global variable and set to default value system
- Replace redfish/v1/Systems/system to redfish/v1/Systems/SYSTEM_ID

Set system, chassis, and bmc as global variables

Changes:
- Add SYSTEM_ID as a global variable and set to default value system
- Replace redfish/v1/Systems/system to redfish/v1/Systems/SYSTEM_ID
- Replace redfish/v1/Chassis/chassis to redfish/v1/Chassis/CHASSIS_ID
- Replace redfish/v1/Managers/bmc to redfish/v1/Managers/MANAGER_ID

Tested:
- Tested on sandbox with the changes with sample test run with
sample test ID runs
1. without SYSTEM_ID provided
2. with -v SYSTEM_ID:system1
3. with export SYSTEM_ID=""
3. with export SYSTEM_ID="system2"

Change-Id: Ifc412b20038cef1eba632caaa6c300be328259bd
Signed-off-by: Wilson Suen <wilsons@supermicro.com>
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Redfish event update test suite Force tags as per standard

Changes:
- Update Tags names for the test suite

Note: Refer CONTRIBUTING.md for under Tags section
documentation.

Tested:
-

Redfish event update test suite Force tags as per standard

Changes:
- Update Tags names for the test suite

Note: Refer CONTRIBUTING.md for under Tags section
documentation.

Tested:
- NA

Change-Id: Id5e8b50b93c3af11390ee8c5b7aa6ef865a6f6dc
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Redfish update test suite Force tags as per standard

Changes:
- Update Tags names for the test suite

Note: Refer CONTRIBUTING.md for under Tags section
documentation.

Tested:
- NA

Cha

Redfish update test suite Force tags as per standard

Changes:
- Update Tags names for the test suite

Note: Refer CONTRIBUTING.md for under Tags section
documentation.

Tested:
- NA

Change-Id: Ice5fa1a185876774d9e9bce4ff53f834b2a1f652
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Fix for the error log testcases
Changes:

- Removed the milliseconds from timestamp
Tested:

- Ran testcase successfully from sandbox

Change-Id: I9e5da666ace6e9e518c748f92d3dd7f54380b30b
Sig

Fix for the error log testcases
Changes:

- Removed the milliseconds from timestamp
Tested:

- Ran testcase successfully from sandbox

Change-Id: I9e5da666ace6e9e518c748f92d3dd7f54380b30b
Signed-off-by: dnirmala <dhurgam.nirmala1@ibm.com>

show more ...

Added new testcase to verify default status of error log.

Changes:

-Added new testcase
Verify_Default_Value_Of_Resolved_Field_Is_False_For_An_Error_Log_Via_Redfish
Tested:
- Ran above

Added new testcase to verify default status of error log.

Changes:

-Added new testcase
Verify_Default_Value_Of_Resolved_Field_Is_False_For_An_Error_Log_Via_Redfish
Tested:
- Ran above test case from sandbox successfully.

Change-Id: Ie7618bdc820029c1bdc1828133b9ba71f5262792
Signed-off-by: dnirmala <dhurgam.nirmala1@ibm.com>

show more ...

Watchdog timer test case update

Changes:
- Add new logic to set the watchdog timer
- Replace legacy REST code with Redfish
- Add new keyword to check boot and host state
- Update

Watchdog timer test case update

Changes:
- Add new logic to set the watchdog timer
- Replace legacy REST code with Redfish
- Add new keyword to check boot and host state
- Update test logic and documentation fixes.

Tested:
robot -v OPENBMC_HOST:xx.xx.xx.xx
--include Verify_Watchdog_Timedout_Event
redfish/systems/eventlog/test_event_logging.robot

Change-Id: I99b7e6f6fc96f90b4e15e1e104d0e0ab991f7ec3
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Robotframework request package upgrade changes

Current working package version
robotframework-requests 0.7.2

To Test:
pip3 install robotframework-requests -U
or

Robotframework request package upgrade changes

Current working package version
robotframework-requests 0.7.2

To Test:
pip3 install robotframework-requests -U
or
# Once this commit is merged.
pip3 install -r requirements.txt

Version latest:
robotframework-requests 0.9.3

Refer Documentation:
https://marketsquare.github.io/robotframework-requests/doc/RequestsLibrary.html

What is not changed:
- The test cases under directory tests/ is not modified and is
deprecated but you can continue using it with older package
and configuration using

git clone -b v3.0-stable https://github.com/openbmc/openbmc-test-automation

Tested:
Upstream HW_CI test list, firmware code update and few other
test suite like ipmi, certificate, dumps, ffdc and redfish
test suites.

Note: I have not tested end to end, so it is likely there could be
grey areas where it could fail but should be minor w.r.t
response data format.

Resolves: openbmc/openbmc-test-automation#2105

Change-Id: Ie03b25ff88948bcccb09e9d82f8da86e28c92697
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Add uptime tracing for event logging create on BMC

Changes:
- Added uptime command before and after the logging binary
is executed. This is more for debugging and knowing the
load it g

Add uptime tracing for event logging create on BMC

Changes:
- Added uptime command before and after the logging binary
is executed. This is more for debugging and knowing the
load it generated during those window

Tested:
Ran successfully
robot -v OPENBMC_HOST:xx.xx.xx.xx
--include Verify_Event_Logs_Capping
--include Test_Event_Log_Wrapping
-v DEBUG_TARBALL_PATH:obmc-phosphor-debug-tarball-witherspoon.tar.xz
redfish/systems/eventlog/test_event_logging.robot

Change-Id: I451ff44c361987e3c7b53248c0d3867e17e2e0c2
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

systems: eventlog: fix Host state cannot match expected match_state

Symptom:
Boot failures exceed the boot failure threshold. The states no longer match.
state:
[boot_progress]:

systems: eventlog: fix Host state cannot match expected match_state

Symptom:
Boot failures exceed the boot failure threshold. The states no longer match.
state:
[boot_progress]: Unspecified
[host]: Running
[operating_system]: Inactive
match_state:
[boot_progress]: FW Progress, Starting OS|OSStart
[operating_system]: Standby
[host]: Running

Root cause:
In test "test_event_logging.robot" that use "Trigger Host Watchdog Error" cause
Host be rebooted by watchdog. However, in "test_led_indicator_asserted.robot"
that will call "Redfish Power ${pre_req_state}" to keep Host at previous state
then perform the test. Sometimes, this results the host report is not be booted
even if it actually is. Eventually, cause test case confusion then return error

Solution:
For fixing this false alarm wait few seconds for Host be booted properly

Tested:
Run robot test redfish/systems/eventlog/test_event_logging.robot then
run redfish/systems/test_led_indicator_asserted.robot continuity

Signed-off-by: Tim Lee <timlee660101@gmail.com>
Change-Id: I2f7e93df9b430cc889d8f0b09ac86b9acaf039df

show more ...

Update subscription test suite

Changes:
- Remove test checking if service enable and add in test setup
- Update documentation and add default remote dummy server IP

This test suite would be

Update subscription test suite

Changes:
- Remove test checking if service enable and add in test setup
- Update documentation and add default remote dummy server IP

This test suite would be use to further write newer event notification
use cases.

Resolves openbmc/openbmc-test-automation#2162

Change-Id: I506668ae81d108ffe4e7ad7d805b860a7fb70a35
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Added power off at start to avoid error logs getting logged during boot

Change-Id: Ida3c72b05bfc73bd725970adbd9baabefd3def7c
Signed-off-by: Rahul Maheshwari <rahulmaheshwari@in.ibm.com>

Removed REST usage from Create_Two_Test_Event_Logs_And_Delete_One test

Change-Id: Ifbab4edcc94498a7fbfe240f41c18aa8a43494a5
Signed-off-by: Rahul Maheshwari <rahulmaheshwari@in.ibm.com>

redfish: systems: eventlog: fix "Verify Subscribe An Event" test failed

Symptom:
"Verify Subscribe An Event" test item in test_event_service.robotgot failed.

Root cause:
From test report that error

redfish: systems: eventlog: fix "Verify Subscribe An Event" test failed

Symptom:
"Verify Subscribe An Event" test item in test_event_service.robotgot failed.

Root cause:
From test report that error message is
Key HttpHeaders: [] != [{'Content': 'application/json'}]
The HttpHeaders content is not same as between ${payload} and ${resp.dict}
Thus, cause this test item got failed.

However, we found that bmcweb seems change the HttpHeaders response as NULL
in this commit "Nullify HttpHeaders per the specification".
Thus, the response "HttpHeaders": [] that didn't match payload Content in test item.

More detail can refer to below bmcweb commit:
Per the definition of HttpHeaders in the schema "This object shall be
null or an empty array in responses." This commit does as the
specification commands.
https://github.com/openbmc/bmcweb/commit/ad22fefecaf7988fd7072dc71042efbf86fc5162

Solution:
Correct payload content to match bmcweb current design.

Tested:
Run robot "Verify Subscribe An Event" of test_event_service.robot

Signed-off-by: Tim Lee <timlee660101@gmail.com>
Change-Id: Id877bba7093508209ed2eb486ced775c8c26f1a7

show more ...

Removed resolve field test case as it uses older xyz path

Same test case is already impemented using Redfish -
Verify_Setting_Error_Log_As_Resolved

Change-Id: I0545aba1fed87d411a6d70070088fa760b3db

Removed resolve field test case as it uses older xyz path

Same test case is already impemented using Redfish -
Verify_Setting_Error_Log_As_Resolved

Change-Id: I0545aba1fed87d411a6d70070088fa760b3db205
Signed-off-by: Rahul Maheshwari <rahulmaheshwari@in.ibm.com>

show more ...

redfish: systems: event service: corrects RegistryPrefixes list

The list defineded in the bmcweb: Base, OpenBMC, TaskEvent
https://github.com/openbmc/bmcweb/blob/0588a3b929b2a88784db2f3dcac04d69260f

redfish: systems: event service: corrects RegistryPrefixes list

The list defineded in the bmcweb: Base, OpenBMC, TaskEvent
https://github.com/openbmc/bmcweb/blob/0588a3b929b2a88784db2f3dcac04d69260fb585/redfish-core/lib/event_service.hpp#L25

Signed-off-by: Joseph Liu <kwliu@nuvoton.com>
Signed-off-by: Tim Lee <timlee660101@gmail.com>
Change-Id: I22e0a5edddcb9682365fba80ccf71f66f7c40217

show more ...

Added test to update resolved field of error log

Change-Id: I925b6ca4a56f6c42217dc7f1df90115863ff6474
Signed-off-by: Rahul Maheshwari <rahulmaheshwari@in.ibm.com>

Delete Redfish error log and verify

Change-Id: Id21ead55f5c1882b63d054896aab4f369330d5c1
Signed-off-by: Rahul Maheshwari <rahulmaheshwari@in.ibm.com>

Fix typo tagging name and documentation

Change-Id: Ifb06b3791abbb8759b9210fb32cb4e13fe2d4ff2
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

Added test to test event service

Added test to test event service.
https://github.com/openbmc/docs/blob/d6c21a9a4e8dca63ba0774afb883fa73fca31f73/designs/redfish-eventservice.md

Signed-off-by: Tony

Added test to test event service

Added test to test event service.
https://github.com/openbmc/docs/blob/d6c21a9a4e8dca63ba0774afb883fa73fca31f73/designs/redfish-eventservice.md

Signed-off-by: Tony Lee <tony.lee@quantatw.com>
Change-Id: I1478bb9146a065ce67bb8e06553a3d6bbcbd6e0a

show more ...

Update event logging attribute string

Change-Id: Ibaf725b62f09ed35dd0039779dae4ef4b2ae9e3b
Signed-off-by: George Keishing <gkeishin@in.ibm.com>