Tests for Downloading Image onto the BMC

- Upload images via REST
- Upload images via TFTP

Resolves openbmc/openbmc-test-automation#510

Change-Id: Id55f12d0d0354024c57ca929953b408e70876b40
Signed-

Tests for Downloading Image onto the BMC

- Upload images via REST
- Upload images via TFTP

Resolves openbmc/openbmc-test-automation#510

Change-Id: Id55f12d0d0354024c57ca929953b408e70876b40
Signed-off-by: Saqib Khan <khansa@us.ibm.com>

show more ...

Generate test cases documentation from robot test suites.

Resolves: openbmc/openbmc-test-automation#547

Change-Id: I5b08b57b3955f0abd5cf4b0bc2201a8651297392
Signed-off-by: Sivas SRR <sivas.srr@in.i

Generate test cases documentation from robot test suites.

Resolves: openbmc/openbmc-test-automation#547

Change-Id: I5b08b57b3955f0abd5cf4b0bc2201a8651297392
Signed-off-by: Sivas SRR <sivas.srr@in.ibm.com>

show more ...

Enable debug tarball on BMC

Two aspects of this change are:

Code update:
- Install debug tarball post code update.
- TBD: add parameter in code update jenkins job to take user

Enable debug tarball on BMC

Two aspects of this change are:

Code update:
- Install debug tarball post code update.
- TBD: add parameter in code update jenkins job to take user
input.

CT run:
- Install debug tarball part of the __init__ setup procedure.
- TBD: add parameter in CT jenkins job to take user input.
- For manual test, users need to specify the debug tarball as
an input.

Test automation code must handle respectively if it has dependencies on
debug tarball binary as part of the "Suite Setup" or "Test Setup".

Resolves openbmc/openbmc-test-automation#461

Change-Id: Idc6f976776ad57a797cff428c840c133fc41ad8a
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Update BMC MAC address

This commit adds changes to compare the MAC address of a BMC system
with input MAC address, and updates BMC MAC if it is different.

Change-Id: I9dcc46718d02977102167483452d3c

Update BMC MAC address

This commit adds changes to compare the MAC address of a BMC system
with input MAC address, and updates BMC MAC if it is different.

Change-Id: I9dcc46718d02977102167483452d3ce475f42d9a
Signed-off-by: Sunil M <sunilmam@us.ibm.com>

show more ...

OS test lib utils

Added:
- HTX tool existence check
- Booting to OS ( similar variant in utils but specific for syslib )
- OS related variable to tox run

Resolves openbmc/openbmc-test-a

OS test lib utils

Added:
- HTX tool existence check
- Booting to OS ( similar variant in utils but specific for syslib )
- OS related variable to tox run

Resolves openbmc/openbmc-test-automation#558

Change-Id: I2d8bc25de5630dfbeefef88fdf44d3752ea3c29f
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Independent tool for IBM IP info. to DUMMYIP conversion

Robotframework RUN command not providing consistent output.
Hence removed inline code to convert IPs to DUMMYIP.

Instead call new "convert_ip

Independent tool for IBM IP info. to DUMMYIP conversion

Robotframework RUN command not providing consistent output.
Hence removed inline code to convert IPs to DUMMYIP.

Instead call new "convert_ip_to_dummy" program.

Resolves: openbmc/openbmc-test-automation#455

Change-Id: Ia5e8c4f7f3ef04545d667f032add36df8a35458d
Signed-off-by: Sivas SRR <sivas.srr@in.ibm.com>

show more ...

Add milestone, closed_at, assignees to 'GitHub Issues to CSV'.

Resolves: openbmc/openbmc-test-automation#423

Change-Id: Iefc4f2d5c399531865b0c122a8fe46ab84fd114c
Signed-off-by: Sivas SRR <sivas.srr

Add milestone, closed_at, assignees to 'GitHub Issues to CSV'.

Resolves: openbmc/openbmc-test-automation#423

Change-Id: Iefc4f2d5c399531865b0c122a8fe46ab84fd114c
Signed-off-by: Sivas SRR <sivas.srr@in.ibm.com>

show more ...

Added new field "assignee" & fix password pass as argument.

Resolves openbmc/openbmc-test-automation#324

Change-Id: I425c35bcd273ea0bd920b063efe023064e9fb0c8
Signed-off-by: Sivas SRR <sivas.srr@in.

Added new field "assignee" & fix password pass as argument.

Resolves openbmc/openbmc-test-automation#324

Change-Id: I425c35bcd273ea0bd920b063efe023064e9fb0c8
Signed-off-by: Sivas SRR <sivas.srr@in.ibm.com>

show more ...

Fix metrics script version and model

With the fix merged for openbmc/openbmc-test-automation#370
updating the CT metrics script.

Resolves openbmc/openbmc-test-automation#399

Change-Id: Ieb80377251

Fix metrics script version and model

With the fix merged for openbmc/openbmc-test-automation#370
updating the CT metrics script.

Resolves openbmc/openbmc-test-automation#399

Change-Id: Ieb80377251711696706a9a14464db6f5013f91c7
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

OpenBMC test metrics

Tool to generate the test statistics from robot framework generated
output.xml file.

Adding support for the following fields:
- driver
- env
- proc
- platform_type
- test_

OpenBMC test metrics

Tool to generate the test statistics from robot framework generated
output.xml file.

Adding support for the following fields:
- driver
- env
- proc
- platform_type
- test_func_area

Resolves openbmc/openbmc-test-automation#217

Change-Id: I1eb911f041c55713182d38aba6343b7ac0540836
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Tool to get github repo issues into csv

Resolves openbmc/openbmc-test-automation#235

Change-Id: I9467459871f1b53bd11e991ebfc8f5bac25e05ea
Signed-off-by: Sivas SRR <sivas.srr@in.ibm.com>

File close operation using invalid file object

Suppose to use the file object for the the close method.
Found during testing and have corrected it.

Change-Id: I9d80dda6b6211cbeec7740f2a951eef765f97

File close operation using invalid file object

Suppose to use the file object for the the close method.
Found during testing and have corrected it.

Change-Id: I9d80dda6b6211cbeec7740f2a951eef765f9761e
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Script to generate Test result into CSV file

This script will read the user supplied output.xml of the robot test
result using robot framework API and writes the test data in a format
and creats a *

Script to generate Test result into CSV file

This script will read the user supplied output.xml of the robot test
result using robot framework API and writes the test data in a format
and creats a *.csv file to user supplied destination directory.

Resolves Partially openbmc/openbmc-test-automation#151

Change-Id: I61dcd5d7ed73c4dac70f4076d706e7f63fdc7f96
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Name changes for FFDC Test Cases: "FFDC On Test Case Fail" and "FFDC"

Changed FFDC Test Cases Names in lib/openbmc_ffdc.robot:
Changed the name of "Log FFDC" to "FFDC On Test Case Fail"
Changed the

Name changes for FFDC Test Cases: "FFDC On Test Case Fail" and "FFDC"

Changed FFDC Test Cases Names in lib/openbmc_ffdc.robot:
Changed the name of "Log FFDC" to "FFDC On Test Case Fail"
Changed the name of "Log FFDC If Test Case Failed" to "FFDC"
The names were reversed..
"Log FFDC" had a check to see if Test Case failed.
"Log FFDC If Test Case Failed" had the actual FFDC gathering.

Change-Id: I50a0cae783180c4bdbe82c94f2cd57f803a05998
Signed-off-by: Gunnar Mills <gmills@us.ibm.com>

show more ...

Loop test invoke with command passing as argument

What this fix focuses
- Enabled to run any test(s) in loop
- Updated README
- IP address removed to publish the result

Resolves openbmc/op

Loop test invoke with command passing as argument

What this fix focuses
- Enabled to run any test(s) in loop
- Updated README
- IP address removed to publish the result

Resolves openbmc/openbmc-test-automation#168

Change-Id: I75931193bdae0f140d83a941f3356521ae911c94
Signed-off-by: Sivas SRR <sivas.srr@in.ibm.com>

show more ...

Manual FFDC log collection

There is use case where a user needs to trigger FFDC collection
manually on demand. This would be helpful while doing developement
or manual test for specific use case and

Manual FFDC log collection

There is use case where a user needs to trigger FFDC collection
manually on demand. This would be helpful while doing developement
or manual test for specific use case and recreate logs.

The robot code is a wrapper to the existing FFDC infrastructure.

Resolves openbmc/openbmc-test-automation#134

Change-Id: I85f11e3f64ba94e17da1c8fbafc4fd29a87fef1f
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Enhancement : External ipmitool enablement

With this enhancement, a user can
- send IPMI command using external ipmitool
- by default dbus method will be used for ipmi command

Resolves o

Enhancement : External ipmitool enablement

With this enhancement, a user can
- send IPMI command using external ipmitool
- by default dbus method will be used for ipmi command

Resolves openbmc/openbmc-test-automation#64

Change-Id: Ibd49dc8cdaf30e32da468c8b04abbff29f673c8b
Signed-off-by: Rahul Maheshwari <rahulmaheshwari@in.ibm.com>

show more ...

Add support for host BIOS update testing

This change adds the following keywords to utils.robot:

Clear BMC Record Log
Copy PNOR to BMC
Flash PNOR
Get Flash BIOS Status
Is PNOR Flashing
Is PNOR Flas

Add support for host BIOS update testing

This change adds the following keywords to utils.robot:

Clear BMC Record Log
Copy PNOR to BMC
Flash PNOR
Get Flash BIOS Status
Is PNOR Flashing
Is PNOR Flash Done
Is System State Host Booted

This also adds test_bios_update.robot which implements a basic ipl test
using the above keywords.

Change-Id: Id544fd1cec755ef95eb7c7330751b3c2e2a2d9dc
Signed-off-by: Jay Azurin <jmazurin@us.ibm.com>

show more ...

Enable long run test with provided number of iteration

Resolves openbmc/openbmc-test-automation#46

Change-Id: I1cf53779534d1a5fe8ec9efc6f769d483e5f415c
Signed-off-by: Sivas SRR <sivas.srr@in.ibm.co

Enable long run test with provided number of iteration

Resolves openbmc/openbmc-test-automation#46

Change-Id: I1cf53779534d1a5fe8ec9efc6f769d483e5f415c
Signed-off-by: Sivas SRR <sivas.srr@in.ibm.com>

show more ...

Enable Qemu test execution

This change addresses the following
- user input SSH and HTTPS port
- consolidate SSH connections in lib
- fix obsolete codes
- update README instructions

Resolve

Enable Qemu test execution

This change addresses the following
- user input SSH and HTTPS port
- consolidate SSH connections in lib
- fix obsolete codes
- update README instructions

Resolves openbmc/openbmc-test-automation#41

Change-Id: I06dd132fb745ebbf035cb0fc583b46542448d126
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Port suite from mkumatag personal repo w/o history

All these files came from https://github.com/mkumatag/openbmc-automation
The decision to remove the commit history was because most of the 122
comm

Port suite from mkumatag personal repo w/o history

All these files came from https://github.com/mkumatag/openbmc-automation
The decision to remove the commit history was because most of the 122
commits did not follow commit comment AND content best practices.
The ability to remove the commit history was possible because all
contributors where from the same company (IBM) making the coordination /
notification/acceptence easy. See all the gory details about the
first try to commit with history here...
https://github.com/openbmc/openbmc-test-automation/pull/1

This suite of tests will run against an OpenBMC based server. It will
run good/bad path testing against the REST interface. There are tests
that will also run ipmitool on the victim BMC too.

If you want to support a new system in to the suite you should only
have to edit two files...
data/<system>.py
tox.ini

The README.md contains details on how to setup for the first time along
with how to execute the test suite

NOTE: some test cases require tools that do not exist on the system.
Currently the ipmitool is needed and if you do not manually copy / link
it in to the tools directory some suites will fail.

show more ...