Update CT Metrics

Changes:
- Update the reference file
- Remove unused arguments
- Cleanup spaces
- Add a description of arguments

Tested:
- Tested the script
python3 tools/ct_m

Update CT Metrics

Changes:
- Update the reference file
- Remove unused arguments
- Cleanup spaces
- Add a description of arguments

Tested:
- Tested the script
python3 tools/ct_metrics/gen_csv_results.py
-s output.xml -d dummy --version_id abcd123
--platform bmc --level 123

Change-Id: I0ceadf49020397ec488a282228c6b43162f0146d
Signed-off-by: Sridevi Ramesh <sridevra@in.ibm.com>

show more ...

CT metric code pylint clean up

Changes:
- W0611: Unused import
- C0116: Missing function or method docstring
- W1514: Using open without explicitly specifying an encoding
- R1732: Co

CT metric code pylint clean up

Changes:
- W0611: Unused import
- C0116: Missing function or method docstring
- W1514: Using open without explicitly specifying an encoding
- R1732: Consider using 'with' for resource-allocating operations
- C0103: Variable name
- C0115: Missing class docstring
- R1722: Consider using 'sys.exit'

Tested:
- Ran the script with test data.

Change-Id: I2f2930ee488e88cb40ab37cae575619d020c5919
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

CT metrics to remove test cases skipped

Changes:
- Some tests are skipped and the test status is marked
as SKIP. When generating metric CSV file, it add up.
Added check to skip marki

CT metrics to remove test cases skipped

Changes:
- Some tests are skipped and the test status is marked
as SKIP. When generating metric CSV file, it add up.
Added check to skip marking a test as executed because
the test is not executed but the robot makes an
entry as skipped in the report log.

Tested:
- Ran script against XLM out which has passed and skipped
test cases.

Change-Id: Ie4dd63a2a2f5563e640ebc8273baee26e654f9ae
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

black: re-format

black and isort are enabled in the openbmc-build-scripts on Python files
to have a consistent formatting. Re-run the formatter on the whole
repository.

Signed-off-by: Patrick Will

black: re-format

black and isort are enabled in the openbmc-build-scripts on Python files
to have a consistent formatting. Re-run the formatter on the whole
repository.

Signed-off-by: Patrick Williams <patrick@stwcx.xyz>
Change-Id: I944f1915ece753f72a3fa654902d445a9749d0f9

show more ...

pycodestyle: Module level import not at top of file

Changes:
- Added NOQA on python files import to skip CI
- Fix import order reported by CI.

Tested:
- CI will catch this if there i

pycodestyle: Module level import not at top of file

Changes:
- Added NOQA on python files import to skip CI
- Fix import order reported by CI.

Tested:
- CI will catch this if there is error

Change-Id: I39a11d3e815a08488671ed948f073828e19aee37
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Revert "Fix for module level import not at top of file"

This reverts commit 47375aa789dcb11ba969895f61dfb12a773e2164.

Signed-off-by: George Keishing <gkeishin@in.ibm.com>
Change-Id: Icc40562b861262

Revert "Fix for module level import not at top of file"

This reverts commit 47375aa789dcb11ba969895f61dfb12a773e2164.

Signed-off-by: George Keishing <gkeishin@in.ibm.com>
Change-Id: Icc40562b861262d8fb72d68b43654334985eea4d

show more ...

Revert "black: re-format"

This reverts commit 5731818de0ce446ceaafc7e75ae39da1b69942ae.

Signed-off-by: George Keishing <gkeishin@in.ibm.com>
Change-Id: Ie61cdc8c7f2825b0d9d66be87a6a3a058de2b372

black: re-format

black and isort are enabled in the openbmc-build-scripts on Python files
to have a consistent formatting. Re-run the formatter on the whole
repository.

Change-Id: If1010ead857d413

black: re-format

black and isort are enabled in the openbmc-build-scripts on Python files
to have a consistent formatting. Re-run the formatter on the whole
repository.

Change-Id: If1010ead857d41364c024bf8145a979a9377d382
Signed-off-by: Patrick Williams <patrick@stwcx.xyz>

show more ...

Fix for module level import not at top of file

Change-Id: I1994b58a027cdac3bf4084b77db61bc646aaaba6
Signed-off-by: Sridevi Ramesh <sridevra@in.ibm.com>

Update python code for python 3.8 or higher compatibility

Changes:
- Update shebang directive to use python3 explicitly.
- remove preexec_fn feature which is deprecated in higher
py

Update python code for python 3.8 or higher compatibility

Changes:
- Update shebang directive to use python3 explicitly.
- remove preexec_fn feature which is deprecated in higher
python version 3.8 and above.
- bufsize fix, from documentation bufsize 1 means line buffered
(only usable if universal_newlines=True i.e., in a text mode)
refer: https://docs.python.org/3/library/subprocess.html
- Fix SyntaxWarning: "is" with "=="

Change-Id: Ib96c1ba8c2327d6774d0d731b48ca7e61a4a297a
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

tools: Enhance reference to robot.result.statistics critical tag

Change reporting tool to handle deprecated critical tag in updated v4.0+ robotframework.

- Patchset #1: initial commit.
- Patchset #

tools: Enhance reference to robot.result.statistics critical tag

Change reporting tool to handle deprecated critical tag in updated v4.0+ robotframework.

- Patchset #1: initial commit.
- Patchset #2: change to total testcase count and Non-Critical test message.

Test:
- Change was tested with
Robot Framework 3.0.4 (Python 3.8.10 on linux)
Robot Framework 4.1.1 (Python 3.8.10 on linux)

Signed-off-by: Peter D Phan <peterp@us.ibm.com>
Change-Id: I64a7f738c1ceaa8ac627854add4e2b1259de76df

show more ...

Fix python3 format error for clean CI

Change-Id: Ie86058dd5b678dce18d0e8f1148c469d1af1eb58
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

Making subsystem a customizable param

Signed-off-by: Vijay <vikantan@in.ibm.com>
Change-Id: I95932b7019fe741d9a5d842e183185932944fc5b

Fix datetime import and module access

Change-Id: Ia8600b660f25b47318fcdf8eb8b752568475288d
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

Set permissions file of generated metrics csv file

Update tools/ct_metrics/gen_csv_results.py by setting
the permssions of the generated csv file to 666.

Resolves openbmc/openbmc-test-automation#16

Set permissions file of generated metrics csv file

Update tools/ct_metrics/gen_csv_results.py by setting
the permssions of the generated csv file to 666.

Resolves openbmc/openbmc-test-automation#1691

Signed-off-by: Steven Sombar <ssombar@us.ibm.com>
Change-Id: I49ead685bd36d9b873c865a63b7df29a62fb9e80

show more ...

Update utility which creates CSV file for metrics

Add support for two new parameters "test_phase" and "processor".

Resolves openbmc/openbmc-test-automation#1652
Change-Id: Ide0de01596f173ff9d9f6959

Update utility which creates CSV file for metrics

Add support for two new parameters "test_phase" and "processor".

Resolves openbmc/openbmc-test-automation#1652
Change-Id: Ide0de01596f173ff9d9f69595d6ea537970b23c7
Signed-off-by: Steven Sombar <ssombar@us.ibm.com>

show more ...

CT metrics and code spell fix

Changes:
- Fix ct metric path lib import.
- code spell fix.

Change-Id: If35f4bff27802832cc3826018b782b00bfa36fb4
Signed-off-by: George Keishing <gkeishin@in.ibm.

CT metrics and code spell fix

Changes:
- Fix ct metric path lib import.
- code spell fix.

Change-Id: If35f4bff27802832cc3826018b782b00bfa36fb4
Signed-off-by: George Keishing <gkeishin@in.ibm.com>

show more ...

Remove references to oem/ibm

Resolves openbmc/openbmc-test-automation#1628

Change-Id: I6ef1b7a26d673e6a563ae536fbee055d864d8f51
Signed-off-by: Steven Sombar <ssombar@us.ibm.com>