build-unit-test-docker: update ubuntu to hirsute

The latest Ubuntu "Hirsute Hippo" was released on 2021-04-22.
Switch our CI builds to use it.

Signed-off-by: Patrick Williams <patrick@stwcx.xyz>
Ch

build-unit-test-docker: update ubuntu to hirsute

The latest Ubuntu "Hirsute Hippo" was released on 2021-04-22.
Switch our CI builds to use it.

Signed-off-by: Patrick Williams <patrick@stwcx.xyz>
Change-Id: If41dfd2247f0513bc297c4789cb051f7f69cbec4

show more ...

build-unit-test-docker: cereal: get upstream c++20 fixes

Signed-off-by: Patrick Williams <patrick@stwcx.xyz>
Change-Id: Iaa03418fdad4405f2f102c283bfaafcdad10c042

format-code: ignore subprojects for pycodestyle

Meson-based repositories may have code from elsewhere inside
a 'subprojects' subdirectory, especially on a developer system.
Tell `pycodestyle` to ign

format-code: ignore subprojects for pycodestyle

Meson-based repositories may have code from elsewhere inside
a 'subprojects' subdirectory, especially on a developer system.
Tell `pycodestyle` to ignore this subdirectory so there are not
false positive code format failures due to upstream code
repositories we do not have control over.

Signed-off-by: Patrick Williams <patrick@stwcx.xyz>
Change-Id: Ia6ce4ba355b14aae07b7e346afaac8667399cfc1

show more ...

unit-test: meson: update flags for phosphor-logging

Prep build scripts for phosphor-logging migration to meson
by adding openpower phosphor-logging build options.

Signed-off-by: Patrick Williams <p

unit-test: meson: update flags for phosphor-logging

Prep build scripts for phosphor-logging migration to meson
by adding openpower phosphor-logging build options.

Signed-off-by: Patrick Williams <patrick@stwcx.xyz>
Change-Id: I9252e465e7a171455ed95c3723d1ca13b561a5ae

show more ...

Increase timeout for tests while running under valgrind

- The tests seems to take longer time while running under
valgrind.

- Added '-t' argument for the meson tests which increases the
tim

Increase timeout for tests while running under valgrind

- The tests seems to take longer time while running under
valgrind.

- Added '-t' argument for the meson tests which increases the
time out value by a mentioned multiplier value for each test
while running under valgrind.

- Set the multiplier value to 10, so that we can wait for 300 seconds
before we timeout for tests that runs under valgrind.

Signed-off-by: Manojkiran Eda <manojkiran.eda@gmail.com>
Change-Id: I29f3e40da388b732b37bdeb03155111de35bbce3

show more ...

unit-test: meson: check meson version for C++20

If a package requests C++20 support, only Meson >=0.57 recognizes
the 'cpp_std=c++20' option but doesn't warn about this. Add code
in our test path t

unit-test: meson: check meson version for C++20

If a package requests C++20 support, only Meson >=0.57 recognizes
the 'cpp_std=c++20' option but doesn't warn about this. Add code
in our test path to ensure that if a package has requested C++20
it also requests Meson >=0.57. This helps prevent a cryptic
message if someone compiles one of our packages on a distro with
an older version of Meson.

Tested: Ran script against sdbusplus with various settings of
meson_version and cpp_std.

Signed-off-by: Patrick Williams <patrick@stwcx.xyz>
Change-Id: I130766a822710bf634eca3677e22c9d484defa00

show more ...

unit-test: handle meson 0.57 optinterpreter

Starting with meson 0.57, the option intepreter code no longer holds
the options as a simple string -> option map, but instead has a new
type called an "O

unit-test: handle meson 0.57 optinterpreter

Starting with meson 0.57, the option intepreter code no longer holds
the options as a simple string -> option map, but instead has a new
type called an "OptionKey" which acts as the key and has no simple
conversion from string. See this commit in meson:

$ git tag --contains=23d3b98fc1
0.57.0
...

Update the unit-test script, which utilizes the Meson optinterpreter,
to use this new OptionKey as the key to the option map lookups.

It appears that they are enhancing the option parser so that you can
get options from subprojects, different languages, and different build
targets. We do not utilize this functionality so the defaults for
an OptionKey are what we want.

Tested: Ran the unit-test infrastructure against phosphor-power and
confirmed that "-Dtests=enabled" was passed to meson.

Signed-off-by: Patrick Williams <patrick@stwcx.xyz>
Change-Id: I285bb396a2761f69dec4a7317b6da8761ea1bea8

show more ...

build-unit-test-docker: fix default docker in comments

Signed-off-by: Patrick Williams <patrick@stwcx.xyz>
Change-Id: Ie5f34b4886105e378d049d4e056c3cdb138b81a4

Remove libevdev2-dbgsym

Removing this package appears to resolve an issue where the docker unit
test script fails due to missing a dependency:
libevdev2-dbgsym : Depends: libevdev2 (= 1.9.1+dfsg-1)

Remove libevdev2-dbgsym

Removing this package appears to resolve an issue where the docker unit
test script fails due to missing a dependency:
libevdev2-dbgsym : Depends: libevdev2 (= 1.9.1+dfsg-1)

Signed-off-by: Zane Shelley <zshelle@us.ibm.com>
Change-Id: Id04eea803bbdcfb6ac959f8b441cc8b4b0a29b92

show more ...

build-unit-test-docker: boost: switch mirror to yocto

The official download location for boost, bintray, often runs out
of bandwidth and gives errors when we download from it. Switch
our download l

build-unit-test-docker: boost: switch mirror to yocto

The official download location for boost, bintray, often runs out
of bandwidth and gives errors when we download from it. Switch
our download location to be the yoctoproject mirror instead, which
seems to be more stable.

The downside of this is that we can only use Boost releases which
are already incorporated into a Yocto commit, but we really should
only do that anyhow.

Signed-off-by: Patrick Williams <patrick@stwcx.xyz>
Change-Id: Ia028ed18d7ef4b9d2a0cc3ca351cee27073ad6bc

show more ...

build-unit-test-docker: add bogus echo to force update keyserver

Signed-off-by: Patrick Williams <patrick@stwcx.xyz>
Change-Id: I7fe918532f0af4bfac6cd782b6fd3ff9a4763944

Spell check on commit message support for CI

- This commit would add the codespell package while
building the base container.

- The intention is that, we maintain two dictionaries
1. That comes

Spell check on commit message support for CI

- This commit would add the codespell package while
building the base container.

- The intention is that, we maintain two dictionaries
1. That comes directly with codespell
- We should also download the latest dictionary while
while building the base container.
2. An openbmc spellings dictionary
- We should be able to add words and spellings that are
openbmc related in this dictionary over time.

- When the commit message have words that the dictionary does not have,
the CI proceeds further without any rejection. The CI only scores a -1 if
it sees a word wrongly spelled from it knowledge from the dictionary.

Tested by:

1. when commit message have mistakes: It breaks & scores a -1
It also highlights the spelling mistake and the correct spelling
to be used.

2. when commit message does not have mistakes : it does not break &
proceeds further for compilation.

Signed-off-by: Manojkiran Eda <manojkiran.eda@gmail.com>
Change-Id: I87278597876b6e2b0a59e297cde020631491b5fd

show more ...

ensure unit test ci can write /usr/local

Certain repos like openpower-debug-collector generate their error files
on the fly during build time. These are installed into
/usr/local/share/phosphor-dbus

ensure unit test ci can write /usr/local

Certain repos like openpower-debug-collector generate their error files
on the fly during build time. These are installed into
/usr/local/share/phosphor-dbus-yaml/ sub-directories.

Without this change, this is happening:

/home/jenkins-op/workspace/ci-repository/openbmc/openpower-debug-collector > make -j 80 -l 80 -O
cp: cannot create regular file '/usr/local/share/phosphor-dbus-yaml/yaml/org/open_power/Host/Boot.errors.yaml': Permission denied

Since this is just a docker container and /usr/local is not persisted,
give permission to all of /usr/local of the ID running the script.

Tested:
- Verified openpower-debug-collector repo now passes CI

Change-Id: Iea1e89f017e9128b0c538392302b177b7c7d600d
Signed-off-by: Andrew Geissler <geissonator@yahoo.com>

show more ...

run-robot: minor shellcheck fixes

Signed-off-by: Patrick Williams <patrick@stwcx.xyz>
Change-Id: I1c0a9d892d2b6635cb2e9cce6bfb826c770de456

test-qemu: shellcheck fixes

Signed-off-by: Patrick Williams <patrick@stwcx.xyz>
Change-Id: I3f738a33f1dfc69314ab83f9dbf0f9f16b929871

Bump the Meson version to 0.57.1

- Meson version 0.57 now supports multi thread support during
the link time optimization, so our compilations can get much
better for repos like bmcweb which use

Bump the Meson version to 0.57.1

- Meson version 0.57 now supports multi thread support during
the link time optimization, so our compilations can get much
better for repos like bmcweb which uses the LTO.

- For more details check the below Meson issue:
https://github.com/mesonbuild/meson/issues/7820

- With the latest poky update (90fd73cb556c0db84e45514413a68f9c5e1aea22),
Meson in yocto had already moved to 0.57.1, so we can bump up the
version used in CI too.

Signed-off-by: Manojkiran Eda <manojkiran.eda@gmail.com>
Change-Id: I0114fe8498f9624ad8bce0ce909267d1412cad7b

show more ...

build-qemu-robot-docker.sh: add rust to package

The latest cryptography packages require rust

Change-Id: I71a1210ece3a151e978c2d934a1899d6effbe039
Signed-off-by: Andrew Geissler <geissonator@yahoo.

build-qemu-robot-docker.sh: add rust to package

The latest cryptography packages require rust

Change-Id: I71a1210ece3a151e978c2d934a1899d6effbe039
Signed-off-by: Andrew Geissler <geissonator@yahoo.com>

show more ...

build-qemu-robot-docker.sh: back level robot requests

The latest robotframework-requests library is not compatible with the
openbmc-test-automation software. The team is working on updating
to handl

build-qemu-robot-docker.sh: back level robot requests

The latest robotframework-requests library is not compatible with the
openbmc-test-automation software. The team is working on updating
to handle this but for now peg us at the version that works with our
test software.

Change-Id: I708f6c6ed3dbeef560c51ed7dd4c12f36851c256
Signed-off-by: Andrew Geissler <geissonator@yahoo.com>

show more ...

build-unit-test-docker: make clang go to 11

Signed-off-by: Patrick Williams <patrick@stwcx.xyz>
Change-Id: Iab3c2729cbf0c1682ad4ef1edbe619c6d270a27c

Upgrade to ubuntu groovy (21.04)

Ubuntu 21.04 looks in terms of dependencies looks much more like the
current bmc builds today. Namely, it includes systemd 246.

Tested:
Build sdbusplus with these

Upgrade to ubuntu groovy (21.04)

Ubuntu 21.04 looks in terms of dependencies looks much more like the
current bmc builds today. Namely, it includes systemd 246.

Tested:
Build sdbusplus with these changes pre-rebase. Build succeeded.

Change-Id: Id52d6c5ee6a11a4af70d2bf789b306d069eb3971
Signed-off-by: Ed Tanous <edtanous@google.com>

show more ...

build-unit-test-docker: prevent exception in thread start-up

Add a lock to allow all the threads to start before they start
running, so that one thread doesn't 'join' on its dependency
before the de

build-unit-test-docker: prevent exception in thread start-up

Add a lock to allow all the threads to start before they start
running, so that one thread doesn't 'join' on its dependency
before the dependency starts. This shows as an exception:

Traceback (most recent call last):
File "/usr/lib/python3.8/threading.py", line 932, in _bootstrap_inner
self.run()
File "./scripts/build-unit-test-docker", line 353, in run
deppkg.join()
File "/usr/lib/python3.8/threading.py", line 1006, in join
raise RuntimeError("cannot join thread before it is started")

Signed-off-by: Patrick Williams <patrick@stwcx.xyz>
Change-Id: I7594ac393f310085eb8328a0394493c01b78add3

show more ...

build-unit-test-docker: use Gerrit revision if available

If Jenkins is triggering us to run CI on a package that is included
in the Docker image itself, use the requested revision-under-test as
part

build-unit-test-docker: use Gerrit revision if available

If Jenkins is triggering us to run CI on a package that is included
in the Docker image itself, use the requested revision-under-test as
part of the Docker image build process.

Signed-off-by: Patrick Williams <patrick@stwcx.xyz>
Change-Id: I61a0a249123800aba860ab1535e96f5cdb2ec63f

show more ...

unit-test: add debug in dependency determination

We are running into a periodic error where 'build_dep_tree' fails
because it is unable to probe the build system used by a dependency.
Add some debug

unit-test: add debug in dependency determination

We are running into a periodic error where 'build_dep_tree' fails
because it is unable to probe the build system used by a dependency.
Add some debug statements so we are able to determine which dependency
this is.

Signed-off-by: Patrick Williams <patrick@stwcx.xyz>
Change-Id: I571d62f191adcab42b4e1814dc6435b1401f3bb8

show more ...

build-unit-test-docker: Fix https_proxy

The https_proxy was not correctly set and if build with proxy settings,
it gives below error:

base: WARNING: Retrying (Retry(total=4, connect=None, read=

build-unit-test-docker: Fix https_proxy

The https_proxy was not correctly set and if build with proxy settings,
it gives below error:

base: WARNING: Retrying (Retry(total=4, connect=None, read=None,
redirect=None, status=None)) after connection broken by
'ProxyError('Cannot connect to proxy.',
NewConnectionError('<urllib3.connection.VerifiedHTTPSConnection
object at 0x7efe419e99d0>: Failed to establish a new connection:
[Errno -2] Name or service not known'))': /simple/inflection/
RAN: /usr/bin/docker build --build-arg http_proxy=http://<myproxy>
--build-arg 'https_proxy={https_proxy}' --network=host --force-rm
--no-cache=false -t
openbmc/ubuntu-unit-test-base:2021-W07-773f263e895d8ed6 -

Tested: Fix the https_proxy string and verify the CI passes.

Signed-off-by: Lei YU <yulei.sh@bytedance.com>
Change-Id: I87f543d33747b4957af83990f80bd8e832f4e5e3

show more ...

build-qemu-robot-docker: upgrade to focal

The 'pip' version that comes with bionic is no longer able to
install some of the python modules we need. Specificially, we
end up with a failure as:

build-qemu-robot-docker: upgrade to focal

The 'pip' version that comes with bionic is no longer able to
install some of the python modules we need. Specificially, we
end up with a failure as:

Traceback (most recent call last):
File "<string>", line 1, in <module>
File "/tmp/pip-build-lz9dedw0/cryptography/setup.py", line 14, in <module>
from setuptools_rust import RustExtension
ModuleNotFoundError: No module named 'setuptools_rust'

Rather than pin the cryptography module, which is actually a
dependency from a few levels down, upgrade the distro to focal to
pick up a new version of pip.

Signed-off-by: Patrick Williams <patrick@stwcx.xyz>
Change-Id: Ief9aaccbe14b835a2dcae5c7d53cc5969f044cf3

show more ...