make aws default docker registry in remaining scripts

AWS has much better anonymous pull request limits (1 per second) vs
docker hub which is 100 per 6 hours per IP address. A lot of our CI and
deve

make aws default docker registry in remaining scripts

AWS has much better anonymous pull request limits (1 per second) vs
docker hub which is 100 per 6 hours per IP address. A lot of our CI and
development occurs on shared systems so it's easy to exceed this limit
on an IP basis.

Tested:
- Verified no setting for DOCKER_REG and a setting of docker.io work as
expected within these scripts

Change-Id: Ic5cb5ee07ee83567b6cf26754b6d1045025bdd65
Signed-off-by: Andrew Geissler <geissonator@yahoo.com>

show more ...

provide docker registry override in remaining scripts

As done with fe2768c73, provide a mechanism to override the docker
registry used for our remaining docker scripts.

docker.io continues to tight

provide docker registry override in remaining scripts

As done with fe2768c73, provide a mechanism to override the docker
registry used for our remaining docker scripts.

docker.io continues to tighten control[1] on access to its registry.
Provide a mechanism within this script to utilize a different registry
for the base ubuntu image.

[1]: https://www.docker.com/blog/november-2024-updated-plans-announcement/

Tested:
- Confirmed script defaults still works as expected
- Confirmed the following also works now:
export DOCKER_REG=public.ecr.aws/ubuntu
- Confirmed where applicable that this also works(fedora):
export DOCKER_REG=public.ecr.aws/docker/library

Change-Id: Ib237183fb9f27573643783b3988cb00614749f4c
Signed-off-by: Andrew Geissler <geissonator@yahoo.com>

show more ...

docker: remove architecture checks

Docker containers now handle this under the covers when you pull a
container.

Change-Id: If0062f68c53ca79735dd841ae06236c34911e081
Signed-off-by: Andrew Geissler

docker: remove architecture checks

Docker containers now handle this under the covers when you pull a
container.

Change-Id: If0062f68c53ca79735dd841ae06236c34911e081
Signed-off-by: Andrew Geissler <geissonator@yahoo.com>

show more ...

qemu-build: Install python3-tomli

At least at v9.1.0 qemu depends on python3-tomli. Install it so we can
build.

Change-Id: I9d2f938944515c45dc72f85f37acebd71b59576d
Signed-off-by: Andrew Jeffery <a

qemu-build: Install python3-tomli

At least at v9.1.0 qemu depends on python3-tomli. Install it so we can
build.

Change-Id: I9d2f938944515c45dc72f85f37acebd71b59576d
Signed-off-by: Andrew Jeffery <andrew@codeconstruct.com.au>

show more ...

qemu-build.sh: add python3-venv dependency

The latest 8.1 QEMU requires this be in the docker image now

Tested:
- Confirmed I can build latest openbmc/qemu with this

Change-Id: Ib2163840402f2034d6

qemu-build.sh: add python3-venv dependency

The latest 8.1 QEMU requires this be in the docker image now

Tested:
- Confirmed I can build latest openbmc/qemu with this

Change-Id: Ib2163840402f2034d600f419d83dbef641362cf6
Signed-off-by: Andrew Geissler <geissonator@yahoo.com>

show more ...

qemu: misc fixes for new qemu release

- Ensure qemu is built in same ubuntu distro as where it is run
- Add new libslirp-dev dep to docker container that executes qemu

Signed-off-by: Andrew Geissle

qemu: misc fixes for new qemu release

- Ensure qemu is built in same ubuntu distro as where it is run
- Add new libslirp-dev dep to docker container that executes qemu

Signed-off-by: Andrew Geissler <geissonator@yahoo.com>
Change-Id: Iaa58d097de0377e4bb5ee229c5ec267ebe4565a7

show more ...

qemu: misc container changes required for latest qemu

The latest QEMU requires Ubuntu 20 or later and removed support for a
build parameter. Cedric also mentioned that the container should have
libs

qemu: misc container changes required for latest qemu

The latest QEMU requires Ubuntu 20 or later and removed support for a
build parameter. Cedric also mentioned that the container should have
libslirp-dev installed.

Tested:
- Verified script now builds latest openbmc/qemu

Signed-off-by: Andrew Geissler <geissonator@yahoo.com>
Change-Id: If8170c9b89969107a237635bd66a2eac723934d0

show more ...

format shell scripts with beautysh

Signed-off-by: Patrick Williams <patrick@stwcx.xyz>
Change-Id: Ie72911e0f57a1f69b0bf317de8c52947886e1303

Use native docker images for scripts on aarch64 Host OS

Commit 051b05b7 support aach64 Host OS to execute scripts. However, it
does not set DOCKER_BASE parameter which consequently uses x86_64 docke

Use native docker images for scripts on aarch64 Host OS

Commit 051b05b7 support aach64 Host OS to execute scripts. However, it
does not set DOCKER_BASE parameter which consequently uses x86_64 docker
images instead of arm64v8 image.
This commit sets DOCKER_BASE to arm64v8/ to use native docker images.

Tested:
1. Set environment variables appropriately and execute scripts. Ensure
all docker images loaded successfully and scripts can execute without
issue.

Signed-off-by: Thang Q. Nguyen <thang@os.amperecomputing.com>
Change-Id: I3c09d448dae17f290f2c2fd1d8116167510635b6

show more ...

Add support aarch64 architecture

Support to run scripts in aarch64 Host Linux.

Tested: execute the scripts changed in this commit in Aarch64 Host
Ubuntu OS and check they can execute successfully

Add support aarch64 architecture

Support to run scripts in aarch64 Host Linux.

Tested: execute the scripts changed in this commit in Aarch64 Host
Ubuntu OS and check they can execute successfully

Signed-off-by: Thang Q. Nguyen <thang@os.amperecomputing.com>
Change-Id: Idde23fbd09c5000c710f4f6d88793fefbb0cb04c

show more ...

qemu-build: Update system dependencies

qemu 5.2 requires bzip2 and ninja-build. Install them.

Change-Id: I18d2e7d9e997fc70f993713b14828947c5c50b61
Signed-off-by: Andrew Jeffery <andrew@aj.id.au>

qemu-build: Update base image to ubuntu:bionic

qemu 5.2 fails to build under Ubuntu 16.04. Upgrade to the base image
to the one specified by scripts/build-qemu-robot-docker.sh (bionic,
18.04).

Chan

qemu-build: Update base image to ubuntu:bionic

qemu 5.2 fails to build under Ubuntu 16.04. Upgrade to the base image
to the one specified by scripts/build-qemu-robot-docker.sh (bionic,
18.04).

Change-Id: Id135f0c3118a6aa997ddcd578fe98af4a9ae17de
Signed-off-by: Andrew Jeffery <andrew@aj.id.au>

show more ...

shellcheck: clean up shellcheck warnings and enable

Signed-off-by: Patrick Williams <patrick@stwcx.xyz>
Change-Id: Ibc843b98c0fea97a31d3d15b556a32f091bf8e47

qemu: Add ca-certificates to container

Qemu builds are failing due to git's inability to verify a certificate:

fatal: unable to access 'https://git.qemu.org/git/capstone.git/':
Problem with the SSL

qemu: Add ca-certificates to container

Qemu builds are failing due to git's inability to verify a certificate:

fatal: unable to access 'https://git.qemu.org/git/capstone.git/':
Problem with the SSL CA cert (path? access rights?)

This is because the system does not have the CA certificate package
installed.

Change-Id: Ibfff0927dd551eed38901efa4400e7e5b328595f
Signed-off-by: Joel Stanley <joel@voyager.ozlabs.ibm.com>

show more ...

qemu-build: Simplify

This reverts some of the changes to the script made to support features
other than what it was meant to do: build a docker image, and build qemu
in that image.

In it's current

qemu-build: Simplify

This reverts some of the changes to the script made to support features
other than what it was meant to do: build a docker image, and build qemu
in that image.

In it's current form it's failing to produce a qemu artifact for the CI
system to use. By simplifying it we have a better chance of debugging
the issue, and in fact the issue has gone away.

Change-Id: Ia757c1139e964b240ea4a54ecc7e24a5894e4cd9
Signed-off-by: Joel Stanley <joel@jms.id.au>

show more ...

qemu-build: Disable -Werror

Werror is useful for the qemu developers, but not for us. When building
for CI we want a binary to be produced if at all possible.

Change-Id: Ife36a3d97100ed64c280acee76

qemu-build: Disable -Werror

Werror is useful for the qemu developers, but not for us. When building
for CI we want a binary to be produced if at all possible.

Change-Id: Ife36a3d97100ed64c280acee766887c8c5d68dd8
Signed-off-by: Joel Stanley <joel@jms.id.au>

show more ...

qemu-build: Set ARCH before using it

Change-Id: Ic3cd4de7f29f690648c0c026c9b9898699497e9f
Signed-off-by: Joel Stanley <joel@jms.id.au>

Adjust the headers and variables to be alphabetical

Change-Id: I179d17b2413be92f568921c2cd102a1e72895681
Signed-off-by: Alanny Lopez <alannyglopez@gmail.com>

Update Variable Naming Convention

Variables in qemu-build.sh, build-jenkins.sh, build-setup.sh,
and kubernetes-launch.sh updated to use the same convention across
different scripts.

Change-Id: Ice9

Update Variable Naming Convention

Variables in qemu-build.sh, build-jenkins.sh, build-setup.sh,
and kubernetes-launch.sh updated to use the same convention across
different scripts.

Change-Id: Ice9ef2f47b0fbf125eadd235f63b79abafdc2dd7
Signed-off-by: Alanny Lopez <alannyglopez@gmail.com>

show more ...

Standardize/Update Headers, Use Declarative Paths

Updated the headers so they would be standardized to follow the same
conventions as used in the build-jenkins.sh.

Changed the sourcing of the kuber

Standardize/Update Headers, Use Declarative Paths

Updated the headers so they would be standardized to follow the same
conventions as used in the build-jenkins.sh.

Changed the sourcing of the kubernetes-launch.sh, now will use a
declarative path instead of the relative paths.

Had a few comment changes I felt were better explanations.

Change-Id: I8fa44443b5eeb893ba93b0be5d7cadae14a63c08
Signed-off-by: Alanny Lopez <alannyglopez@gmail.com>

show more ...

Add iputils-ping to the build scripts

iputils-ping is a required tool for yocto-2.3.

Change-Id: I51834fbc542f88c5f1e673428edb9a56a4f58862
Signed-off-by: Saqib Khan <khansa@us.ibm.com>

Launch script will now tag instead of build images

Made this change to shift the building of the Dockerfile away from the
helper script. Instead the build will now be done by invoker scripts.
Then d

Launch script will now tag instead of build images

Made this change to shift the building of the Dockerfile away from the
helper script. Instead the build will now be done by invoker scripts.
Then doing the helper script will tag that built image with a new name
that will be used to replace the old image name. This change updates the
build-setup.sh, the qemu-build.sh, and the kubernetes-launch.sh

Change-Id: I2d82e30b5e427bc46ac327541c58eebe9e6efd52
Signed-off-by: Alanny Lopez <alanny.lopez@ibm.com>

show more ...

Isolated the build directory

The build directory was whatever path the qemudir had. To adjust for
allowing external mounts to be used such as NFS have made it so that the
script will use the qemudir

Isolated the build directory

The build directory was whatever path the qemudir had. To adjust for
allowing external mounts to be used such as NFS have made it so that the
script will use the qemudir to create an internal copy where the build
will happen so that files in the qemudir will not be affected. The
artifacts for the image will be found in ${WORKSPACE}/arm-softmmu.

Change-Id: I21cfc8c5a7817de0b8641bb4d4f0b635904dd1bc
Signed-off-by: Alanny Lopez <alanny.lopez@ibm.com>

show more ...

Update the Qemu-build to source in helper script

Qemu build script will now call in the kubernetes helper if launch
is set to pod or job. To satisfy this update, added new templates
to launch the co

Update the Qemu-build to source in helper script

Qemu build script will now call in the kubernetes helper if launch
is set to pod or job. To satisfy this update, added new templates
to launch the container into kubernetes cluster as a job or a pod.
In addition added the default variables for the template that are not
defined in the qemu-build.sh script.

Change-Id: I92fee4c6a6c2e734f840d16af026afbbab4f3fb1
Signed-off-by: Alanny Lopez <alanny.lopez@ibm.com>

show more ...

Added qemudir Variable and Updated Header.

The qemudir variable will be used to specify the QEMU directory. Added a
check to the docker run command to avoid mount conflicts and changed how
we enter

Added qemudir Variable and Updated Header.

The qemudir variable will be used to specify the QEMU directory. Added a
check to the docker run command to avoid mount conflicts and changed how
we enter the qemu build directory to be the full path. Update header to
be more descriptive.

Change-Id: I78d012db2b758c53115c0e7c3f126102d2d01310
Signed-off-by: Alanny Lopez <alanny.lopez@ibm.com>

show more ...