Skip to content

Improve testing against distro and podman-next #548

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 2 commits into from
May 6, 2025

Conversation

inknos
Copy link
Contributor

@inknos inknos commented May 2, 2025

  1. Split upstream into distro/pnext test runs

A new CI run targets tests that are exclusive for podman-next. /upstream plans are now split into /distro and /pnext to be explicit against which podman version is used in the tests. Also, python version used are now called base_python and all_python, to be more self explainatory.

  1. Add pytest marker pnext to filter tests

Tests that should run against podman-next are now skipped by default in tox runs. They can be enabled with --pnext and filtered in using -m pnext. These two options should be used together since pnext and non-pnext tests are thought to be incompatible.

  1. Split test_container_mounts to test a breaking change and update docs

The scenario test_container_mounts was split to demonstrates the usage of the marker against an upstream breaking change. CONTRIBUTING.md now reflects the new feature and explains how to use tox locally to leverage on this feature.

  1. Add manual trigger on packit

Since the tests cover a corner case and serve the purpose of testing
unreleased features of libpod (which is slightly out of the scope of
podman-py) the testing jobs are optional and should run for certain PRs
only. The command to run the pnext tests is the following.

/packit test --labels {pnext,podman_next}

Fixes: #547

cc: @lsm5

@openshift-ci openshift-ci bot added the approved label May 2, 2025
Copy link
Member

@lsm5 lsm5 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM apart from the podman-next-fedora-base failing often. Left a comment about that.

@inknos inknos force-pushed the testing-podman-pnext branch 5 times, most recently from f0cf021 to 97791aa Compare May 2, 2025 15:24
@inknos
Copy link
Contributor Author

inknos commented May 2, 2025

/packit test --labels pnext

@inknos
Copy link
Contributor Author

inknos commented May 2, 2025

@lsm5 all is good now (except for cirrus which is red because it uses podman-next)

as said privately, this is a problem that we cannot get around that easily for cirrus. disabling the copr, is surely a quick fix, but it would prevent us from testing upstream changes

Copy link
Member

@lsm5 lsm5 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM .

I think we should be ok to remove cirrus but would be good to have prior team approval.

Copy link
Member

@lsm5 lsm5 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@openshift-ci openshift-ci bot added the lgtm label May 5, 2025
@lsm5
Copy link
Member

lsm5 commented May 5, 2025

/hold

1. Split upstream into distro/pnext test runs

A new CI run targets tests that are exclusive for podman-next.
/upstream plans are now split into /distro and /pnext to be explicit
against which podman version is used in the tests. Also, python version
used are now called base_python and all_python, to be more self
explainatory.

2. Add pytest marker `pnext` to filter tests

Tests that should run against podman-next are now skipped by default in
tox runs. They can be enabled with --pnext and filtered in using
`-m pnext`. These two options should be used together since `pnext` and
`non-pnext` tests are thought to be incompatible.

3. Split `test_container_mounts` to test a breaking change and update
   docs

The scenario `test_container_mounts` was split to demonstrates the
usage of the marker against an upstream breaking change.
CONTRIBUTING.md now reflects the new feature and explains how to use tox
locally to leverage on this feature.

4. Add manual trigger on packit

Since the tests cover a corner case and serve the purpose of testing
unreleased features of libpod (which is slightly out of the scope of
podman-py) the testing jobs are optional and should run for certain PRs
only. The command to run the pnext tests is the following.

/packit test --labels {pnext,podman_next}

Fixes: containers#547

Signed-off-by: Nicola Sella <[email protected]>
@inknos inknos force-pushed the testing-podman-pnext branch from 97791aa to f3b8f1d Compare May 5, 2025 13:48
@openshift-ci openshift-ci bot removed the lgtm label May 5, 2025
Copy link
Member

@lsm5 lsm5 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm
/hold

@openshift-ci openshift-ci bot added lgtm and removed lgtm labels May 5, 2025
Cirrus is now redundant with tmt. Also, with the recent change, cirrus
would need to be updated and reworked to work with podman-next and
without it.

Also, replace badge in the README

Signed-off-by: Nicola Sella <[email protected]>
@inknos inknos force-pushed the testing-podman-pnext branch from d9b1daf to cec8a83 Compare May 6, 2025 08:50
Copy link
Member

@lsm5 lsm5 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@openshift-ci openshift-ci bot added the lgtm label May 6, 2025
Copy link
Contributor

openshift-ci bot commented May 6, 2025

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: inknos, lsm5

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@openshift-merge-bot openshift-merge-bot bot merged commit 9f56d1c into containers:main May 6, 2025
21 checks passed
@inknos inknos mentioned this pull request Feb 10, 2025
22 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Testing against podman-next breaks test_container_mounts
2 participants