-
Notifications
You must be signed in to change notification settings - Fork 109
Improve testing against distro and podman-next #548
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Improve testing against distro and podman-next #548
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM apart from the podman-next-fedora-base
failing often. Left a comment about that.
f0cf021
to
97791aa
Compare
/packit test --labels pnext |
@lsm5 all is good now (except for cirrus which is red because it uses as said privately, this is a problem that we cannot get around that easily for cirrus. disabling the copr, is surely a quick fix, but it would prevent us from testing upstream changes |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
LGTM .
I think we should be ok to remove cirrus but would be good to have prior team approval.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
/lgtm
/hold |
1. Split upstream into distro/pnext test runs A new CI run targets tests that are exclusive for podman-next. /upstream plans are now split into /distro and /pnext to be explicit against which podman version is used in the tests. Also, python version used are now called base_python and all_python, to be more self explainatory. 2. Add pytest marker `pnext` to filter tests Tests that should run against podman-next are now skipped by default in tox runs. They can be enabled with --pnext and filtered in using `-m pnext`. These two options should be used together since `pnext` and `non-pnext` tests are thought to be incompatible. 3. Split `test_container_mounts` to test a breaking change and update docs The scenario `test_container_mounts` was split to demonstrates the usage of the marker against an upstream breaking change. CONTRIBUTING.md now reflects the new feature and explains how to use tox locally to leverage on this feature. 4. Add manual trigger on packit Since the tests cover a corner case and serve the purpose of testing unreleased features of libpod (which is slightly out of the scope of podman-py) the testing jobs are optional and should run for certain PRs only. The command to run the pnext tests is the following. /packit test --labels {pnext,podman_next} Fixes: containers#547 Signed-off-by: Nicola Sella <[email protected]>
97791aa
to
f3b8f1d
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
/lgtm
/hold
Cirrus is now redundant with tmt. Also, with the recent change, cirrus would need to be updated and reworked to work with podman-next and without it. Also, replace badge in the README Signed-off-by: Nicola Sella <[email protected]>
d9b1daf
to
cec8a83
Compare
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
/lgtm
[APPROVALNOTIFIER] This PR is APPROVED This pull-request has been approved by: inknos, lsm5 The full list of commands accepted by this bot can be found here. The pull request process is described here
Needs approval from an approver in each of these files:
Approvers can indicate their approval by writing |
A new CI run targets tests that are exclusive for podman-next. /upstream plans are now split into /distro and /pnext to be explicit against which podman version is used in the tests. Also, python version used are now called base_python and all_python, to be more self explainatory.
pnext
to filter testsTests that should run against podman-next are now skipped by default in tox runs. They can be enabled with --pnext and filtered in using
-m pnext
. These two options should be used together sincepnext
andnon-pnext
tests are thought to be incompatible.test_container_mounts
to test a breaking change and update docsThe scenario
test_container_mounts
was split to demonstrates the usage of the marker against an upstream breaking change. CONTRIBUTING.md now reflects the new feature and explains how to use tox locally to leverage on this feature.Since the tests cover a corner case and serve the purpose of testing
unreleased features of libpod (which is slightly out of the scope of
podman-py) the testing jobs are optional and should run for certain PRs
only. The command to run the pnext tests is the following.
/packit test --labels {pnext,podman_next}
Fixes: #547
cc: @lsm5