Add pytest main CI smoke test#1431
Conversation
|
The failing timeline check is for the missing changelog fragment. Since this is only adding a CI smoke test and doesn't change runtime behavior or docs, I think this should probably use the |
b27ea21 to
8c10362
Compare
seifertm
left a comment
There was a problem hiding this comment.
Thanks for the initiative @Herrtian !
It's desirable to have parity between the CI/CD workflow and the local development environment. That means, it should be possible to run the tests against pytest dev in the local development environment.
There was another Pull Request which seems like it had this figured out. Can you take a look and extend the local development environment so that there's a tox environment that runs all tests against the development version of pytest?
| if-no-files-found: error | ||
|
|
||
| test-pytest-dev: | ||
| name: ubuntu - Python ${{ env.PYTHON_LATEST }} - pytest main |
There was a problem hiding this comment.
The workflow run fails and complains about env not being found. I assume the reason is that env just isn't available here. We can just use "latest", instead of the variable value.
Codecov Report✅ All modified and coverable lines are covered by tests. Additional details and impacted files@@ Coverage Diff @@
## main #1431 +/- ##
=======================================
Coverage 94.50% 94.50%
=======================================
Files 2 2
Lines 510 510
Branches 62 62
=======================================
Hits 482 482
Misses 22 22
Partials 6 6 ☔ View full report in Codecov by Sentry. 🚀 New features to boost your workflow:
|
|
Thanks, updated this in 09a6a37. The job name now uses a literal latest, and the CI job runs a new local tox env, pytest-dev, so the same pytest-main check can be run outside CI too. I checked the tox config locally and ran the env against pytest main. It currently surfaces a few strict-mode behavior failures from pytest main, so I kept the CI job non-blocking as originally intended. |
Fixes #1132.
This adds a separate non-blocking CI job that installs pytest from the pytest main branch and runs the existing test target against it. The regular tox matrix stays unchanged.