Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reduced / isolated testing #1845

Open
bmcfee opened this issue May 31, 2024 · 0 comments
Open

Reduced / isolated testing #1845

bmcfee opened this issue May 31, 2024 · 0 comments
Labels
management Project governance, packaging, distribution, etc testing Issues with our test design and continuous integration services

Comments

@bmcfee
Copy link
Member

bmcfee commented May 31, 2024

Is your feature request related to a problem? Please describe.

Issue #1843 raised the concern of accessing remote resources during testing. While this isn't a serious limitation for us in CI, it might be a problem for other package vendors (i.e. debian), which block network access during package builds and test runs.

This is a problem for librosa's tests, which either depend on remotely hosted (or git submoduled) resources (librosa-test-data repo) or hosted example data.

Describe the solution you'd like
We can add a pytest skip flag to any tests that require access to either the test data submodule. This way, a user can set an environment flag (or perhaps some other mechanism) to disable executing tests we know will be problematic. This would have no impact on our CI setup.

@bmcfee bmcfee added testing Issues with our test design and continuous integration services management Project governance, packaging, distribution, etc labels May 31, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
management Project governance, packaging, distribution, etc testing Issues with our test design and continuous integration services
Development

No branches or pull requests

1 participant