Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Added CLI --refresh-catalog option and extractor extra use_cached_catalog to ignore the cached source catalog #8580

Merged
merged 21 commits into from
Jun 17, 2024

Conversation

edgarrmondragon
Copy link
Collaborator

@edgarrmondragon edgarrmondragon commented Jun 17, 2024

closes #6919

  • Adds no_catalog_cache use_cached_catalog to config extras, so that a single plugin can be run every time without the catalog cache.
  • Adds --catalog-refresh --refresh-catalog option to meltano select and meltano el

Adding a new extra seems extreme, but I don't know how else to implement this where it could be used as part of a job for any tap. If there's a better way to do it, I'm happy to adjust this based on feedback.

Supersedes #8518

Copy link

netlify bot commented Jun 17, 2024

Deploy Preview for meltano canceled.

Name Link
🔨 Latest commit 68eac3a
🔍 Latest deploy log https://app.netlify.com/sites/meltano/deploys/667060c0490490000865cd6a

@edgarrmondragon edgarrmondragon force-pushed the edgarrmondragon/feat/ignore-catalog-cache branch 3 times, most recently from 64243b6 to 6424257 Compare June 17, 2024 10:36
@edgarrmondragon edgarrmondragon force-pushed the edgarrmondragon/feat/ignore-catalog-cache branch from 6424257 to d4041c6 Compare June 17, 2024 10:43
Copy link

codecov bot commented Jun 17, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 92.00%. Comparing base (780017b) to head (68eac3a).
Report is 2 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main    #8580      +/-   ##
==========================================
+ Coverage   91.83%   92.00%   +0.17%     
==========================================
  Files         245      246       +1     
  Lines       19296    19369      +73     
  Branches     2152     3418    +1266     
==========================================
+ Hits        17720    17821     +101     
+ Misses       1303     1272      -31     
- Partials      273      276       +3     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@edgarrmondragon edgarrmondragon marked this pull request as ready for review June 17, 2024 10:55
@edgarrmondragon edgarrmondragon force-pushed the edgarrmondragon/feat/ignore-catalog-cache branch from b933cf5 to 04432bd Compare June 17, 2024 15:48
@edgarrmondragon edgarrmondragon changed the title feat: Ignore Catalog Cache feat: Add CLI --refresh-catalog option and use_cached_catalog extractor extra to allow ignore the cached source catalog Jun 17, 2024
@edgarrmondragon edgarrmondragon changed the title feat: Add CLI --refresh-catalog option and use_cached_catalog extractor extra to allow ignore the cached source catalog feat: Added CLI --refresh-catalog option and extractor extra use_cached_catalog to ignore the cached source catalog Jun 17, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

feature: Add a --refresh option for meltano select to refresh a new copy of the discovered catalog
3 participants