Open
Description
Detailed Description
Currently RAWDIR has to be local
Context
- for gfs, its good to download the raw files to s3, so the next time the consumer runs, it doesnt need to re download these
Possible Implementation
- use ffspec, or similar, instead of
pathlib
in https://github.com/openclimatefix/nwp-consumer/blob/main/src/nwp_consumer/internal/repositories/raw_repositories/noaa_s3.py#L131
Metadata
Assignees
Labels
No labels