Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Ecocounter: develop sensitivity/factor tables #1085

Open
gabrielwol opened this issue Oct 18, 2024 · 0 comments · May be fixed by #1096
Open

Ecocounter: develop sensitivity/factor tables #1085

gabrielwol opened this issue Oct 18, 2024 · 0 comments · May be fixed by #1096
Assignees
@gabrielwol
Labels
Ecocounter

Comments

@gabrielwol
Copy link
Collaborator

Develop schema to store Spectrum manual counts and resulting factors for scaling Ecocounter counts.
@gabrielwol gabrielwol changed the title Ecocounter: develop factor tables Ecocounter: develop sensitivity/factor tables Oct 18, 2024
gabrielwol added a commit that referenced this issue Oct 21, 2024
@gabrielwol
#1085 sensitivity_history table
b4e359b
gabrielwol added a commit that referenced this issue Oct 22, 2024
@gabrielwol
#1085 add counter variable to sites tables (used by ecocounter in com…
dcf802d 
…munications)
gabrielwol added a commit that referenced this issue Oct 22, 2024
@gabrielwol
#1085 script used to populate sensitivity history
9f9440c
gabrielwol added a commit that referenced this issue Oct 22, 2024
@gabrielwol
#1085 transform sensitivity_history and validation_results into corre…
01697e4 
…ction_factors
gabrielwol added a commit that referenced this issue Oct 22, 2024
@gabrielwol
#1085 counts_corrected view
8318257
gabrielwol added a commit that referenced this issue Oct 22, 2024
@gabrielwol
#1085 open data daily view
15da0e1
gabrielwol added a commit that referenced this issue Oct 24, 2024
@gabrielwol
#1085 update sensitivity history, fix groupby bug in opendata view
7312c2b
@gabrielwol gabrielwol self-assigned this Oct 29, 2024
gabrielwol added a commit that referenced this issue Oct 29, 2024
@gabrielwol
#1085 sensitivity -> setting
3f6a837
gabrielwol added a commit that referenced this issue Oct 29, 2024
@gabrielwol
#1085 add qc plots
49bfa9f
gabrielwol added a commit that referenced this issue Oct 29, 2024
@gabrielwol
#1085 add qc shiny app
19fdfef
gabrielwol added a commit that referenced this issue Oct 31, 2024
@gabrielwol
#1085 ecocounter_graph_volumes
ac7740b
gabrielwol added a commit that referenced this issue Oct 31, 2024
@gabrielwol
#1085 shiny app improvements; zoom, faster render times, dynamic labels
9b19644
gabrielwol added a commit that referenced this issue Oct 31, 2024
@gabrielwol
#1085 shiny app; add flow_id
581cd00
gabrielwol added a commit that referenced this issue Nov 7, 2024
@gabrielwol
#1085 improve export feature, fix scaled volume bug
6e8ba63
gabrielwol added a commit that referenced this issue Nov 7, 2024
@gabrielwol
#1085 add MOVE open data sync DAG
59b4db0
gabrielwol added a commit that referenced this issue Nov 7, 2024
@gabrielwol
#1085 add "direction_main" for easier grouping of flows
6e2562f
gabrielwol added a commit that referenced this issue Nov 7, 2024
@gabrielwol
#1085 fix anomalous_range join conditions for new shiny ranges (conta…
9adc3a9 
…in both site and flow ids)
gabrielwol added a commit that referenced this issue Nov 7, 2024
@gabrielwol
#1085 open data views (filtered + calibrated & raw, daily).
39ec9c3
gabrielwol added a commit that referenced this issue Nov 7, 2024
@gabrielwol
#1085 shiny; ability to view validated counts only
e9ccdb8
gabrielwol added a commit that referenced this issue Nov 8, 2024
@gabrielwol
#1085 don't pull for decommissioned sites/flows
a82948d
gabrielwol added a commit that referenced this issue Nov 8, 2024
@gabrielwol
#1085 base of ecocounter_open_data dag
232c1c3
gabrielwol added a commit that referenced this issue Nov 8, 2024
@gabrielwol
#1085 add task.bash to download data
6595b4f
gabrielwol added a commit that referenced this issue Nov 8, 2024
@gabrielwol
#1085 fix permissions error
511ea73
@gabrielwol gabrielwol linked a pull request Nov 8, 2024 that will close this issue
1085 Ecocounter Open Data Schema+DAG+QC plots #1096
Open
5 tasks
gabrielwol added a commit that referenced this issue Nov 12, 2024
@gabrielwol
#1085 switch open data views to tables + add insert functions, adjust…
2e8a97d 
… DAG
gabrielwol added a commit that referenced this issue Nov 12, 2024
@gabrielwol
#1085 test_dags add connection
e68b8c1
gabrielwol added a commit that referenced this issue Nov 12, 2024
@gabrielwol
#1085 sort sites, add daily tick marks
1930137
gabrielwol added a commit that referenced this issue Nov 21, 2024
@gabrielwol
#1085 r shiny updates + validation plots
516664e
gabrielwol added a commit that referenced this issue Nov 21, 2024
@gabrielwol
#1085 open data dictionary
4a2a3cd
gabrielwol added a commit that referenced this issue Nov 21, 2024
@gabrielwol
#1085 fix image links
8e19407
@gabrielwol gabrielwol linked a pull request Nov 21, 2024 that will close this issue
Open
5 tasks
gabrielwol added a commit that referenced this issue Nov 21, 2024
@gabrielwol
#1085 rename raw_counts to 15min_counts
ce6f289
gabrielwol added a commit that referenced this issue Nov 21, 2024
@gabrielwol
#1085 add locations pull to dag
905909a
gabrielwol added a commit that referenced this issue Nov 25, 2024
@gabrielwol
#1085 add DAG readme + DOC_MD
7e5da54
gabrielwol added a commit that referenced this issue Nov 25, 2024
@gabrielwol
#1085 remove externaltasksensor; (cross environment complexity, not n…
138798a 
…ecessary)
gabrielwol added a commit that referenced this issue Nov 25, 2024
@gabrielwol
#1085 map data pulls over years (last 2 months)
636844b
gabrielwol added a commit that referenced this issue Nov 26, 2024
@gabrielwol
#1085 remove discontinuities table, replace with sensitivity_history
c9f211e
gabrielwol added a commit that referenced this issue Nov 26, 2024
@gabrielwol
#1085 readme updates
1275087
gabrielwol added a commit that referenced this issue Nov 26, 2024
@gabrielwol
#1085 create open_data schema views for unified permanent cycling vol…
e66b0d4 
…umes
gabrielwol added a commit that referenced this issue Nov 26, 2024
@gabrielwol
#1085 update DAG to pull from open_data schema
1b4ddfb
gabrielwol added a commit that referenced this issue Nov 26, 2024
@gabrielwol
#1085 output readme with pandoc
2c1dcb1
gabrielwol added a commit that referenced this issue Nov 27, 2024
@gabrielwol
#1085 data check bug fix
8df8acf
gabrielwol added a commit that referenced this issue Nov 27, 2024
@gabrielwol
#1085 lat,lng to latitude,longitude
c3f3050
gabrielwol added a commit that referenced this issue Nov 27, 2024
@gabrielwol
#1085 doc updates
b3923a5
gabrielwol added a commit that referenced this issue Nov 28, 2024
@gabrielwol
#1085 bash script for re-exporting historical ecocounter data
90782fb
gabrielwol added a commit that referenced this issue Nov 28, 2024
@gabrielwol
#1085 use variable for EXPORT_PATH
54669ac
gabrielwol added a commit that referenced this issue Nov 29, 2024
@gabrielwol
#1085 add location_dir_id, extra columns to summary table
b0b7c3f
gabrielwol added a commit that referenced this issue Dec 2, 2024
@gabrielwol
#1085 fix for data-availability check
c8cc228
gabrielwol added a commit that referenced this issue Dec 2, 2024
@gabrielwol
#1085 fix: get_years -> int, minor doc changes
d89182f
gabrielwol added a commit that referenced this issue Dec 4, 2024
@gabrielwol
#1085 remove name columns from 15 min data
808cc2e
gabrielwol added a commit that referenced this issue Dec 4, 2024
@gabrielwol
#1085 add zeros to 15 min data
086d95f
gabrielwol added a commit that referenced this issue Dec 4, 2024
@gabrielwol
#1085 minor doc update
b2ec2f8
gabrielwol added a commit that referenced this issue Dec 18, 2024
@gabrielwol
#1085 remove toplevel database connections (#1112), remove deprecated…
d5dc31d 
… airflow imports (#1115)
gabrielwol added a commit that referenced this issue Dec 19, 2024
@gabrielwol
#1085 don't try to set os.environ['PGPASSWORD']
bfb52c9
gabrielwol added a commit that referenced this issue Dec 20, 2024
@gabrielwol
#1085 update year breaks
ae5c566
gabrielwol added a commit that referenced this issue Dec 20, 2024
@gabrielwol
#1085 use templating for conn details
d00e15a
gabrielwol added a commit that referenced this issue Dec 20, 2024
@gabrielwol
#1085 pandoc! + update readme pagebreaks
3b9dd0b
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@gabrielwol gabrielwol

Labels
Ecocounter
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

1085 Ecocounter Open Data Schema+DAG+QC plots CityofToronto/bdit_data-sources
1 participant
@gabrielwol