This repo collects data from various webpages through cron jobs (via GitHub Actions). The frequency of the trigger depends on the data source, but will not make commits unless a change is detected.

• Vehicle reports (traffic stops)

• Triggered: first of every month at 11am UTC
• Output: /results/vehicle_stops.csv
• Parser params:
  • metric = 'vehicle_stops'
  • html_doc = 'https://raw.githubusercontent.com/gh-islg/reform_dash_scraper/main/vehicle_stops.html'

• Domestic violence reports

• Triggered: first of every month at 11am UTC
• Output: /results/domestic_violence.csv
• Parser params:
  • metric = 'domestic_violence'
  • html_doc = 'https://raw.githubusercontent.com/gh-islg/reform_dash_scraper/main/domestic_violence.html'

• SQF reports

• Triggered: first of every month at 11am UTC
• Output: /results/sqf.csv
• Parser params:
  • metric = 'sqf'
  • html_doc = 'https://raw.githubusercontent.com/gh-islg/reform_dash_scraper/main/sqf.html'