Skip to content

Dataform is a framework for managing SQL based data operations in BigQuery, Snowflake, and Redshift

License

Notifications You must be signed in to change notification settings

dreamdata-io/dataform

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Dataform is a tool for managing SQL based data operations in your warehouse.

Cloud build status NPM package version npm
NPM dependency status License information

Intro

Dataform is an open source framework for managing SQL based data operations in your warehouse. It helps you pilot the T in ELT, with SQL code, and brings engineering best practices to analytics pipeline management.

How it works

  • You develop datasets and assertions in SQL with Dataform’s built-in templating syntax and APIs
  • Dataform compiles your project into a DAG (Directed Acyclic Graph) of every action in SQL
  • Dataform connects to your warehouse and runs the DAG or just the actions that you specify
  • You receive detailed execution logs

Get started

With the CLI

You can install the Dataform SDK using the following command line. Follow the docs to get started.

npm i -g @dataform/cli

With Dataform web

Dataform web is a development environment and production ready deployment tool for the Dataform SDK. You can learn more on dataform.co

Want to report a bug or request a feature?

Open an issue or email us at opensource@dataform.co

Want to contribute?

Check out our contributors guide to get started with setting up the repo.

About

Dataform is a framework for managing SQL based data operations in BigQuery, Snowflake, and Redshift

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages

  • TypeScript 90.2%
  • Starlark 8.4%
  • Other 1.4%