Hi there,
I will utilize my expertise in dbt, Airflow, and BigQuery to improve the data transformation and modeling process. I will focus on optimizing query performance, integrating new data sources, and enhancing data accuracy.
To achieve this, I will:
-Analyze your current data model and identify areas for improvement
-Use dbt to transform and model data, ensuring data quality and consistency
-Schedule automated data pipelines using Airflow, ensuring efficient data processing and minimal downtime
-Store and query data in BigQuery, leveraging its scalability and performance capabilities
-Optimize query performance using best practices and techniques
-Integrate new data sources, ensuring seamless data flow and minimal disruptions
-Enhance data accuracy by implementing data validation and quality control measures
What specific data sources do you plan to integrate, and are there any specific performance metrics or KPIs you would like me to focus on during the optimization process?
As a senior data engineer with 7 years of experience in data engineering and analytics, I have worked on multiple projects involving dbt, Airflow, and BigQuery.
Skills:
- BigQuery
- Data Engineering
- Data Modeling
- Data Transformation
- Data Integration
- Data Accuracy
Due to NDA restrictions, I cannot share previous project details, but I am available to discuss different approaches and provide a demo if needed. Please initiate a chat to further discuss the project.
Regards,
Akhilesh