Azure Data Engineer(Indians Only)
₹500000-1000000 INR
Paid on delivery
Hands-on design, modeling, development, and delivery of data solutions.
Strong working knowledge of Azure services and components, with the ability to integrate various components into a scalable, reliable, and sustainable enterprise solution.
Develop and maintain ETL processes and data pipelines using Azure Data Factory (ADF).
Optimize data transformation processes using PySpark.
Production experience delivering CI/CD pipelines across Azure and vendor products.
Contribute to the design and development of enterprise standards.
Key knowledge of architectural patterns across code and infrastructure development.
Requirements:
Technical Skills and Experience:
Bachelor’s or master’s degree in computer science, Engineering, Data Science, or equivalent experience, with a preference for experience and a proven track record in advanced, innovative environments.
7-8 years of professional experience in data engineering.
Strong expertise in Microsoft Azure data services, particularly Azure Data Factory (ADF) and PySpark.
Experience with data pipeline design, development, and maintenance.
Proficiency in SQL and experience with NoSQL databases.
Knowledge of ETL/ELT processes and tools.
Familiarity with big data technologies such as Hadoop and Spark.
Experience with Azure Databricks, Data Lake, SQL Database, and other Azure data services.
Production experience delivering CI/CD pipelines across Azure and vendor products.
Knowledge of architectural patterns across code and infrastructure development.
Fully conversant with big-data processing approaches and “schema-on-read” methodologies, with a preference for a deep understanding of Spark, Databricks, and Delta Lake.
Experience with Agile delivery frameworks and tools (SAFe, Jira, Confluence, Azure DevOps).
Experience with visualization tools (Power BI, developing reports, dashboards, KPI scorecards).
Preferred Qualifications:
Azure Data Engineer certification.
Experience with data warehousing concepts and technologies.
Understanding of data security and compliance requirements.
Project ID: #38295041
About the project
15 freelancers are bidding on average ₹856667 for this job
I have 8.5 years of extensive experience in Data Engineering, I have honed my skills in with Python ,Spark, Airflow, Databricks, ETL Pipelines, SQL,BigQuery, GCP,MongoDB, Azure Eventhubs,Neo4j,TigerGraph, Kafka, Azure More
Hi there, With my solid 7-8 years of professional experience in data engineering, there's no doubt that I have the expertise you need. My comprehensive familiarity and ability to integrate various Azure services wi More
We provides top-notch AWS DevOps services to help you deliver software faster, make it scalable, and save on costs. Our team of experts manages your infrastructure securely, reliably, and efficiently, tailored to your More
