Data Engineers with Apache Airflow & Python Expertise

Open Posted 3 hours ago Paid on delivery Ends in 6 days
Open Ends in 6 days

I'm seeking multiple engineers specializing in Apache Airflow, with strong Python and PostgreSQL skills. AWS knowledge is a significant plus.

As we expand our data platform 1.0, familiarity with these tools will greatly enhance your bid:

- Data lineage implementation using Marquez

- Data streaming setup with Kafka and Debezium

Additionally, I'm in need of a short-term DevOps or DataOps professional to assist in the early creation of CI/CD pipelines, alongside establishing a testing and production environment.

Critical tasks for the Apache Airflow engineers will include:

- Building and scheduling workflows

- Integrating workflows with AWS services

- Optimizing and troubleshooting existing workflows

The ideal candidates will be proactive, ready to tackle immediate components of the data platform, which include:

- Data lineage with Marquez

- Streaming with Kafka and Debezium

- CI/CD pipeline creation

Skills that are essential for the DevOps/DataOps member:

- Expertise in CI/CD pipelines

- Experience in creating testing environments

- Proficiency in production environment setup

Your expertise and proactive approach will ensure the successful expansion and implementation of our data platform.

Python Amazon Web Services Hadoop Linux Big Data Sales

Project ID: #39051668

About the project

35 proposals Open for bidding Remote project Active 35 mins ago

35 freelancers are bidding on average €20/hour for this job

AwaisChaudhry

Hello, I understand you're looking for experienced engineers who specialize in Apache Airflow, strong Python skills, and PostgreSQL knowledge, along with a solid background in AWS. My approach would be to focus on bui More

€24 EUR / hour
(25 Reviews)
7.8
deniskirilov0212

Hello, I am an experienced engineer specializing in Apache Airflow, Python, and PostgreSQL, making me well-equipped to support your data platform expansion. I have hands-on expertise in building and optimizing workflo More

€18 EUR / hour
(8 Reviews)
6.6
patilpk153

Experienced data engineer well versed with airflow and devops certified in kubernetes and would like to discuss further

€18 EUR / hour
(18 Reviews)
5.0
JustinJcob

Hi Thank you for the opportunity to bid on your project. An Experienced Apache Airflow Engineer with strong Python, PostgreSQL, and AWS skills, ready to tackle data platform 1.0 enhancements including Marquez data li More

€15 EUR / hour
(7 Reviews)
4.6
rajat23091969

Hello ReneDresen, As an experienced data engineer and DevOps specialist, I am confident in my ability to meet the requirements of your project. With proficiency in Python, Linux, AWS, and Big Data technologies like Ha More

€12 EUR / hour
(8 Reviews)
4.1
jesus0305

Hello, As an experienced computer scientist with a real passion for leveraging technology to solve complex problems, I believe my skills are a strong fit for your project. First and foremost, I'd like to showcase my p More

€24 EUR / hour
(2 Reviews)
2.3
irfan0430

My name is Irfan, and I hold extensive expertise in Python and data engineering to successfully tackle the tasks outlined for the Apache Airflow Engineers. Having worked on Python frameworks like Flask, asyncio, fastAP More

€15 EUR / hour
(4 Reviews)
2.3
ivans69

Hi, Rene D. I am thrilled about the opportunity to collaborate on your project! With extensive experience in Linux, Amazon Web Services, Python, Big Data Sales and Hadoop, I bring a professional skillset and a deep co More

€14 EUR / hour
(1 Review)
1.4
Nehag510

Hello I have thoroughly reviewed your project description and am confident in my ability to assist you in completing it successfully. I believe it would be highly beneficial to delve deeper into the specifics of the j More

€15 EUR / hour
(1 Review)
1.4
williamb156

Hello, As an experienced Full-Stack developer with extensive knowledge in a range of programming languages including Python, I am well-equipped to handle the critical tasks associated with your project. In my 7+ years More

€28 EUR / hour
(0 Reviews)
0.0
elvis162

Hello there! Going through your job description, I believe my skill set makes me an excellent fit. I am very confident for your job - Data Engineers with Apache Airflow & Python Expertise because I have worked on sim More

€19 EUR / hour
(0 Reviews)
0.0
michaelj079

Hello, Having worked extensively in Full Stack development for over 7 years, I bring a vast range of programming languages and technologies to the table. Python, being one of my core strengths, is incredibly aligned w More

€28 EUR / hour
(0 Reviews)
0.0
Mirko155

✅✅✅Hello. AI/ML/NLP/ChatBot/LLM/AI Integration Expert Here!!!✅✅✅ I appreciate for your job posting first. I have gone through your description and I am reaching out to you with my interest in this job. As a senior AI/M More

€15 EUR / hour
(0 Reviews)
0.0
mihajlop4

Hello! I am a passionate Full Stack Developer with over 7 years of experience in building high-quality web applications. My expertise spans across Hadoop, Big Data Sales, Amazon Web Services, Linux and Python technolog More

€19 EUR / hour
(0 Reviews)
0.0
weisofttech

Hello Rene D., Thanks for sharing details about your project, It seems like a perfect match for our skills and it’s exactly the kind of challenge we love taking on. With 13+ years of experience in Amazon Web Services More

€15 EUR / hour
(0 Reviews)
0.0
michaeld876

Hello I hope you’re doing well! Your project to expand Data Platform 1.0 is exciting, and I’m confident that my expertise aligns with your needs. With a strong background in Apache Airflow, Python, PostgreSQL, and AWS More

€15 EUR / hour
(0 Reviews)
0.0
ShannonL84

With my extensive experience in Full Stack Development, I have had the opportunity to work on complex and data-intensive applications. Leveraging the power of Python and Django, I've built robust systems that handle ta More

€15 EUR / hour
(0 Reviews)
0.0
rafael9977

Dear Client, I have completed very similiar projects. So I can complete your project accurately in time. I always approach work with ownership mindset so the best quality and accurate timeline is what I guarantee you. More

€15 EUR / hour
(0 Reviews)
0.0
shashank165

Hi Team, I have over 7 years of experience in Apache Airflow, Python, and PostgreSQL, I specialize in building scalable data workflows and optimizing ETL pipelines. Core Skills • Apache Airflow workflow orchestratio More

€15 EUR / hour
(0 Reviews)
0.0
ayushkumaroo7

Hello, My core expertise is in AWS DevOps and Data Engineering. I specialize in setting up Airflow, designing data pipelines, and working extensively with various AWS services. Additionally, I have strong experience i More

€15 EUR / hour
(0 Reviews)
0.0