End-to-End Data Engineering Pipeline
$30-250 AUD
착불
I'm seeking an expert in data engineering to construct a comprehensive, end-to-end pipeline for a project I'm currently working on.
Key Project Details:
- Data Type: The project primarily deals with structured data, so familiarity and expertise with processing structured datasets is crucial.
- Data Storage: The processed data will be stored in a SQL database. Experience with SQL and database management is necessary.
- Data Source: The primary source of the data is APIs. Proficiency in working with APIs and extracting data from them is important.
Ideal Skills and Experience:
- Strong background in data engineering
- Proven experience in building end-to-end data pipelines
- Proficient in SQL and managing SQL databases
- Experienced in processing structured data
- Skilled in working with APIs
- Knowledge of data warehousing concepts would be a plus
- Experience with ETL tools like Apache NiFi, Talend, or Informatica.
- Practiced in implementing data quality checks and validation techniques.
- Familiarity with major cloud services such as AWS, Azure, or Google Cloud for data storage and processing.
Please provide examples of similar projects you've worked on in your proposal.
Preference for using AWS Glue for the ETL processes and data pipeline construction.
프로젝트 ID: #38880369
프로젝트 소개
이 일자리에 대한 프리랜서 25 명의 평균 입찰가: $171
I AM NOT LIKE OTHER 99% OF SELLERS. YOU WILL PAY ONLY AFTER THE WORK IS COMPLETE, AND I ONLY FOCUS ON EXPLAINING WHAT I UNDERSTAND. PLEASE READ IT. I am going to start your project right now. As a data engineering exp 기타
i can do it. 14 years exp. on website design HTML,Css ,My sql. javascript wordpress and flutter phpi can do it. 14 years exp. on website design HTML,Css ,My sql. javascript wordpress and flutter php
As a freelancer experienced in both front and back-end technologies, my skills extend into comprehensive data engineering solutions that would be perfect for your project. From working with APIs and processing structur 기타
As a seasoned full-stack development team with over five years of experience, we possess the diverse skillset essential for constructing an efficient end-to-end data engineering pipeline. Our team's deep expertise in S 기타
With 14+ years of expertise in database modeling, ETL solutions, and data pipeline design, I have a proven track record of delivering scalable and efficient solutions. My experience spans structured data processing, AP 기타
Hi , I’m here to make your project a success. I’ve worked across all kinds of tech stacks like Database Development, MySQL, Data Warehousing, SQL and Database Administration, and I know how to build solutions that are 기타
Hello anithast, We would like to grab this opportunity and will work till you get 100% satisfied with our work. We are an expert team which have many years of experience on SQL, MySQL, Database Administration, Databa 기타
Dear client, I am a full stack developer with over 10 years of experience in web development and project management. My passion tends to land on progressive web application development using React, Angular, and other 기타
I recently worked on an ETL pipeline using AWS Glue ,s3,lambda and Airflow i have experience with APIs as well
Hello, We are expert Data Engineers with 10 years of rich experience all such practices you mentioned into your project detail. We not only specialize in Apache NiFi and Informatica, but we are also well-versed with 기타
Hi! I'm only new to Freelancer.com but I bring with me 10 years of experience working in the field of Business Intelligence for esteemed companies (PUMA, Accenture, Macquarie)! I recently helped a client on another fre 기타
Hiring someone for your data warehouse related tasks such as create data modeling, star schema, snowflake schema, SCD type 1,2,and 3, ERD, datawarehouse implementations and queries ? Im always available with you, My 기타
I am an experienced **data engineer** specializing in building **end-to-end data pipelines** for structured data. With expertise in **SQL**, **API integrations**, and **ETL processes**, I ensure efficient data extracti 기타
I have extensive experience in extracting data from various APIs and storing it in different databases with customizable configurations.