End-to-End Data Engineering Pipeline

종료 등록 시간: 3 주 전 착불
종료 착불

I'm seeking an expert in data engineering to construct a comprehensive, end-to-end pipeline for a project I'm currently working on.

Key Project Details:

- Data Type: The project primarily deals with structured data, so familiarity and expertise with processing structured datasets is crucial.

- Data Storage: The processed data will be stored in a SQL database. Experience with SQL and database management is necessary.

- Data Source: The primary source of the data is APIs. Proficiency in working with APIs and extracting data from them is important.

Ideal Skills and Experience:

- Strong background in data engineering

- Proven experience in building end-to-end data pipelines

- Proficient in SQL and managing SQL databases

- Experienced in processing structured data

- Skilled in working with APIs

- Knowledge of data warehousing concepts would be a plus

- Experience with ETL tools like Apache NiFi, Talend, or Informatica.

- Practiced in implementing data quality checks and validation techniques.

- Familiarity with major cloud services such as AWS, Azure, or Google Cloud for data storage and processing.

Please provide examples of similar projects you've worked on in your proposal.

Preference for using AWS Glue for the ETL processes and data pipeline construction.

MySQL 데이터베이스 행정 SQL 데이터 웨어하우징 데이터베이스 개발

프로젝트 ID: #38880369

프로젝트 소개

25 건(제안서) 재택 근무형 프로젝트 서비스 이용 중: 2 주 전

이 일자리에 대한 프리랜서 25 명의 평균 입찰가: $171

OmarFarukBD

I AM NOT LIKE OTHER 99% OF SELLERS. YOU WILL PAY ONLY AFTER THE WORK IS COMPLETE, AND I ONLY FOCUS ON EXPLAINING WHAT I UNDERSTAND. PLEASE READ IT. I am going to start your project right now. As a data engineering exp 기타

$195 AUD (5일 이내)
(29 리뷰)
6.0
v2x5111

i can do it. 14 years exp. on website design HTML,Css ,My sql. javascript wordpress and flutter phpi can do it. 14 years exp. on website design HTML,Css ,My sql. javascript wordpress and flutter php

$99 AUD (7일 이내)
(17 리뷰)
5.2
idogoldblatt

As a freelancer experienced in both front and back-end technologies, my skills extend into comprehensive data engineering solutions that would be perfect for your project. From working with APIs and processing structur 기타

$120 AUD (3일 이내)
(1 리뷰)
4.1
rashidamjad

As a seasoned full-stack development team with over five years of experience, we possess the diverse skillset essential for constructing an efficient end-to-end data engineering pipeline. Our team's deep expertise in S 기타

$250 AUD (7일 이내)
(3 리뷰)
4.0
Bhatti1987

With 14+ years of expertise in database modeling, ETL solutions, and data pipeline design, I have a proven track record of delivering scalable and efficient solutions. My experience spans structured data processing, AP 기타

$140 AUD (7일 이내)
(13 리뷰)
4.1
gopiande

I’m an experienced data engineer with a strong track record in building robust data pipelines. Here’s how I can help: API Data Ingestion: Extract data efficiently using Python or AWS Glue. Data Transformation: Process 기타

$250 AUD (10일 이내)
(7 리뷰)
2.4
adrianmaynardny

Hi , I’m here to make your project a success. I’ve worked across all kinds of tech stacks like Database Development, MySQL, Data Warehousing, SQL and Database Administration, and I know how to build solutions that are 기타

$155 AUD (1일 이내)
(0 리뷰)
0.0
rajeshrolen

Hello anithast, We would like to grab this opportunity and will work till you get 100% satisfied with our work. We are an expert team which have many years of experience on SQL, MySQL, Database Administration, Databa 기타

$140 AUD (7일 이내)
(0 리뷰)
0.0
vishals397

Dear client, I am a full stack developer with over 10 years of experience in web development and project management. My passion tends to land on progressive web application development using React, Angular, and other 기타

$140 AUD (5일 이내)
(0 리뷰)
0.0
jacobm73

Dear client, I am eager to leverage my expertise in data engineering to construct a robust, end-to-end pipeline for your project. With extensive experience in processing structured data, managing SQL databases, and uti 기타

$140 AUD (7일 이내)
(0 리뷰)
0.0
syedfaiq12

I recently worked on an ETL pipeline using AWS Glue ,s3,lambda and Airflow i have experience with APIs as well

$250 AUD (7일 이내)
(0 리뷰)
0.0
him8407

Hello I'm individual freelancer i have more than 15 years of competitive experience in IT industry using Microsoft Technology, ASP.NET,MVC, .Net Core, C#.NET, Ajax,WCF, JQuery, Vb 6.0,SQL Server) , Mobile App Develop 기타

$140 AUD (7일 이내)
(0 리뷰)
0.0
Solutionzhere

Hello, We are expert Data Engineers with 10 years of rich experience all such practices you mentioned into your project detail. We not only specialize in Apache NiFi and Informatica, but we are also well-versed with 기타

$40 AUD (7일 이내)
(0 리뷰)
0.0
alkarlasaclayan

Hi! I'm only new to Freelancer.com but I bring with me 10 years of experience working in the field of Business Intelligence for esteemed companies (PUMA, Accenture, Macquarie)! I recently helped a client on another fre 기타

$250 AUD (15일 이내)
(0 리뷰)
0.0
Triomaulanazhari

Hiring someone for your data warehouse related tasks such as create data modeling, star schema, snowflake schema, SCD type 1,2,and 3, ERD, datawarehouse implementations and queries ? Im always available with you, My 기타

$140 AUD (7일 이내)
(0 리뷰)
0.0
mohamedk007

I am an experienced **data engineer** specializing in building **end-to-end data pipelines** for structured data. With expertise in **SQL**, **API integrations**, and **ETL processes**, I ensure efficient data extracti 기타

$100 AUD (4일 이내)
(0 리뷰)
0.0
JohnFranklin88

I have extensive experience in extracting data from various APIs and storing it in different databases with customizable configurations.

$250 AUD (5일 이내)
(0 리뷰)
0.0