Need help with Kafka expertise to Real-time Data Migration KafkaConnect

In Progress Posted 5 months ago Paid on delivery
In Progress Paid on delivery

I'm in need of a skilled data engineer who has good exposure to Kafka connect and its integration with Kafka (broker - schema registry) with security setup.

I am doing real time data migration from Oracle -> Kafka -> BigQuery. USing No Authentication, Everything is working end to end for me (using PLAINTEXT)

I am looking to advance the configuration to use SASL_PLAINTEXT or SASL_SCRAM.

FYI:

Using below connectors (Kafka connect)

- OracleCDC Connector

- BQSink Connector

Evaluation Criteria (MUST)

- Using SASL_PLAINTEXT/SASL_SCRAM the environment should be setup and data should sync end to end.

Note: Without any security part, everything is working for me already.

- Once above is done, I'll use Confluent cloud to host Broker and Schema Registry. Rest will be hosted on docker (connect & control center). So I expect the solution to work seemlessly

Note: My Environment (Docker Desktop) is already setup. ( Broker, Connect including the connectors, Control center, SchemaRegistry, ORacle, GCP)

Ideal skills for this project:

- Proficiency with KafkaConnect, Kafka, Kubernetes, Docker

- Strong understanding of real-time data integration solutions.

The project requires someone who can effectively implement this data migration, ensuring it's efficient, accurate, and runs smoothly in real-time.

Big Data Sales Apache Kafka

Project ID: #38444783

About the project

2 proposals Remote project Active 5 mos ago

Awarded to:

theanurupmillan

I HAVE DONE CERTIFICATIONS IN KAFKA CLUSTER SETUP AND MANAGEMENT. I'm Anurup Millan and I AM NEW ON FREELANCER, I am a seasoned backend developer specializing in building scalable, stable, and efficient backend system More

₹12000 INR in 5 days
(0 Reviews)
0.0

2 freelancers are bidding on average ₹12250 for this job

bindmission

Hello, I have 10 years of experience in Kafka, KafkaConnect, and real-time data integration. I can help you set up SASL_PLAINTEXT or SASL_SCRAM for secure data migration. I will ensure end-to-end data transfer from More

₹12500 INR in 3 days
(0 Reviews)
0.0