Need help with Kafka expertise to Real-time Data Migration KafkaConnect
₹1500-12500 INR
Paid on delivery
I'm in need of a skilled data engineer who has good exposure to Kafka connect and its integration with Kafka (broker - schema registry) with security setup.
I am doing real time data migration from Oracle -> Kafka -> BigQuery. USing No Authentication, Everything is working end to end for me (using PLAINTEXT)
I am looking to advance the configuration to use SASL_PLAINTEXT or SASL_SCRAM.
FYI:
Using below connectors (Kafka connect)
- OracleCDC Connector
- BQSink Connector
Evaluation Criteria (MUST)
- Using SASL_PLAINTEXT/SASL_SCRAM the environment should be setup and data should sync end to end.
Note: Without any security part, everything is working for me already.
- Once above is done, I'll use Confluent cloud to host Broker and Schema Registry. Rest will be hosted on docker (connect & control center). So I expect the solution to work seemlessly
Note: My Environment (Docker Desktop) is already setup. ( Broker, Connect including the connectors, Control center, SchemaRegistry, ORacle, GCP)
Ideal skills for this project:
- Proficiency with KafkaConnect, Kafka, Kubernetes, Docker
- Strong understanding of real-time data integration solutions.
The project requires someone who can effectively implement this data migration, ensuring it's efficient, accurate, and runs smoothly in real-time.
Project ID: #38444783
About the project
Awarded to:
I HAVE DONE CERTIFICATIONS IN KAFKA CLUSTER SETUP AND MANAGEMENT. I'm Anurup Millan and I AM NEW ON FREELANCER, I am a seasoned backend developer specializing in building scalable, stable, and efficient backend system More
2 freelancers are bidding on average ₹12250 for this job
Hello, I have 10 years of experience in Kafka, KafkaConnect, and real-time data integration. I can help you set up SASL_PLAINTEXT or SASL_SCRAM for secure data migration. I will ensure end-to-end data transfer from More