Python Tool for Big Data Processing

Status: Open
Hadiah: $173
Entri Diterima: 30

Deskripsi Kontes

We are seeking a skilled Python developer to design and optimize a robust tool capable of importing and processing hundreds of thousands of rows of data while interacting with an internal API. The tool must achieve a throughput of at least 10,000 transactions per second (TPS), with a preference for even higher performance.

The data import process will be semi-automatic, requiring real-time updates to the imported content, as the source file will dynamically grow or shrink with the addition or removal of data. Once the import and processing begin, the tool should produce two output tables:
1. A table containing the processed data.
2. A table with manually selected entries.

To elaborate your entry, please submit a big-data example of your choice that showcases:
- Efficient handling of large-scale datasets.
- High performance and scalability.
- Interaction with APIs to fetch or update data.

This will serve as the foundation for further refinement and development during the task.

Key Requirements:
- Advanced proficiency in Python, particularly for large-scale data processing.
- Proven experience working with big data and developing high-performance solutions.
- Expertise in creating efficient, scalable, and maintainable data processing pipelines.

Keahlian yang Disarankan

Ikuti Kontes Ini

Papan Klarifikasi Publik

maximg10
- 1 hari yang lalu
Hi, I have hands-on experience in big data processing with Apache Spark and Python.
- 1 hari yang lalu
NadiaJavaid
- 1 hari yang lalu
Hello, I’m Nadia Javaid, an IT graduate with expertise in data science and Python. I’ve completed a thesis on data driven models and worked on big data, APIs, and high-performance tools. Let’s connect.
- 1 hari yang lalu
Codeitsmarts
- 1 minggu yang lalu
I have 5 years of experience in PHP, mysql, Codeigniter, Wordpress, Jquery, HTML, CSS ,Python and many more. See my portfolio for art work samples and my clients feedback.
Please initiate chat for further discussion. I will do my best for you , with a Positive Hope! Regards
-----------------------------------------------------------------------------
- 1 minggu yang lalu
mailtoafaqCEO
- 3 minggu yang lalu
I have done all
- 3 minggu yang lalu
solutionslanguag
- 3 minggu yang lalu
#increaseprize
- 3 minggu yang lalu
perfection25
- 3 minggu yang lalu
Please message #25 I assure that I can do your required work as per your exact requirements
- 3 minggu yang lalu
AhsanAsif279
- 4 minggu yang lalu
Hi contest holder as it i a contest , so can u provide further details ?.or you looking for a proposal ?
- 4 minggu yang lalu
zafarfarooq612
- 4 minggu yang lalu
I am a professional python developer. I am pretty sure. I can help you. Waiting for your response. Thanks
- 4 minggu yang lalu