Python Web Scraping Code Optimization

Otevřený Zveřejněno před 22 hodinami K zaplacení v momentě doručení Končí za 6 dní
Otevřený K zaplacení v momentě doručení Končí za 6 dní

I'm working on a web scraping project using Python and need help optimizing my code for better performance. Specifically, I'm looking for an expert who can help with:

The current version of the script scrapes data from a single web page that generates dynamic data after a click and saves the results into an Excel file. While it works, the execution time is quite slow, especially when scraping large amounts of data (multiple clicks). The code is written with basic loops, and I believe that restructuring it could significantly speed up the process.

• Optimisation of loops

• Efficient saving to Excel

Currently, I'm scraping a large data set with over 1,000,000 records. The ideal freelancer for this job should have extensive experience with Python, web scraping, and data processing. Proficiency in optimising loops and data storage methods is crucial. Please only apply if you're able to demonstrate similar past work.

Dolování dat Zpracování dat Python Softwarová architektura Sběr dat z webových stránek

Identifikační číslo projektu: #38619325

O projektu

23 nabídek Otevřeno nabídkám Projekt na dálku Aktivní před 3 hodinami

23 Freelnceři na tento projekt zveřejňují nabídky v průměru $221

MashoodurRehman1

I am Python Web Scraping and Optimization developer and I can optimize your web scraping code to improve performance. With extensive experience in Python, web scraping, and data processing, I can efficiently restructur Další

$250 USD za 2 dní
(195 Recenzí)
8.0
toni5705

Hello It's a pleasure to meet you My name is Anthony Muñoz. I am the Principal Engineer at DSPro, a software development agency. I have over 10 years of experience working as a Full-Stack and software developer. I am d Další

$500 USD za 7 dní
(3 Recenzí)
7.7
fatimatuzzohura

Hello, I am writing to express my interest in the project you've outlined. With 8 years of experience as a professional software developer specializing in Python, I possess a strong background in automating processes Další

$250 USD za 3 dní
(222 Recenzí)
7.5
yoyopriyam

With my extensive 12 years of experience honing skills in Data Mining, Python, and Software Architecture, I am confident that I can put your web scraping project on the fast-track to success. I have a proven track reco Další

$140 USD za 7 dní
(125 Recenzí)
7.0
AnjaliMehta

Hi There! I have understood the requirements for the task. I have 8+ years of experience in performing Data Analytics, Automation and various other calculations and analysis using VBA, Macro, Power Queries, Pivot table Další

$140 USD za 7 dní
(12 Recenzí)
5.8
rashidamjad

Dear Vhukhudo, I hope this proposal finds you well. It seems like you're in need of some Python magic to optimize your web scraping code for better performance. I assure you, this is where I come in with my expertise Další

$250 USD za 8 dní
(23 Recenzí)
5.8
blackrockwise

Hi there, I like how you have outlined your project description. I can handle this project effectively making sure that I put speed and performance into consideration. You can check my profile Další

$225 USD za 5 dní
(3 Recenzí)
5.4