Python Script to Fetch News URLs

  • Status: Closed
  • Prize: ₹12500
  • Entries Received: 51

Contest Brief

I need a python script that fetches all the URLs from a news website every 5 minutes. The script should run on www.pythonanywhere.com and post all the URLs to an API.

Key Requirements:
- The script should be able to ignore duplicate URLs
- Ideally, the freelancer should have experience with web scraping and working with APIs.
- The ability to write clean, efficient code is a must.

Please note that the specific structure of the news website is currently unknown, as the client has not specified. Therefore, the script should be flexible enough to handle different types of content (static HTML pages, JavaScript-rendered content, API-based content).

Recommended Skills

No winners yet
Post a Contest Like This

Top entries from this contest

View More Entries

Public Clarification Board

  • abdulghafarshar
    abdulghafarshar
    • 2 weeks ago

    Hello Sir,
    I am an expert full-stack developer with a strong background in Python, specializing in Django, Flask, and FastAPI. I am eager to create a Python script that fetches URLs from a news website every 5 minutes.
    Key highlights of my approach:
    • Web Scraping: Proficient in using libraries like BeautifulSoup and Scrapy to handle various content types, including static HTML and JavaScript-rendered pages.
    • API Integration: I will ensure seamless posting of URLs to your API while implementing logic to filter out duplicates.
    • Scheduled Execution: The script will be designed to run every 5 minutes on PythonAnywhere for timely updates.
    • Clean Code: I prioritize writing efficient, maintainable code that adheres to best practices.
    I am confident in delivering a robust solution tailored to your needs. I look forward to discussing this project further!

    • 2 weeks ago
  • harpalsinh88
    harpalsinh88
    • 1 month ago

    check #33 , i've very recent experience with similar project and also attached the link to video of live demo

    • 1 month ago
  • abdulghafarshar
    abdulghafarshar
    • 1 month ago

    Hello sir, iam expert in such works and i done such works alot. Please check #22 and contact me i have few questions regarding this work. I complete the this work in best way.

    • 1 month ago
  • Krrishniresh7788
    Krrishniresh7788
    • 1 month ago

    Hello contest holder, are you still looking for a entry?

    • 1 month ago
  • connectwithavish
    connectwithavish
    • 2 months ago

    Hello there! hope you are doing great.
    I have 5 years of experience in PHP, mysql, Codeigniter, Wordpress, Jquery, HTML, CSS ,Python and many more. See my portfolio for art work samples.

    Please initiate chat for further discussion. I will do my best for you , with a Positive Hope! Regards
    -----------------------------------------------------------------------------

    • 2 months ago
  • mailtoafaqCEO
    mailtoafaqCEO
    • 2 months ago

    #15 Inbox me please

    • 2 months ago
  • Toufiqs1
    Toufiqs1
    • 2 months ago

    #2

    • 2 months ago
  • abdulrahman545
    abdulrahman545
    • 2 months ago

    Hi, Can you provide link for the news specifically?

    • 2 months ago

Show more comments

How to get started with contests

  • Post your contest

    Post Your Contest Quick and easy

  • Get tons of entries

    Get Tons of Entries From around the world

  • Award the best entry

    Award the best entry Download the files - Easy!

Post a Contest Now or Join us Today!