URL Processing and Metadata Aggregation in Drupal

Closed Posted 2 months ago Paid on delivery
Closed Paid on delivery

I have two APIs that work together to fetch and process URLs, and I need a developer to set up a cron job in my Drupal 10 environment to automate this process.

The first API fetches over 1.5k URLs every three months. The second API processes these URLs, retrieves their metadata, and creates a node for each one in Drupal. This process continues until all URLs yield a result, without any 'not available' (NA) results. If a URL returns an NA, it will repeat the process until a result is found.

The primary purpose of this project is data aggregation, specifically gathering metadata information from various URLs. The aggregated metadata will be stored in a database.

Ideal skills and experience for the job include:

- Proficiency in Drupal 10

- Familiarity with working with APIs

- Experience with setting up and managing cron jobs

- Strong understanding of data aggregation

- Database management skills

Please bid if you can help me with this project.

PHP Drupal Web Scraping MySQL Software Architecture

Project ID: #38754668

About the project

9 proposals Remote project Active 1 mo ago

9 freelancers are bidding on average ₹8444 for this job

curiosityweb

Total 9 years of experience in web development and from past 3 years working as Drupal 8/9 front and back-end development, along with theming development.  Knowledge of Drupal 8, WordPress, XHTML, CSS, MySQL, PhpMyAdm More

₹7000 INR in 7 days
(80 Reviews)
5.2
dunitech

I am excited to submit my proposal for setting up a cron job in your Drupal 10 environment to automate the process of fetching and processing URLs through your APIs. With my expertise in Drupal development and API inte More

₹7000 INR in 7 days
(6 Reviews)
4.4
parassharmadevel

With over X years of experience in web development, particularly in HTML, CSS, jQuery, and PHP, including using frameworks such as Laravel and CodeIgniter. I strongly believe that my skills align well with the requirem More

₹8000 INR in 2 days
(16 Reviews)
4.0
babulalchoudhar1

Having over six years of experience as a full-stack website developer, I've honed my skills to provide high-quality results efficiently. I've extensively utilized APIs and conducted data aggregation tasks in numerous p More

₹7000 INR in 7 days
(3 Reviews)
2.3
WemiAde

Hi, I’d love to help you automate the process of fetching and processing URLs in your Drupal 10 environment. With my experience in integrating APIs and managing cron jobs, I can set up a seamless system that fetches t More

₹7000 INR in 2 days
(0 Reviews)
0.0
adityaprince06

In addition to PHP, I've also developed a high level of proficiency in Drupal over the course of my eight-year career as a full stack developer. Being well-versed in Drupal 10, I am confident in my ability to set up an More

₹7000 INR in 7 days
(0 Reviews)
0.0
syedfahadahmad33

Hello, I just read your description and am interested in your project. I am an expert in Drupal 10 and have also worked on certain projects. If you need quality work then feel free to contact me. Thanks

₹12500 INR in 7 days
(0 Reviews)
0.0