Hi there,
I am an expert in developing server side automation and background task scripts for Linux servers with more than two years of experience. After carefully reviewing your system, here are my thoughts and development proposal:
1. Develop the CLI driven software using Node.js
2. Setup search database for caching and quick lookup (TypeSense local or Elastic Search)
3. A fully documented, command driven tool that can generate the data as you require
4. Support for CSV and HTML based data/report generation
5, Setting up a bare bone Linux server (OpenSuse, Ubuntu or Debian 9/10) (will require server with Root SSH password)
6. Firewalld and fail2ban security setup for Linux OS
From the scope of the data you are suggesting, I will suggest a machine with decent hardware specification (at least 8 GB of Ram and 120 GB SSD). If you are on AWS EC2 or GCP Compute Engine then it will be much easier to scale accordingly compared to dedicated Linux hosting elsewhere. Let me know your thoughts and comments on my proposal. Thanks for your time and consideration.