A Python script designed for ETL (Extract, Transform, Load) operations with a LiteSQL database, implemented in an efficient and optimized manner.
This Python script performs the following tasks:
- Database Creation & Initialization: Sets up a LiteSQL database.
- Data Insertion: Inserts data into the database.
- Data Retrieval: Reads data from the database.
- Data Export: Exports data to CSV and JSON files.
- Reporting: Generates insightful reports based on the data.
This project aims to streamline data management and reporting processes, making it easier to efficiently handle and analyze data.
in requirements.txt
file.
python3, python3.10-venv, pip
-
Clone the repository:
git clone https://github.com/hadilotfy/Streamline-ETL-Reporting.git
-
Change Directory:
cd Streamline-ETL-Reporting/
-
Optional: make and activate a new virtual environment for script testing
python -m venv env env/Scripts/activate # or source env/Scripts/activate
-
Install script: either only install the required libraries using:
pip install -r requirements.txt
or install the script to your system using:
pip install .
call the script in you shell.
src/script.py --help
or
python src/script.py --help
if you installed the script using 'pip install .' , you can call using:
hadi-etl-main.exe --help