Hello there,
Data engineer with extensive experience in DataBricks and AWS, adept at job creation, workflow management, S3 mounting, Dbutils, Utils, integration with code repositories, DataBricks Notebooks, and Azure Data Lake.
I’ll start by working closely with your data scientists and IT teams to design and automate ML workflows tailored to your needs. CI/CD pipelines will be set up to ensure smooth and continuous deployment of models.
Similar Projects:
1. Predictive Maintenance System: - Objective: Develop a predictive maintenance system for manufacturing equipment using machine learning algorithms. - Data Sources: Sensor data from machines, maintenance logs, historical failure data. - Technologies: DataBricks for data preprocessing, AWS S3 for data storage, ML models for predictive analytics, DataBricks Notebooks for model development and deployment.
2. Customer Churn Prediction: - Objective: Build a model to predict customer churn for a subscription-based service. - Data Sources: Customer usage data, demographic information, customer support interactions. - Technologies: DataBricks for data exploration and feature engineering, AWS S3 for data storage, ML algorithms for churn
prediction, DataBricks Notebooks for model training and evaluation.
I hope my skills are matching for your requirements and profile, please ping me at your convenience time so that we can go for further discussion.
Regards,
Navina