Hey team,
Skilled Data Engineer with extensive experience of 5+ years in designing, building, and optimizing large-scale data pipelines and data lakes using AWS services. Proficient in data warehousing, ETL/ELT processes, and big data technologies with a strong focus on ensuring data quality, security, and accessibility.
Core Competencies
AWS Services: EC2, S3, Glue, Lambda, Redshift, RDS, OpenSearch, ElasticSearch, Kinesis, Athena
Data Warehousing: Redshift, Snowflake, Amazon Aurora
ETL/ELT Tools: AWS Glue, Apache Spark, Apache Kafka, Talend
Programming: Python, SQL
Big Data Technologies: Hadoop, Spark
Cloud Infrastructure: Terraform, AWS CloudFormation
Data Security: Data encryption, IAM roles, AWS KMS, compliance with regulations (GDPR, HIPAA, etc.)
Version Control & Collaboration: Git, GitHub, JIRA, Slack
Channel Outage Detection system OOT Platform (Dish) (AWS Cloud): -
Objective: Dish Media Technologies offers TV on demand services. Dish wants to develop a system to identify the channel down before it hampers the customer experience. Also develop an Anomaly detection model using the generated outage data. - Data Sources: User browsing history, purchase history, product metadata. -
Technologies: Python, ETL, NEW RELIC, DATAIKU, AWS services.
I would like to discuss further about this requirement, please ping me at your convenience time so that we can go for further discussion.
Regards,
Navina