Remote Sr. Data Platform Engineer (Spark & Scala) in India for 12 months
$20-30 USD / hour
Closed
Posted 7 months ago
$20-30 USD / hour
Role Proficiency:
Develop data-driven solutions for difficult business challenges. Utilizing analytical statistical and programming skills to collect analyze and interpret large data sets with supervision.
Outcomes:
- Work with stakeholders throughout the organization to identify opportunities for leveraging data from our customers to create models that can generate business insights
- Build predictive models and machine learning algorithms to analyse large amounts of information to discover trends and patterns.
- Mine and analyse data from company databases to drive optimization and improvement of product development marketing techniques business strategies etc
- Develop processes and tools to monitor and analyse model performance and data accuracy.
- Coordinate with different functional teams to implement models and monitor outcomes.
- Set FAST goals and provide feedback on FAST goals of reportees
Measures of Outcomes:
- Number of business processes changed due to vital analysis.
- Models applied to Business Problems
- Number of Business Intelligent Dashboards developed
- Number of productivity standards defined for project
- Number of mandatory trainings completed
Knowledge Examples:
- Programming languages – Java/ Python/ R / Scala
- Web Services - Redshift S3 Spark DigitalOcean etc.
- Statistical and data mining techniques: GLM/Regression Random Forest Boosting Trees text mining social network analysis etc.
- Google Analytics Site Catalyst Coremetrics Adwords Crimson Hexagon Facebook Insights etc.
- Computing Tools - Map/Reduce Hadoop Hive Spark Gurobi MySQL etc.
- Database languages such as SQL NoSQL
- Analytical tools and languages such as SAS & Mahout.
- Practical experience with ETL data processing etc.
- Proficiency in MATLAB.
- Data visualization software such as Tableau or Qlik.
- Proficient in mathematics and calculations.
- Utilization of spreadsheet tools such as Microsoft Excel or Google Sheets
Mandatory skills: Scala + Spark + AWS/any cloud
Job Description:
· Design and deliver scalable web services, APIs, and backend data modules.
· Experience in writing multithreaded programs running in Scala/Spark.
· Experience with Git and building tools like Gradle/Maven/SBT.
· Strong understanding of object-oriented design, data structures, algorithms, profiling, and optimization.
· Knowledge of top algorithms like sorting, heap/stack, queue, search, etc.
· Familiarity with test-driven development
· Thrive in a fast-paced environment, with the ability to deliver code of quality quickly.
· Attention to detail. Strong communication and collaboration skills.
· Understand requirements and develop reusable code using design patterns & component architecture and write unit test cases.
· Collaborate with product management and engineering teams to elicit and understand the requirements and develop solutions.
· Stay current with the latest tools, technology ideas, and methodologies; share knowledge by clearly articulating results and ideas to key decision-makers.
Engagement:
► Remote in India
► Schedule: Fixed 9-5 preferred but can explore flexible options for the right candidate
► Timezone: Indian Standard Time
► Only Individuals who are fulltime-freelancers can apply, agencies are not eligible.