Data Engineer Jobs

I'm in need of a skilled data engineer who can process semi-structured JSON data using Databricks. I want solution using Databricks. Only react if you going to use databricks for my solutions. Requirements: - Data Cleansing: Identifying and correcting errors in the data. - Data Transformation: Modifying the data into a suitable format for analysis. - Data Enrichment: Enhancing the data by adding relevant information from other sources. Ideal candidates should have: - Extensive experience with Databricks. - Proficient in handling semi-structured data, particularly JSON files. - Strong skills in data cleansing, transformation, and enrichment.

I need someone to systematically collect and compile contact information for small Canadian tech businesses. The primary use for this data will be market research, lead generation, and business analysis, so the data needs to be accurate and up-to-date. Ideal skills: - Data collection and analysis - Market research - Lead generation - Knowledge of the technology sector This project will focus on gathering contact information for small tech businesses in Canada. You should be able to source and compile useful data efficiently. Please note that the specific information needed for each business has yet to be confirmed but may potentially include contact names and emails, phone numbers and addresses, as well as business sector and size. Previous experience in gathering such data and understan...

I'm in need of a data entry professional who can start working immediately. Your primary task will involve copying and pasting data from various websites into my text file and CMS. The data will come from 81 Television Channels and radio stations programming schedules. Training will be provided so you can follow the instructions and training accurately. Key Requirements: - Immediate availability - Speed and accuracy in data entry - No mistakes allowed. - Ability to follow instructions and training Ideal Skills: - Prior experience with data entry is preferred - Familiarity with copy/pasting tasks - Experience with CMS (Content Management System) is a plus - Basic understanding of spreadsheet software (e.g., Excel) is beneficial - Basic HTML knowledge is not required but will be a pl...

I'm looking for a freelance resume writer who specializes in tech resumes, particularly for data engineering positions in the UK. My goal is to create a compelling resume that highlights my skills and experiences effectively for mid-level roles. Key Skills to Highlight: - Proficiency in Python and SQL - Experience with Cloud platforms like Azure - Familiarity with Databricks, PySpark, PowerBI, Snowflake, DBT cloud, Azure Data Factory, Synapse Analytics, ETL, CI/CD, Azure DevOPs, C# .Net Most Recent Job Experience: - Data Engineering The ideal candidate for this project should have: - Proven experience in writing tech resumes, particularly for data engineering roles - In-depth understanding of the data engineering field - Ability to articulate and present technical skills and experi...

I need a professional who can help me develop skills in data cleaning, transformation, and schema design by organizing raw, fragmented data into a cohesive and valid data warehouse schema suitable for Redshift. This project focuses on a fictional large clothing company that offers both discount and luxury brands of men's and women's clothing and accessories. Key aspects of the project: - Data Cleaning: This is the most critical aspect of the project. The selected freelancer will need to identify and rectify data quality issues such as missing values, duplicate entries, and incorrect data formats in the provided CSV files. - Data Transformation: Following the cleaning process, the freelancer will need to transform the data into a format suitable for schema design and storage ...

I'm seeking an expert who can set up a seamless connection between AWS Airflow and Azure Databricks primarily for data orchestration. The data source for this project will be Amazon S3, where the data is stored in table format and the final output to be stored in Databricks delta table. The ideal candidate will have extensive experience with both AWS and Azure platforms, particularly with Airflow and Databricks. Proficiency in handling and orchestrating data from Amazon S3 is crucial.

I'm looking for a skilled developer or team to build a Minimum Viable Product (MVP) of a Unified Insights Platform. This platform should primarily focus on data integration using Fivetran and data transformation with DBT. Key Responsibilities: - Develop an intuitive platform aimed at business executives, allowing for easy access and understanding of integrated data. - Use Tableau for data reporting, Snowflake as our data warehouse, and D3JS for chart visualizations, Fivetran for data integration and DBT for Data Transformation. - Implement Auth0 by Okta authentication protocols to ensure data security and user accessibility and Datadog for monitoring. Ideal Skills: - Proficiency in Fivetran, DBT, Tableau, Snowflake, and D3JS. - Experience in developing data-focused platforms. - St...