Metrofpcom etl jobs

Job Title: Power BI Freelancer Needed for Data Visualization and Reporting J...measures and columns. Ensure data accuracy and troubleshoot issues within the data model. Optimize dashboards for performance and user experience. Collaborate with stakeholders to gather requirements and deliver solutions. Required Skills: Proficiency in Power BI and its components (Power Query, DAX, etc.). Strong knowledge of data visualization best practices. Experience with data modeling and ETL processes. Familiarity with integrating multiple data sources. Good communication skills for understanding requirements and presenting insights. Preferred Qualifications: Experience in [specific industry, if relevant]. Knowledge of SQL, Python, or other relevant tools. Previous experience in creating similar d...

...Engineer/Full Stack Developer with extensive knowledge and experience in database structuring and implementation on AWS. The project revolves around a financial platform, necessitating the design and implementation of a robust ETL (Extract, Transform, Load) pipeline for our data warehouse. Key Responsibilities: - Creating the ETL pipeline - Data extraction primarily from vendor APIs with occasional web scraping - Data loading to various databases Ideal Skills: - Strong expertise in AWS and cloud-based database implementation - Proficiency in designing and optimizing ETL pipelines - Experience in integrating vendor APIs - Knowledge in database structuring and optimization Good to Have: - Proficiency in AI and prompt engineering Please note that while the specific...

...business needs. - Allow for dynamic filtering and drill-down capabilities. 5. **Documentation and Training:** - Provide documentation on the report structure and data sources. - Offer training sessions to our team on how to use and interpret the reports. **Skills Required:** - Proficiency in Power BI - Strong analytical and problem-solving skills - Experience with data integration and ETL processes - Excellent communication skills **Deliverables:** - Fully functional Power BI report with interactive dashboards - Documentation and training materials **Timeline:** - Project completion within 7 days **Budget:** - 5K **How to Apply:** - Please provide examples of previous Power BI projects. - Include a brief description of your approach to this project. - Mention your ...

...business needs. - Allow for dynamic filtering and drill-down capabilities. 5. **Documentation and Training:** - Provide documentation on the report structure and data sources. - Offer training sessions to our team on how to use and interpret the reports. **Skills Required:** - Proficiency in Power BI - Strong analytical and problem-solving skills - Experience with data integration and ETL processes - Excellent communication skills **Deliverables:** - Fully functional Power BI report with interactive dashboards - Documentation and training materials **Timeline:** - Project completion within 7 days **Budget:** - 5K **How to Apply:** - Please provide examples of previous Power BI projects. - Include a brief description of your approach to this project. - Mention your ...

...business needs. - Allow for dynamic filtering and drill-down capabilities. 5. **Documentation and Training:** - Provide documentation on the report structure and data sources. - Offer training sessions to our team on how to use and interpret the reports. **Skills Required:** - Proficiency in Power BI - Strong analytical and problem-solving skills - Experience with data integration and ETL processes - Excellent communication skills **Deliverables:** - Fully functional Power BI report with interactive dashboards - Documentation and training materials **Timeline:** - Project completion within 7 days **Budget:** - 5K **How to Apply:** - Please provide examples of previous Power BI projects. - Include a brief description of your approach to this project. - Mention your ...

...Create user guides for data pipelines, model training, and backtest system. Provide final code base with version control (Git). Present final results, discuss next steps or potential live trading integration. Officially close the project; gather feedback and conduct final sign-offs. 4. Required Skill Sets for the Freelancer Data Engineering & Management Experience with time-series data ingestion, ETL pipelines, and handling large data sets. Familiarity with Parquet or similar columnar data formats, plus database technologies. Quantitative & Financial Knowledge Strong understanding of options pricing and Greeks (Black–Scholes). Experience with Level 2 order book data and market microstructure is a plus. Programming & Libraries Python (NumPy, Pandas, Scikit-le...

We have 2 SQL databases. A source database and a target database that have completely different structures (tables, field names/types and relations). We're doing some migration planning from source to target and need some consulting advice on how to best map tables and fields for ETL migration. We are looking for a solution that uses AI and/or ML to avoid doing this all manually the schema mapping. Please put "SCHEMA123" at the start of your proposal so we can filter out automated responses. Please list any details of your experience in doing a project like this. Thanks!

We are migrating data from our current ERP system (that is stored in an SQL database) to Microsoft Dynamics Business Central Cloud. The source database structures is different than Business Central. We have been a...been able to reverse engineer both the databases and create ERD models and DDL scripts. Also we know how to create Dynamics APIs and use AL to interact with Dynamics. We are looking some consulting advice on how best migrate the data into dynamics. For example looking for ideas how to best table and field match, what software tools to use, best proccess etc for this ETL project. Please describe any experience you have with ETL/migrating data between different systems. Please add the word DYMANICS123 to the start of your proposal so we can weed out automated re...

...Experience Required Profile 7+ years of experience on Database warehouse / lake house programming Experience in implementing at least 2 end-to-end data warehouse / data lake projects Experience in implementing at least 1 Azure Data warehouse / lake house project end-to-end Converted business requirements to concept / technical specification Worked along with source system experts in finalizing ETL and analytics design Support data modeler developer in design and development of ETLs Creation of activity plan as per the agreed concept with timelines Technical Expertise: Strong experience with Microsoft Azure components, including Azure Data Factory, Azure Synapse, Azure SQL Database, Azure Key Vault, MS Fabric, Azure DevOps (ADO), and Virtual Networks (VNets). Expertise in Medalli...

... o Data wrangling using SAC Modeler (acquired and live connections). o SAC Planning: Complex data actions, aggregations, and input schedules. o Finance Planning: Supporting budgeting, forecasting, and financial reporting processes. • Design and optimize SAP BW/4HANA models, including: o DSOs, ADSOs, Composite Providers, and InfoObjects. o Develop BW queries using BEx Query Designer. o Implement ETL pipelines for structured data loading and transformation. • Support integration between SAC and SAP BW using live and acquired connections. • Assist in system testing, debugging, and troubleshooting. • Prepare and maintain technical documentation for analytics solutions. Specific Skills Required: • Proficiency in SAC Story Design, data blending, and linked ana...

...Utilize relational databases and ORMs (e.g., SQLAlchemy) effectively for data management. Technical Skills Must-Have Skills ● Python Programming (Advanced): ○ Comprehensive knowledge of syntax, semantics, multi-threading, multi-processing, regular expressions, and exception handling. ○ Expertise in libraries such as Pandas and NumPy. ● ETLPipelines: ○ Proficiency in designing and implementing ETL pipelines for large-scale data projects. ● Object-Oriented Programming (OOP) (Intermediate): ○ Understanding of classes, objects, inheritance, polymorphism, and encapsulation. ● Relational Databases (Advanced): ○ Experience in query optimization, query building, and managing databases such as PostgreSQL, MSSQL, and Oracle. Expected Proficiency ● AWSCloudServices: ○ Fami...

...as a technical resource. We will be focusing on Relevance AI and platforms, largely repurposing existing code. We realize that most AI developers don't have experience with Relevance yet. That's fine. We are looking for someone with significant experience with AI, vector embeddings, sentiment analysis, , RESTful APIs, OAuth2, Pinecone, PostgreSQL, MongoDB, Scraping tools, ETL pipelines, and multi-agent systems. Looking for someone passionate about AI that can work thoughtfully and independently. The first project we are working on is an automation Workflow process, based on the Dream 100 concept to identify, track, and built relationships with influential content creators. Here is an outline of the project:

Job Title: Freelance Data Engineer/Programmer for ETL Development Job Description: We are seeking an experienced Data Engineer/Programmer to develop robust ETL (Extract, Transform, Load) processes to seamlessly integrate our Warehouse Management System (WMS) with our Enterprise Resource Planning (ERP) system. This role is critical in ensuring smooth and reliable data flow between these systems to enhance operational efficiency and decision-making. Key Responsibilities: - Design, develop, and maintain ETL pipelines to connect WMS and ERP systems. - Extract data from various sources, transform it to meet business requirements, and load it into the target system or data warehouse. - Work with Python and Pandas for data manipulation and automation of workflows. - Levera...

...Live Tables (DLT) on Databricks. The pipeline ensures high data quality through defined expectations within DLT or an equivalent framework. Once the pipeline is developed and validated, it will be deployed using Databricks Asset Bundles, enabling seamless and scalable management of data workflows. The project will cover the following steps: Pipeline Development with Delta Live Tables: Creating ETL pipelines to process and transform data incrementally. Data Quality Assurance: Implementing expectations to validate and monitor data at every stage of the pipeline. Deployment with Databricks Asset Bundles: Packaging and deploying the pipeline for operational use in production environments. This project demonstrates end-to-end pipeline lifecycle management on Databricks, emphasizing ...

I'm looking for a seasoned Python Engineer with extensive Flask experience to build a robust API service. Key responsibilities will include: - Web development with Flask: Your primary focus will be creating a scalable and efficient API service that meets our project's requirements. - Data Handling and ETL: While the bulk of the work will be web development, a strong capability in data handling, extraction, transformation, and loading is essential. Experience with Panda is a must. - Integration of Data Analytics: The API will need to have data analytics capabilities. Prior experience in this area will be beneficial. - Implementing Real-time Updates: The API service should be able to support real-time updates. Experience with similar features in previous projects is a plus....

I am in need of a highly skilled Senior Python Engineer to assist with the backend of a web...architecture. Key Responsibilities: - Designing and implementing backend components. - Handling data processing and storage. - Developing robust APIs. Critical Skills: - Proficiency in Python and Flask. - Extensive knowledge of MongoDB and PostgreSQL. - Experience with object-oriented programming. - Understanding of scalable architecture. - Proficient in data extraction, transformation, and loading (ETL) using Pandas. This role will focus heavily on data processing and storage, as well as API development, so experience and skills in these areas are vital. The project requires a full backend development, so a full-stack developer would also be considered, but the primary focus is on bac...

3. Data Engineer Responsibilities: Collect, process, and organize audio data. Set up data pipelines, create preprocessing workflows, and ensure data quality to feed the model. Skills: Python, SQL, big data tools (Hadoop, Spark), ETL (Extraction, Transformation, and Loading), and handling large volumes of data. Ideal Profile: Someone with experience handling large volumes of audio data (multi-track) who can build scalable and efficient data pipelines. 4. Software Developer / Backend Engineer Responsibilities: Integrate the model into a functional application, build APIs for the model, or even develop an interface if the project requires a standalone application. Skills: Backend development (Node.js, Python, Django), API creation and implementation, microservices, cloud experience (AW...

I'm looking for a freelance resume write...tech resumes, particularly for data engineering positions in the UK. My goal is to create a compelling resume that highlights my skills and experiences effectively for mid-level roles. Key Skills to Highlight: - Proficiency in Python and SQL - Experience with Cloud platforms like Azure - Familiarity with Databricks, PySpark, PowerBI, Snowflake, DBT cloud, Azure Data Factory, Synapse Analytics, ETL, CI/CD, Azure DevOPs, C# .Net Most Recent Job Experience: - Data Engineering The ideal candidate for this project should have: - Proven experience in writing tech resumes, particularly for data engineering roles - In-depth understanding of the data engineering field - Ability to articulate and present technical skills and experiences in a ...

I am looking for someone to mentor, train and provide project support on Talend and complex sql tasks. This is at least a 3-6 months arrangement. I would require a right person to give me a demo before we can start the project together. Confidently is an important part of the process.

Develop a comprehensive dashboard in Tableau to track and analyze sales performance across multiple regions and stores, enabling stakeholders to make data-driven decisions. Key Responsibilities: Data Integration: Gathered data from multiple sources, including SQL Server, SAP, and Excel files. Designed and optimized ETL pipelines using Alteryx to clean, transform, and load data into a centralized data warehouse. Dashboard Development: Built interactive Tableau dashboards showcasing KPIs such as total sales, profit margin, sales trends, and regional performance. Incorporated advanced features like drill-downs, filters, and trend analysis to provide actionable insights. Created custom visualizations to highlight underperforming regions and top-selling products. Data Modeling: Desi...

I am looking for an experienced ETL tester with strong skills in various ETL testing tools and methodologies. Your expertise in data warehousing and cloud platforms will be highly beneficial for this project. SHARE RESUME Key Requirements: - Proficient in ETL Testing tools like Informatica Power Center, IICS, and Informatica DVO - Familiar with Agile Scrum, Waterfall, and STLC methodologies - Experienced with cloud platforms, particularly GCP (Google Cloud Platform), AWS Cloud, and Azure Cloud - Proficient in databases such as MySQL, Oracle, SQL Server, and PostgreSQL - Comfortable working with various operating systems, including Windows XP/7/10, UNIX, and MAC OS - Skilled in SQL, PL/SQL, and Python - Experienced with test management tools like HP ALM / Quality Cente...

...simplifying complex concepts. The Trainee should explain all the topic that are required but not subject to the one mentioned below. The Trainer should also execute end to end hands on project with the trainee. Please refer to the attached Training topic requirement. The training should cover: - Python and R - SQL and Excel - Tableau and Power BI - Data Extracting, Transforming, and Loading (ETL) processes - Large data platforms Ideal candidates are those with extensive experience dealing with corporate clients and delivering projects. A proven track record of training success is a plus. Your ability to engage with beginners and make learning enjoyable and effective will be key. The training program is expected to last 8-10 weeks. The training sessions should be co...

I'm looking for a Senior Java Backend Application Developer, primarily focused on integration and development with Kafka. Key Responsibilities: - Spearhead integration development tasks - Potential for application development tasks Essential Skills: - Over 5...Experience with cloud platforms such as AWS, Azure, or Google Cloud. - Proficiency with container orchestration tools like Kubernetes or Docker Swarm. - Proficiency in scripting languages such as Python, Bash, or PowerShell. - Knowledge of API management tools and practices. - Understanding of security protocols and best practices in application integration. - Experience with data transformation and ETL tools. If you have a strong background in integration development and are eager to work with Kafka, I would like to...

I am in need of an ETL engineer who can assist with transferring data from our Oracle database to a MySQL server. The project involves: - **Data Transfer**: The volume of data to be transferred is less than 10 GB. - **Frequency**: The data will be transferred on a weekly basis for one case and as and when available for other case. Your script should fire automatically to perform the transfer. - **Data Transformation**: Some level of data transformation is required during the transfer process. - Incorporate data validation checks to ensure the accuracy and integrity of the transferred data. - Implement robust error handling and logging mechanisms to capture any issues during the ETL process. - Set up and configure a scheduling mechanism to automate the weekly and ad-h...

I am in need of an ETL engineer who can assist with transferring data from our Oracle database to a MySQL server. The project involves: - **Data Transfer**: The volume of data to be transferred is less than 10 GB. - **Frequency**: The data will be transferred on a weekly basis for one case and as and when available for other case. Your script should fire automatically to perform the transfer. - **Data Transformation**: Some level of data transformation is required during the transfer process. - Incorporate data validation checks to ensure the accuracy and integrity of the transferred data. - Implement robust error handling and logging mechanisms to capture any issues during the ETL process. - Set up and configure a scheduling mechanism to automate the weekly and ad-h...

I'm seeking an expert in data engineering to construct a comprehensive, end-to-end pipeline for a project I'm currently working on. Key Project Details: - Data Type: The proje...end-to-end data pipelines - Proficient in SQL and managing SQL databases - Experienced in processing structured data - Skilled in working with APIs - Knowledge of data warehousing concepts would be a plus - Experience with ETL tools like Apache NiFi, Talend, or Informatica. - Practiced in implementing data quality checks and validation techniques. - Familiarity with major cloud services such as AWS, Azure, or Google Cloud for data storage and processing. Please provide examples of similar projects you've worked on in your proposal. Preference for using AWS Glue for the ETL processes...

...workflow, focused on integrating data from various spreadsheets into a cohesive dataset. The primary type of data is tabular, and the main goal of this project revolves around efficient data integration. Ideal Skills: - Proficiency in FME (Feature Manipulation Engine) - Extensive experience with tabular data - Competence in data integration - Familiarity with working with spreadsheets - Knowledge of ETL (Extract, Transform, Load) processes - Proficiency in scripting languages such as Python or R Experience: - Prior work with FME workflow automation - Proven track record of successful data integration projects - Experience in handling large sets of tabular data from spreadsheets. The final integrated dataset should be provided in CSV format. The workflow should include **using ...

...configuration of Apache NiFi. Designing and managing data flow pipelines. Proficiency in NiFi Processors, such as: Data ingestion: GetFile, GetHTTP, GetKafka, etc. Data transformation: ConvertRecord, ReplaceText, etc. Data distribution: PutFile, PutKafka, PostHTTP, etc. Knowledge of NiFi Registry for version control and deployment of flow definitions. 2. Data Integration and Management: Experience with ETL (Extract, Transform, Load) processes. Understanding of data streaming and batch processing. Ability to connect to various data sources (APIs, databases, file systems, cloud storage). 3. System Administration: Proficiency in server setup and management on Linux/Windows. Knowledge of networking and firewalls for secure NiFi access. Experience with SSL/TLS for secure data transmis...

I'm in need of a seasoned data engineer who has extensive experience with Azure, AWS, and Databricks. The primary focus of this project is data pipeline development. Key Requirements: - Proficiency in Python, Spark, and SQL - In-depth knowledge of data engineering tools and platforms such as Databricks, Azure, and AWS - Experience in developing robust data pipelines - Experience with ETL processes for data extraction, transformation, and loading - Experience in data migration between databases and data warehouses - Expertise in SQL query optimization for performance improvements Ideal Skills: - Data analysis - Familiarity with Hadoop - Data cleaning and preprocessing expertise Please provide your credentials and examples of similar projects you've completed in the past.

I am looking for a skilled database analyst experienced with Excel ,Access databases to help manage my customer data. A...with Excel ,Access databases to help manage my customer data. As my database analyst, you will: - Assess the current structure of my SQL database - Identify areas for improvement or optimization - Provide recommendations for future database design Ideal Skills: - Proficiency in Spread sheets - Experience with customer data management - Strong analytical and problem-solving skills - Knowledge of ETL (Extract, Transform, Load) processes. - Expertise in database performance tuning and optimization. - Experience in data modeling and schema design. - Competency with database reporting tools like Tableau or Crystal Reports. The project needs to be completed within ...

I'm looking for a professional data analyst who can help me make sense of my sales data. The data is currently in Excel/CSV files. Ideal Skills: - Proficient in data analysis software (Excel, Python, R, etc...professional data analyst who can help me make sense of my sales data. The data is currently in Excel/CSV files. Ideal Skills: - Proficient in data analysis software (Excel, Python, R, etc.) - Experience with sales data analysis - Ability to identify trends and patterns - Strong statistical skills - Skills in managing and querying databases (SQL, NoSQL, etc.) - Experience with Extract, Transform, Load (ETL) processes Please note that specific insights I want from the data have not yet been defined, so I will appreciate your expertise in uncovering significant insights...

...deploying AI/ML models Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes) Strong problem-solving and analytical skills, with the ability to work on complex data-driven projects Excellent communication skills and the ability to work collaboratively in a multidisciplinary team Preferred Qualifications: Familiarity with data engineering concepts and tools, including ETL processes and data warehousing Knowledge of distributed computing and high-performance computing (HPC) for scaling machine learning models Familiarity with Agile methodologies and version control systems (e.g., Git) Compensation: The compensation for this position ranges from $100,000 - $120,000 depending on experience. Why Join Us? As part of our dynamic team, you will have th...

...deploying AI/ML models Familiarity with containerization and orchestration tools (e.g., Docker, Kubernetes) Strong problem-solving and analytical skills, with the ability to work on complex data-driven projects Excellent communication skills and the ability to work collaboratively in a multidisciplinary team Preferred Qualifications: Familiarity with data engineering concepts and tools, including ETL processes and data warehousing Knowledge of distributed computing and high-performance computing (HPC) for scaling machine learning models Familiarity with Agile methodologies and version control systems (e.g., Git) Compensation: The compensation for this position ranges from $100,000 - $120,000 depending on experience. Why Join Us? As part of our dynamic team, you will have th...

...coding • Integrate with Web services including SOAP, WSDL, REST, SSL standards, security models and typical API client architecture. Plus experience in working with Platform Events, Bulk API and the Metadata API • Implementation knowledge of Flow, App Builder, Process Builder, validation rule, approval process, reports and dashboards • Experience using Apex Data Loader (or other ETL tools like Informatica or Boomi or Cast Iron or Mulesoft) • Experience with database development, SQL or PL/SQL, database schemas, stored procedures is is a plus. • Follow unit testing and test class best practices, and be capable of coding for positive/negative scenarios • Must have experience with production deployment using CI/CD tools like GitHub, Gitlab, Bamboo, Co...

I'm in need of a Redshift SQL specialist who can assist me with writing intricate queries primarily focused on analytics and ETL processes. This will involve integrating my existing datasets. Ideal Skills: - Proficiency in Redshift SQL - Experience with writing complex queries using redshift Please note, the task will not involve database optimization or data migration.

Description: Collaborate with me on integrating SQL Server and Oracle APIs using SSIS. This project involves setting up a robust ETL pipeline for efficient data management, building a data model for HR and Procurement, and developing an interactive 8 dashboard in Power BI deployed on Power BI Report Server. Tasks: SSIS and SQL Server Integration: Configure SQL Server and SSIS, ensuring a seamless ETL pipeline. Design and execute workflows to extract, transform, and load (ETL) data between sources. Oracle API and Excel Integration: Set up secure Oracle API integration for real-time or scheduled data extraction. Integrate data from Excel files and APIs for HR and Procurement departments. Map and load data into SQL Server, ensuring schema compatibility. Power BI Model...

...me. The primary aim of this application is to extract text data from various e-commerce sites. Key Requirements: - Expertise in Python, particularly in libraries/APIs used for web scraping (e.g., BeautifulSoup, Scrapy, Selenium). - Previous experience in developing web scraping applications, preferably for e-commerce sites. - A strong understanding of data extraction, transformation and loading (ETL) processes. - Ability to write clean, efficient and well-documented code. - Good problem-solving skills and attention to detail. Your task will be to create an application that can navigate e-commerce sites, identify relevant text data, and extract it efficiently and accurately. The final deliverable should be an easy-to-use Python application, with comprehensive documentation and u...

I'm looking for an API and Data Analytics specialist to help automate our data extraction from Practice Hub. Currently, we are manually entering data into Google Sheets and using Looker Studio for report generation. Need...process by utilizing Practice Hub's API to pull: - Patient records - Appointment schedules - Billing information The extracted data will primarily be used for generating operational reports. Given our competitors are working on a similar product, I would like to start this project as soon as possible. Skills needed: - Experience with APIs - Data analytics expertise - Familiarity with ETL processes - Knowledge in generating operational reports. Please check the Practice Hub API info here for reference:

...reputable and experienced full-stack service agency with a strong presence on Freelancer to work on several enterprise clients projects: Requirements for Azure Data Engineer: Experience in designing, building, and maintaining large-scale data pipelines using Azure Data Services (Azure Synapse Analytics, Azure Databricks, Azure Data Factory, etc.) Strong knowledge of data modeling, data warehousing, and ETL/ELT processes Experience with Azure cloud services, including Azure Storage, Azure Databricks, and Azure Active Directory Strong programming skills in languages such as Python, Scala, or .NET Experience with Agile development methodologies and version control systems like Git Requirements for Full Stack Team/Agency: We are looking for a full-stack service agency that can prov...

Description: Perform data migration from a PostgreSQL database to MySQL using Docker Compose to configure containers. Develop ETL scripts in Python to manage the extraction, transformation, and loading (ETL) process, including data cleaning to treat missing, duplicate, and inconsistent values. Use a Kaggle database as a source, prioritizing large and complex datasets. Kaggle: Tasks: Configuring Databases in Containers: Configure PostgreSQL and MySQL in different containers using Docker Compose. Create databases and tables in two databases, ensuring compatibility for migration. ETL Development: Extraction: Import data from the selected database in Kaggle to PostgreSQL. Transformation: Perform cleansing and standardization, addressing:

I'm in need of a mid-level Azure ETL Developer to assist with my project. The ideal candidate should have hands-on experience with the following Azure ETL tools and services: - Azure Data Factory - Azure Synapse Analytics - Azure Databricks Additionally, the ETL process will need to handle a variety of data sources, including: - SQL Databases - NoSQL Databases - Cloud Storage Services The perfect freelancer for this job should have a solid understanding of these tools and services, as well as experience working with diverse data sources. I look forward to receiving your proposals.

...need to remember that our core clients are non-technical marketers with limited analytical capabilities. Key responsibilities: • Develop and maintain scalable web applications, ensuring seamless performance across front-end and back-end systems. • Design and implement a secure data ecosystem to support CSV ingestion, API integrations, and SFTP server configurations • Build and maintain a robust ETL pipeline to automate data cleaning, transformation and validation processes • Create an interactive, accessible, and responsive web application, ensuring compliance with WCAG accessibility standards • Develop and optimize front-end components that support exportable and shareable data visualisations to empower actionable insights • Enhance user experienc...

I'm looking for a professional with substantial experience in setting up Azure Databricks. The main goal of this project is to establish a simple, yet efficient Databricks setup on Azure. A single node is sufficient for this task. Once the setup is complete, I need you to run a sample program using PySpark. This will valid...yet efficient Databricks setup on Azure. A single node is sufficient for this task. Once the setup is complete, I need you to run a sample program using PySpark. This will validate the setup and ensure everything is functioning correctly. The primary purpose of this Databricks setup will be focused on data processing and ETL. Ideal skills for this job include: - Extensive knowledge in Azure and Databricks - Proficiency in PySpark - Experience in data pro...

I'm seeking a skilled AWS Data Engineer trainer for my intermediate-level team. The focus will be on hands-on workshops utilizing various AWS services, including AWS Glue, AWS Lambda, AWS Athena, Redshift, and Data Stream. Ideal Skills and ...intermediate-level team. The focus will be on hands-on workshops utilizing various AWS services, including AWS Glue, AWS Lambda, AWS Athena, Redshift, and Data Stream. Ideal Skills and Experience: - Profound knowledge of AWS services - Prior experience in training or teaching - Ability to design and deliver engaging, interactive workshops - Strong understanding of data engineering concepts and ETL processes - Familiarity with AWS Glue, AWS Lambda, AWS Athena, Redshift, Data Stream - Experience in using project-based learning to teach c...

...be provided for reference: - The source file with product data in our current format. - The required ONDC format for bulk uploads. fashion csv - - An example file showing how to create variants for products. Skills Required: Strong proficiency in Python (data manipulation using pandas, file I/O, etc.). Experience with data transformation and ETL processes. Familiarity with e-commerce platforms and bulk upload formats is a plus. Expected Workflow: Analyze the provided files and understand the required mappings. Develop the Python script to perform the transformations. Validate the output against the format. Submit the script, sample output file, and documentation. Deadline: 2 days from project award. How to Apply:

I'm looking for a skilled data engineer with experience in ETL development. The task involves creating ETL packages or scripts to load data from the National Plan and Provider Enumeration System (NPPES) into both MySQL and MSSQL databases on a weekly basis. Key Requirements: - Proficiency in both MySQL and MSSQL - Experience in designing and implementing ETL processes - Familiarity with NPPES data is a plus - Ability to ensure data is loaded accurately and efficiently on a weekly schedule Please note, while data transformations like cleaning, standardization, and enrichment may be beneficial, they are not strictly required at this stage. The primary focus is on the ETL process itself.

I'm currently engaged in a data engineering project and I need assistance with data transformation and ETL tasks. A significant portion of this project involves building and designing Directed Acyclic Graphs (DAGs) in Apache Airflow. Ideal Skills: - Proficiency in Python and Pyspark - Extensive experience with AWS services, particularly Glue, Athena, and S3 - Expertise in workflow automation using Airflow - Strong understanding of data transformation and ETL processes The selected freelancer will play a crucial role in ensuring the smooth operation of my project. Your expertise will help facilitate efficient data processing and workflow automation.

I'm looking to enhance my GitHub profile. The main tasks involve updating it with interesting Data integration projects and improving its visual appeal. Key Tasks: - Curate and incorporate engaging data integration projects into my GitHub profile. - Improve the visual design of my profile to make it more attractive. Ideal Skills: - Proficiency in Data Integration Projects like ETL , Snowflake , Cloud Data Integration , Data Analytics etc. - Strong understanding of visual design principles. - Experience with GitHub and its functionalities. Please note, this project will require you to strike a balance between project variety and visual design, ensuring the profile is not only appealing, but also showcases a range of my skills.

Hello, I'm Jorge Salazar and I'm seeking a provider for a practical course on TIBCO EBX MDM and Data Catalog. - Target Group: A team with technical knowledge including Data Architecture, Data Modeling, Object-Oriented Programming, and ETL development. - Language Requirement: The course must be conducted in Spanish. - Format: Live remote sessions, designed for 8 to 10 participants with practical case studies. The course will primarily focus on: - Mastering the TIBCO EBX tool through guided exercises. - Utilizing step-by-step guided exercises to tackle real-world scenarios. - Achieving advanced mastery in the use of TIBCO for data management and architecture. Freelancers with experience in TIBCO EBX training, Data Management, and conducting live remote sessions in Spanis...

...drafts reviewed. Quality Assurance: Establish checks to ensure consistency, accuracy, and adherence to the structured template across all reports. Requirements Proven Experience with AI and NLP Tools: Proficiency with GPT-4, OpenAI API, or similar models, and experience with NLP tasks such as sentiment analysis and summarization. Data Pipeline Expertise: Experience with tools like Apache Airflow, ETL processes, or other data pipeline automation frameworks. Document Generation Skills: Experience with PowerPoint or PDF generation libraries (e.g., Python-pptx, ReportLab) and handling placeholder-driven document assembly. Frontend Development (Preferred): Familiarity with building user interfaces in frameworks like Django or Flask for creating and managing reports. Experience with Sc...