Data Pipeline Optimization – Who Needs Engineers https://whoneedsengineers.com/wne_live Software Engineering Recruitment Thu, 03 Oct 2024 18:45:02 +0000 en-US hourly 1 https://wordpress.org/?v=6.6.2 https://whoneedsengineers.com/wne_live/wp-content/uploads/2023/06/cropped-wne_logo-3-32x32.png Data Pipeline Optimization – Who Needs Engineers https://whoneedsengineers.com/wne_live 32 32 Data Engineer – Remote https://whoneedsengineers.com/jobs/data-sciene-and-analytics/data-engineer-remote-2/ Thu, 03 Oct 2024 18:45:02 +0000 https://whoneedsengineers.com/wne_live/jobs/jobs-categories/data-engineer-remote-2/ Data Engineer – Remote

Job Description:

    We are seeking a talented Data Engineer to join our team for an exciting contract opportunity within the energy sector. This role involves designing and implementing modern business intelligence and machine learning solutions by identifying, creating, and preparing necessary data. The successful candidate will be responsible for building robust data architectures and pipelines that will effectively integrate various data sources. You will leverage Microsoft Azure services and other tools to develop solutions that meet both business and technical requirements. Your expertise will ensure that data is cleansed, mapped, transformed, and optimized for storage and usage. You will automate processes and deploy production-standard code, ensuring best practices in unit testing, continuous integration, and versioning. Furthermore, you will load transformed data into various storage and reporting structures, including data warehouses and analytics applications.

IT Languages:

  • SQL
  • Python
  • PySpark

The Data Engineer will be responsible for a variety of key tasks that contribute to the overall success of our data operations.:

    Identify and prepare data for business intelligence and machine learning solutions;; Build data architectures and pipelines to integrate various data sources;; Design and implement solutions using Microsoft Azure services;; Ensure data is cleansed, mapped, and optimized for storage and usage;; Automate tasks and implement production-standard code;; Load transformed data into data warehouses and analytics applications

Spoken Languages:

  • English;; French

Skillset:

  • Data Engineering
  • Cloud Data Processing
  • Data Warehousing
  • ETL Tools
  • Big Data Technologies
  • Azure Cloud Platform
  • Data Pipeline Optimization

Soft Skills:

  • Strong communication skills
  • Excellent collaboration skills
  • Effective presentation skills

Qualifications:

  • Bachelor’s Degree in Computer Science or related field
  • Azure Data Engineer certification (preferred)

Years of Experience:

    5

Location:

    Ireland

Job Benefits:

  • Competitive hourly pay rate
  • Opportunity for contract extension
  • Work from home flexibility

Working Conditions:

    Remote

Employment Type:

    Temporary Contract

Company Culture:

  • We foster an inclusive and dynamic work environment that encourages innovation, collaboration, and continuous learning. Our teams are dedicated to leveraging technology to drive efficiency and effectiveness in the energy sector.

Opportunities For Advancement:

  • Potential for long-term contract opportunities, Professional development and training, Career progression within the organization

Visa Sponsorship:

    Not Available
]]>