Data pipeline orchestration – Who Needs Engineers https://whoneedsengineers.com/wne_live Software Engineering Recruitment Thu, 24 Oct 2024 16:30:03 +0000 en-US hourly 1 https://wordpress.org/?v=6.6.2 https://whoneedsengineers.com/wne_live/wp-content/uploads/2023/06/cropped-wne_logo-3-32x32.png Data pipeline orchestration – Who Needs Engineers https://whoneedsengineers.com/wne_live 32 32 Data Engineer https://whoneedsengineers.com/jobs/data-sciene-and-analytics/data-engineer-33/ Thu, 24 Oct 2024 16:30:03 +0000 https://whoneedsengineers.com/wne_live/jobs/jobs-categories/data-engineer-33/ Data Engineer

Job Description:

    We are seeking a skilled Data Engineer who possesses a strong technical background and is passionate about working with data. This position is perfect for individuals who excel in various aspects of data management, including designing, implementing, and optimizing data storage solutions. In this role, you will collaborate closely with various stakeholders, including business customers, product owners, and IT teams, to transform business objectives into effective data storage architectures. Your work will involve participating in agile and lean methodologies, ensuring software quality through automated testing, and contributing to continuous integration and deployment practices. You will be responsible for identifying and documenting requirements, working alongside Data Product Owners to create data storage designs, and implementing solutions using Google Cloud Platform technologies. Additionally, you will take part in performance tuning and provide second-level support to address customer inquiries and incidents.

IT Languages:

  • SQL
  • Python
  • DBT
  • GCP
  • Terraform
  • Airflow

As a Data Engineer, your primary responsibilities will include designing and implementing data storage solutions while ensuring their performance and reliability. You will work alongside cross-functional teams to ensure that the data infrastructure meets the evolving needs of the business.:

    Identify, document, and communicate requirements for data solutions;; Design data storage architectures in collaboration with Data Product Owners;; Implement data storage solutions on Google Cloud Platform using DBT for transformations and BigQuery for data storage;; Participate in testing processes and adopt test-driven development methodologies;; Tune data storage systems for improved performance, including SQL query optimization and index management;; Provide Level 2 support for customer inquiries and technical issues;; Collaborate effectively with team members across various departments

Spoken Languages:

  • English

Skillset:

  • Big data technologies
  • Cloud computing
  • Data architecture
  • Performance tuning
  • Data manipulation
  • Data pipeline orchestration

Soft Skills:

  • Critical thinking
  • Strong communication skills
  • Team collaboration
  • Problem-solving

Qualifications:

  • Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field
  • At least two years of experience in big data technologies
  • Minimum one year of experience with cloud computing platforms such as AWS, Azure, or Google Cloud

Years of Experience:

    3

Location:

    United States

Job Benefits:

  • Medical, dental, and prescription drug coverage
  • Flexible family care and parental leave
  • Vehicle discount program for employees and family members
  • Tuition assistance
  • Paid time off for community service
  • Generous holiday schedule
  • Option to purchase additional vacation time

Working Conditions:

    Full Time

Employment Type:

    Permanent Contract

Company Culture:

  • A diverse and inclusive workplace that values collaboration and innovation. Employees are encouraged to pursue their interests and develop their careers in a supportive environment.

Opportunities For Advancement:

  • Leadership roles, Technical expert positions, Cross-functional team opportunities

Visa Sponsorship:

    Not Available
]]>