Data pipeline orchestration – Who Needs Engineers
/wne_live
Software Engineering RecruitmentThu, 24 Oct 2024 16:30:03 +0000en-US
hourly
1 https://wordpress.org/?v=6.6.2/wne_live/wp-content/uploads/2023/06/cropped-wne_logo-3-32x32.pngData pipeline orchestration – Who Needs Engineers
/wne_live
3232Data Engineer
/jobs/data-sciene-and-analytics/data-engineer-33/
Thu, 24 Oct 2024 16:30:03 +0000/wne_live/jobs/jobs-categories/data-engineer-33/Data Engineer
Job Description:
We are seeking a skilled Data Engineer who possesses a strong technical background and is passionate about working with data. This position is perfect for individuals who excel in various aspects of data management, including designing, implementing, and optimizing data storage solutions. In this role, you will collaborate closely with various stakeholders, including business customers, product owners, and IT teams, to transform business objectives into effective data storage architectures. Your work will involve participating in agile and lean methodologies, ensuring software quality through automated testing, and contributing to continuous integration and deployment practices. You will be responsible for identifying and documenting requirements, working alongside Data Product Owners to create data storage designs, and implementing solutions using Google Cloud Platform technologies. Additionally, you will take part in performance tuning and provide second-level support to address customer inquiries and incidents.
IT Languages:
SQL
Python
DBT
GCP
Terraform
Airflow
As a Data Engineer, your primary responsibilities will include designing and implementing data storage solutions while ensuring their performance and reliability. You will work alongside cross-functional teams to ensure that the data infrastructure meets the evolving needs of the business.:
Identify, document, and communicate requirements for data solutions;; Design data storage architectures in collaboration with Data Product Owners;; Implement data storage solutions on Google Cloud Platform using DBT for transformations and BigQuery for data storage;; Participate in testing processes and adopt test-driven development methodologies;; Tune data storage systems for improved performance, including SQL query optimization and index management;; Provide Level 2 support for customer inquiries and technical issues;; Collaborate effectively with team members across various departments
Spoken Languages:
English
Skillset:
Big data technologies
Cloud computing
Data architecture
Performance tuning
Data manipulation
Data pipeline orchestration
Soft Skills:
Critical thinking
Strong communication skills
Team collaboration
Problem-solving
Qualifications:
Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field
At least two years of experience in big data technologies
Minimum one year of experience with cloud computing platforms such as AWS, Azure, or Google Cloud
Years of Experience:
3
Location:
United States
Job Benefits:
Medical, dental, and prescription drug coverage
Flexible family care and parental leave
Vehicle discount program for employees and family members
Tuition assistance
Paid time off for community service
Generous holiday schedule
Option to purchase additional vacation time
Working Conditions:
Full Time
Employment Type:
Permanent Contract
Company Culture:
A diverse and inclusive workplace that values collaboration and innovation. Employees are encouraged to pursue their interests and develop their careers in a supportive environment.
Opportunities For Advancement:
Leadership roles, Technical expert positions, Cross-functional team opportunities