https://whoneedsengineers.com/wne_live Software Engineering Recruitment Thu, 24 Oct 2024 16:30:03 +0000 en-US hourly 1 https://wordpress.org/?v=6.6.2 https://whoneedsengineers.com/wne_live/wp-content/uploads/2023/06/cropped-wne_logo-3-32x32.png https://whoneedsengineers.com/wne_live 32 32 https://whoneedsengineers.com/jobs/data-sciene-and-analytics/data-engineer-33/ Thu, 24 Oct 2024 16:30:03 +0000 https://whoneedsengineers.com/wne_live/jobs/jobs-categories/data-engineer-33/ Data Engineer

Job Description:

We are seeking a skilled Data Engineer who possesses a strong technical background and is passionate about working with data. This position is perfect for individuals who excel in various aspects of data management, including designing, implementing, and optimizing data storage solutions. In this role, you will collaborate closely with various stakeholders, including business customers, product owners, and IT teams, to transform business objectives into effective data storage architectures. Your work will involve participating in agile and lean methodologies, ensuring software quality through automated testing, and contributing to continuous integration and deployment practices. You will be responsible for identifying and documenting requirements, working alongside Data Product Owners to create data storage designs, and implementing solutions using Google Cloud Platform technologies. Additionally, you will take part in performance tuning and provide second-level support to address customer inquiries and incidents.

IT Languages:

• SQL
• Python
• DBT
• GCP
• Terraform
• Airflow

As a Data Engineer, your primary responsibilities will include designing and implementing data storage solutions while ensuring their performance and reliability. You will work alongside cross-functional teams to ensure that the data infrastructure meets the evolving needs of the business.:

Identify, document, and communicate requirements for data solutions;; Design data storage architectures in collaboration with Data Product Owners;; Implement data storage solutions on Google Cloud Platform using DBT for transformations and BigQuery for data storage;; Participate in testing processes and adopt test-driven development methodologies;; Tune data storage systems for improved performance, including SQL query optimization and index management;; Provide Level 2 support for customer inquiries and technical issues;; Collaborate effectively with team members across various departments

Spoken Languages:

• English

Skillset:

• Big data technologies
• Cloud computing
• Data architecture
• Performance tuning
• Data manipulation
• Data pipeline orchestration

Soft Skills:

• Critical thinking
• Strong communication skills
• Team collaboration
• Problem-solving

Qualifications:

• Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field
• At least two years of experience in big data technologies
• Minimum one year of experience with cloud computing platforms such as AWS, Azure, or Google Cloud

Years of Experience:

3

Location:

United States

Job Benefits:

• Medical, dental, and prescription drug coverage
• Flexible family care and parental leave
• Vehicle discount program for employees and family members
• Tuition assistance
• Paid time off for community service
• Generous holiday schedule
• Option to purchase additional vacation time

Working Conditions:

Full Time

Employment Type:

Permanent Contract

Company Culture:

• A diverse and inclusive workplace that values collaboration and innovation. Employees are encouraged to pursue their interests and develop their careers in a supportive environment.

Opportunities For Advancement:

• Leadership roles, Technical expert positions, Cross-functional team opportunities

Visa Sponsorship:

Not Available

]]> https://whoneedsengineers.com/jobs/software-development-and-engineering/software-engineer-new-grad-distributed-data-systems-2025-start-2/ Sun, 20 Oct 2024 12:45:02 +0000 https://whoneedsengineers.com/wne_live/jobs/jobs-categories/software-engineer-new-grad-distributed-data-systems-2025-start-2/ Software Engineer – New Grad, Distributed Data Systems (2025 Start)

Job Description:

At our organization, we are driven by a commitment to empower data teams in tackling some of the most challenging issues facing the world today, from enhancing security measures to advancing medical breakthroughs. We are focused on creating and maintaining a premier data and AI infrastructure platform, allowing our clients to concentrate on the critical, high-value challenges that are integral to their missions. Our objective is to fundamentally simplify the entire data lifecycle, which encompasses everything from data ingestion to ETL, business intelligence, and extending all the way to machine learning and artificial intelligence through a cohesive platform. We envision a transformative shift in data architecture, moving away from traditional data warehouse structures towards a novel architectural model known as Lakehouse, which integrates data warehousing with advanced analytics. This innovative approach is designed to tackle substantial issues such as data freshness, reliability, overall cost-effectiveness, data accessibility, and accommodating a broader range of use cases. As a member of our team, you will have the opportunity to engage in a variety of specialized areas including but not limited to query compilation and optimization, distributed query execution and scheduling, and enhancing data security. You will also delve into aspects of resource management, transaction coordination, and the development of efficient storage structures. Our goal is to cultivate an environment where creativity and technical expertise converge to drive meaningful advancements in data systems.

IT Languages:

• Java
• C++

As a Software Engineer in the Distributed Data Systems team, you will engage in various key responsibilities aimed at enhancing our data infrastructure.:

Develop and implement query compilation and optimization techniques.;; Contribute to distributed query execution and scheduling processes.;; Design and build components for a vectorized execution engine.;; Enhance data security measures across our platforms.;; Manage resources efficiently to optimize system performance.;; Coordinate transactions to ensure data integrity.;; Create efficient storage structures, including encodings and indexes.;; Implement automatic physical data optimization strategies.;; Oversee the management of our data storage systems.

Spoken Languages:

• English

Skillset:

• Query optimization
• Distributed systems
• Database management
• Performance tuning
• Resource management

Soft Skills:

• Analytical thinking
• Problem-solving
• Team collaboration
• Adaptability
• Attention to detail

Qualifications:

• Bachelor’s degree in Computer Science, Engineering, or a related field, with graduation anticipated in Fall 2024 or Spring 2025.
• Proficiency in a general-purpose programming language such as Java or C++.
• Solid understanding of algorithms, data structures, and principles of object-oriented programming.
• Demonstrated passion for database and storage systems, distributed systems, language design, or performance optimization.
• Experience in managing projects from inception to completion.

Years of Experience:

0

Location:

United States

Job Benefits:

• Comprehensive health insurance
• Retirement savings plan
• Annual performance bonuses
• Equity options
• Flexible working hours
• Professional development opportunities

Working Conditions:

Full Time

Employment Type:

Permanent Contract

Company Culture:

• We foster a culture that values innovation, collaboration, and inclusivity. Our environment is designed to support diverse perspectives and encourage personal and professional growth. We believe in empowering our employees to excel and contribute meaningfully to our mission.

Opportunities For Advancement:

• Career progression into senior technical roles, Leadership development programs, Opportunities to work on cutting-edge projects

Visa Sponsorship:

Available

]]> https://whoneedsengineers.com/jobs/software-development-and-engineering/software-engineer-new-grad-distributed-data-systems-2025-start/ Sun, 13 Oct 2024 13:00:02 +0000 https://whoneedsengineers.com/wne_live/jobs/jobs-categories/software-engineer-new-grad-distributed-data-systems-2025-start/ Software Engineer – New Grad, Distributed Data Systems (2025 Start)

Job Description:

At our organization, we are driven by a commitment to empower data teams in tackling some of the most challenging issues facing the world today, from enhancing security measures to advancing medical breakthroughs. We are focused on creating and maintaining a premier data and AI infrastructure platform, allowing our clients to concentrate on the critical, high-value challenges that are integral to their missions. Our objective is to fundamentally simplify the entire data lifecycle, which encompasses everything from data ingestion to ETL, business intelligence, and extending all the way to machine learning and artificial intelligence through a cohesive platform. We envision a transformative shift in data architecture, moving away from traditional data warehouse structures towards a novel architectural model known as Lakehouse, which integrates data warehousing with advanced analytics. This innovative approach is designed to tackle substantial issues such as data freshness, reliability, overall cost-effectiveness, data accessibility, and accommodating a broader range of use cases. As a member of our team, you will have the opportunity to engage in a variety of specialized areas including but not limited to query compilation and optimization, distributed query execution and scheduling, and enhancing data security. You will also delve into aspects of resource management, transaction coordination, and the development of efficient storage structures. Our goal is to cultivate an environment where creativity and technical expertise converge to drive meaningful advancements in data systems.

IT Languages:

• Java
• C++

As a Software Engineer in the Distributed Data Systems team, you will engage in various key responsibilities aimed at enhancing our data infrastructure.:

Develop and implement query compilation and optimization techniques.;; Contribute to distributed query execution and scheduling processes.;; Design and build components for a vectorized execution engine.;; Enhance data security measures across our platforms.;; Manage resources efficiently to optimize system performance.;; Coordinate transactions to ensure data integrity.;; Create efficient storage structures, including encodings and indexes.;; Implement automatic physical data optimization strategies.;; Oversee the management of our data storage systems.

Spoken Languages:

• English

Skillset:

• Query optimization
• Distributed systems
• Database management
• Performance tuning
• Resource management

Soft Skills:

• Analytical thinking
• Problem-solving
• Team collaboration
• Adaptability
• Attention to detail

Qualifications:

• Bachelor’s degree in Computer Science, Engineering, or a related field, with graduation anticipated in Fall 2024 or Spring 2025.
• Proficiency in a general-purpose programming language such as Java or C++.
• Solid understanding of algorithms, data structures, and principles of object-oriented programming.
• Demonstrated passion for database and storage systems, distributed systems, language design, or performance optimization.
• Experience in managing projects from inception to completion.

Years of Experience:

0

Location:

United States

Job Benefits:

• Comprehensive health insurance
• Retirement savings plan
• Annual performance bonuses
• Equity options
• Flexible working hours
• Professional development opportunities

Working Conditions:

Full Time

Employment Type:

Permanent Contract

Company Culture:

• We foster a culture that values innovation, collaboration, and inclusivity. Our environment is designed to support diverse perspectives and encourage personal and professional growth. We believe in empowering our employees to excel and contribute meaningfully to our mission.

Opportunities For Advancement:

• Career progression into senior technical roles, Leadership development programs, Opportunities to work on cutting-edge projects

Visa Sponsorship:

Available

]]>