Performance tuning – Who Needs Engineers
https://whoneedsengineers.com/wne_live
Software Engineering RecruitmentThu, 24 Oct 2024 16:30:03 +0000en-US
hourly
1 https://wordpress.org/?v=6.6.2https://whoneedsengineers.com/wne_live/wp-content/uploads/2023/06/cropped-wne_logo-3-32x32.pngPerformance tuning – Who Needs Engineers
https://whoneedsengineers.com/wne_live
3232Data Engineer
https://whoneedsengineers.com/jobs/data-sciene-and-analytics/data-engineer-33/
Thu, 24 Oct 2024 16:30:03 +0000https://whoneedsengineers.com/wne_live/jobs/jobs-categories/data-engineer-33/Data Engineer
Job Description:
We are seeking a skilled Data Engineer who possesses a strong technical background and is passionate about working with data. This position is perfect for individuals who excel in various aspects of data management, including designing, implementing, and optimizing data storage solutions. In this role, you will collaborate closely with various stakeholders, including business customers, product owners, and IT teams, to transform business objectives into effective data storage architectures. Your work will involve participating in agile and lean methodologies, ensuring software quality through automated testing, and contributing to continuous integration and deployment practices. You will be responsible for identifying and documenting requirements, working alongside Data Product Owners to create data storage designs, and implementing solutions using Google Cloud Platform technologies. Additionally, you will take part in performance tuning and provide second-level support to address customer inquiries and incidents.
IT Languages:
SQL
Python
DBT
GCP
Terraform
Airflow
As a Data Engineer, your primary responsibilities will include designing and implementing data storage solutions while ensuring their performance and reliability. You will work alongside cross-functional teams to ensure that the data infrastructure meets the evolving needs of the business.:
Identify, document, and communicate requirements for data solutions;; Design data storage architectures in collaboration with Data Product Owners;; Implement data storage solutions on Google Cloud Platform using DBT for transformations and BigQuery for data storage;; Participate in testing processes and adopt test-driven development methodologies;; Tune data storage systems for improved performance, including SQL query optimization and index management;; Provide Level 2 support for customer inquiries and technical issues;; Collaborate effectively with team members across various departments
Spoken Languages:
English
Skillset:
Big data technologies
Cloud computing
Data architecture
Performance tuning
Data manipulation
Data pipeline orchestration
Soft Skills:
Critical thinking
Strong communication skills
Team collaboration
Problem-solving
Qualifications:
Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field
At least two years of experience in big data technologies
Minimum one year of experience with cloud computing platforms such as AWS, Azure, or Google Cloud
Years of Experience:
3
Location:
United States
Job Benefits:
Medical, dental, and prescription drug coverage
Flexible family care and parental leave
Vehicle discount program for employees and family members
Tuition assistance
Paid time off for community service
Generous holiday schedule
Option to purchase additional vacation time
Working Conditions:
Full Time
Employment Type:
Permanent Contract
Company Culture:
A diverse and inclusive workplace that values collaboration and innovation. Employees are encouraged to pursue their interests and develop their careers in a supportive environment.
Opportunities For Advancement:
Leadership roles, Technical expert positions, Cross-functional team opportunities
Visa Sponsorship:
Not Available
]]>Software Engineer – New Grad, Distributed Data Systems (2025 Start)
https://whoneedsengineers.com/jobs/software-development-and-engineering/software-engineer-new-grad-distributed-data-systems-2025-start-2/
Sun, 20 Oct 2024 12:45:02 +0000https://whoneedsengineers.com/wne_live/jobs/jobs-categories/software-engineer-new-grad-distributed-data-systems-2025-start-2/Software Engineer – New Grad, Distributed Data Systems (2025 Start)
Job Description:
At our organization, we are driven by a commitment to empower data teams in tackling some of the most challenging issues facing the world today, from enhancing security measures to advancing medical breakthroughs. We are focused on creating and maintaining a premier data and AI infrastructure platform, allowing our clients to concentrate on the critical, high-value challenges that are integral to their missions. Our objective is to fundamentally simplify the entire data lifecycle, which encompasses everything from data ingestion to ETL, business intelligence, and extending all the way to machine learning and artificial intelligence through a cohesive platform. We envision a transformative shift in data architecture, moving away from traditional data warehouse structures towards a novel architectural model known as Lakehouse, which integrates data warehousing with advanced analytics. This innovative approach is designed to tackle substantial issues such as data freshness, reliability, overall cost-effectiveness, data accessibility, and accommodating a broader range of use cases. As a member of our team, you will have the opportunity to engage in a variety of specialized areas including but not limited to query compilation and optimization, distributed query execution and scheduling, and enhancing data security. You will also delve into aspects of resource management, transaction coordination, and the development of efficient storage structures. Our goal is to cultivate an environment where creativity and technical expertise converge to drive meaningful advancements in data systems.
IT Languages:
Java
C++
As a Software Engineer in the Distributed Data Systems team, you will engage in various key responsibilities aimed at enhancing our data infrastructure.:
Develop and implement query compilation and optimization techniques.;; Contribute to distributed query execution and scheduling processes.;; Design and build components for a vectorized execution engine.;; Enhance data security measures across our platforms.;; Manage resources efficiently to optimize system performance.;; Coordinate transactions to ensure data integrity.;; Create efficient storage structures, including encodings and indexes.;; Implement automatic physical data optimization strategies.;; Oversee the management of our data storage systems.
Spoken Languages:
English
Skillset:
Query optimization
Distributed systems
Database management
Performance tuning
Resource management
Soft Skills:
Analytical thinking
Problem-solving
Team collaboration
Adaptability
Attention to detail
Qualifications:
Bachelor’s degree in Computer Science, Engineering, or a related field, with graduation anticipated in Fall 2024 or Spring 2025.
Proficiency in a general-purpose programming language such as Java or C++.
Solid understanding of algorithms, data structures, and principles of object-oriented programming.
Demonstrated passion for database and storage systems, distributed systems, language design, or performance optimization.
Experience in managing projects from inception to completion.
Years of Experience:
0
Location:
United States
Job Benefits:
Comprehensive health insurance
Retirement savings plan
Annual performance bonuses
Equity options
Flexible working hours
Professional development opportunities
Working Conditions:
Full Time
Employment Type:
Permanent Contract
Company Culture:
We foster a culture that values innovation, collaboration, and inclusivity. Our environment is designed to support diverse perspectives and encourage personal and professional growth. We believe in empowering our employees to excel and contribute meaningfully to our mission.
Opportunities For Advancement:
Career progression into senior technical roles, Leadership development programs, Opportunities to work on cutting-edge projects
Visa Sponsorship:
Available
]]>Software Engineer – New Grad, Distributed Data Systems (2025 Start)
https://whoneedsengineers.com/jobs/software-development-and-engineering/software-engineer-new-grad-distributed-data-systems-2025-start/
Sun, 13 Oct 2024 13:00:02 +0000https://whoneedsengineers.com/wne_live/jobs/jobs-categories/software-engineer-new-grad-distributed-data-systems-2025-start/Software Engineer – New Grad, Distributed Data Systems (2025 Start)
Job Description:
At our organization, we are driven by a commitment to empower data teams in tackling some of the most challenging issues facing the world today, from enhancing security measures to advancing medical breakthroughs. We are focused on creating and maintaining a premier data and AI infrastructure platform, allowing our clients to concentrate on the critical, high-value challenges that are integral to their missions. Our objective is to fundamentally simplify the entire data lifecycle, which encompasses everything from data ingestion to ETL, business intelligence, and extending all the way to machine learning and artificial intelligence through a cohesive platform. We envision a transformative shift in data architecture, moving away from traditional data warehouse structures towards a novel architectural model known as Lakehouse, which integrates data warehousing with advanced analytics. This innovative approach is designed to tackle substantial issues such as data freshness, reliability, overall cost-effectiveness, data accessibility, and accommodating a broader range of use cases. As a member of our team, you will have the opportunity to engage in a variety of specialized areas including but not limited to query compilation and optimization, distributed query execution and scheduling, and enhancing data security. You will also delve into aspects of resource management, transaction coordination, and the development of efficient storage structures. Our goal is to cultivate an environment where creativity and technical expertise converge to drive meaningful advancements in data systems.
IT Languages:
Java
C++
As a Software Engineer in the Distributed Data Systems team, you will engage in various key responsibilities aimed at enhancing our data infrastructure.:
Develop and implement query compilation and optimization techniques.;; Contribute to distributed query execution and scheduling processes.;; Design and build components for a vectorized execution engine.;; Enhance data security measures across our platforms.;; Manage resources efficiently to optimize system performance.;; Coordinate transactions to ensure data integrity.;; Create efficient storage structures, including encodings and indexes.;; Implement automatic physical data optimization strategies.;; Oversee the management of our data storage systems.
Spoken Languages:
English
Skillset:
Query optimization
Distributed systems
Database management
Performance tuning
Resource management
Soft Skills:
Analytical thinking
Problem-solving
Team collaboration
Adaptability
Attention to detail
Qualifications:
Bachelor’s degree in Computer Science, Engineering, or a related field, with graduation anticipated in Fall 2024 or Spring 2025.
Proficiency in a general-purpose programming language such as Java or C++.
Solid understanding of algorithms, data structures, and principles of object-oriented programming.
Demonstrated passion for database and storage systems, distributed systems, language design, or performance optimization.
Experience in managing projects from inception to completion.
Years of Experience:
0
Location:
United States
Job Benefits:
Comprehensive health insurance
Retirement savings plan
Annual performance bonuses
Equity options
Flexible working hours
Professional development opportunities
Working Conditions:
Full Time
Employment Type:
Permanent Contract
Company Culture:
We foster a culture that values innovation, collaboration, and inclusivity. Our environment is designed to support diverse perspectives and encourage personal and professional growth. We believe in empowering our employees to excel and contribute meaningfully to our mission.
Opportunities For Advancement:
Career progression into senior technical roles, Leadership development programs, Opportunities to work on cutting-edge projects