Big Data Technologies – Who Needs Engineers
/wne_live
Software Engineering RecruitmentMon, 28 Oct 2024 16:30:02 +0000en-US
hourly
1 https://wordpress.org/?v=6.6.2/wne_live/wp-content/uploads/2023/06/cropped-wne_logo-3-32x32.pngBig Data Technologies – Who Needs Engineers
/wne_live
3232Data Engineer I
/jobs/data-sciene-and-analytics/data-engineer-i-2/
Mon, 28 Oct 2024 16:30:02 +0000/wne_live/jobs/jobs-categories/data-engineer-i-2/Data Engineer I
Job Description:
We are seeking a motivated and detail-oriented Data Engineer I to join our dynamic team. In this role, you will be responsible for designing, constructing, and maintaining scalable data pipelines that ensure the efficient flow of data across various systems. You will work closely with data scientists and analysts to understand their data needs and develop solutions that facilitate data-driven decision-making. As a Data Engineer, you will implement data models, optimize database performance, and ensure data integrity. This position provides an exciting opportunity to contribute to our data strategy and enhance our analytic capabilities.
IT Languages:
Python
SQL
Java
The Data Engineer I will be tasked with various responsibilities that are crucial for the handling and processing of data. These responsibilities include but are not limited to::
Designing and developing data pipelines to process large datasets efficiently;; Collaborating with data scientists to understand data requirements and provide necessary data solutions;; Monitoring and troubleshooting data pipeline performance to ensure optimal operation;; Implementing data governance practices to maintain data quality and integrity;; Documenting data processes and workflows to enhance team collaboration and knowledge sharing
Spoken Languages:
English;; Spanish
Skillset:
ETL
Data Warehousing
Big Data Technologies
Database Management
Cloud Services
Soft Skills:
Analytical thinking
Problem-solving
Effective communication
Team collaboration
Qualifications:
Bachelor’s degree in Computer Science, Information Technology, or a related field
Strong understanding of data structures, algorithms, and software design principles
Experience with ETL processes and data warehousing concepts
Years of Experience:
2
Location:
New York, NY, United States
Job Benefits:
Health insurance
Retirement savings plan
Paid time off
Professional development opportunities
Working Conditions:
Full Time
Employment Type:
Permanent Contract
Company Culture:
Our company fosters a collaborative and inclusive environment where innovation thrives. We value diversity in our team and encourage continuous learning and professional growth. We believe in work-life balance and support our employees in achieving their personal and professional goals.
Opportunities For Advancement:
Career development programs, Mentorship opportunities, Access to training and certifications
We are seeking a talented Data Engineer dedicated to building and optimizing data pipelines and architectures to support our data-driven initiatives. In this role, you will work closely with data scientists and analysts to ensure that our data infrastructure meets the needs of our business. Your responsibilities will include designing scalable data solutions, maintaining databases, and developing robust data integration processes. You will have the opportunity to work with cutting-edge technologies and contribute to innovative projects that impact our organization and clients. The ideal candidate will possess a strong analytical mindset and a passion for data engineering, as well as a commitment to continuous learning and improvement in an ever-evolving field.
IT Languages:
Python
SQL
Java
Scala
As a Data Engineer, your primary responsibilities will encompass the following tasks::
Design, construct, install and maintain large-scale processing systems and data pipelines;; Collaborate with data scientists to define data requirements and specifications;; Monitor data quality and ensure data integrity across various systems;; Implement data governance practices and security measures;; Optimize data flow and collection for cross-functional teams
Spoken Languages:
English;; Spanish;; French
Skillset:
Data warehousing
Big data technologies
Data visualization tools
Cloud services (AWS, Azure, GCP)
Soft Skills:
Strong problem-solving skills
Excellent communication abilities
Team player with a collaborative mindset
Adaptability to changing technologies and business needs
Qualifications:
Bachelor’s degree in Computer Science, Engineering or related field
Strong understanding of data modeling and data storage solutions
Experience with ETL processes and tools
Years of Experience:
5
Location:
United States
Job Benefits:
Health insurance
Retirement savings plan
Flexible working hours
Professional development opportunities
Remote work options
Working Conditions:
Full Time
Employment Type:
Permanent Contract
Company Culture:
We foster a culture of innovation and collaboration, encouraging team members to share ideas and contribute to projects that drive our mission forward. Our workplace is supportive and inclusive, with a strong emphasis on work-life balance and employee well-being.
Opportunities For Advancement:
Professional development programs, Mentorship opportunities, Career progression paths within the data team
We are seeking an enthusiastic and skilled Machine Learning Engineer to join our dynamic tech team in Munich. In this role, you will be responsible for designing, implementing, and deploying machine learning models that tackle complex challenges and enhance our product offerings. You will engage in diverse projects ranging from natural language processing to computer vision, utilizing the latest technologies to drive innovation and efficiency. Your expertise will be vital in collaborating with data scientists, software engineers, and product teams to integrate machine learning solutions into production, ensuring our systems are robust and scalable.
IT Languages:
Python
TensorFlow
PyTorch
Scikit-learn
As a Machine Learning Engineer, you will undertake the following responsibilities::
Design, develop, and optimize machine learning models for large-scale applications;; Collaborate with cross-functional teams to seamlessly integrate machine learning models into production;; Conduct thorough data analysis, preprocessing, and feature engineering to uphold data quality;; Implement comprehensive machine learning pipelines, covering model training, evaluation, and deployment;; Continuously monitor, maintain, and enhance the performance of deployed models over time;; Stay informed about the latest advancements in machine learning and artificial intelligence research
Spoken Languages:
English;; German
Skillset:
Machine Learning Algorithms
Cloud Platforms
Data Structures
Big Data Technologies
Deep Learning Frameworks
Soft Skills:
Problem-solving
Collaboration
Adaptability
Attention to detail
Time management
Qualifications:
Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field
Proven experience in machine learning engineering or a similar capacity
Years of Experience:
5
Location:
Germany
Job Benefits:
Competitive salary
Flexible working hours
Professional development opportunities
Health and wellness programs
Collaborative work environment
Working Conditions:
Hybrid
Employment Type:
Permanent Contract
Company Culture:
Our company fosters a culture of innovation and collaboration, where team members are encouraged to share ideas and contribute to exciting projects. We value continuous learning and support our employees in their professional growth.
Opportunities For Advancement:
Leadership roles, Specialization in advanced technologies, Mentorship opportunities
Visa Sponsorship:
Available
]]>Data Engineer
/jobs/data-sciene-and-analytics/data-engineer-39/
Sun, 27 Oct 2024 16:30:03 +0000/wne_live/jobs/jobs-categories/data-engineer-39/Data Engineer
Job Description:
We are seeking a skilled Data Engineer who will be instrumental in building and maintaining our data infrastructure. In this role, you will design and implement robust data pipelines that are essential for processing large volumes of data efficiently. Your expertise will help us transform raw data into actionable insights that drive our business decisions. You will collaborate with cross-functional teams to understand their data requirements and ensure that data is accessible and reliable. As a Data Engineer, you will also be responsible for optimizing data workflows and ensuring data quality across systems. The ideal candidate will have a strong background in data architecture and a passion for leveraging data to solve complex problems.
IT Languages:
Python
SQL
Java
Scala
As a Data Engineer, you will be tasked with developing and maintaining data pipelines and architecture. Your responsibilities will include the following::
Design and implement ETL processes for data ingestion;; Collaborate with data scientists and analysts to understand data needs;; Monitor and troubleshoot data processing workflows;; Ensure the security and privacy of data
Spoken Languages:
English;; Spanish
Skillset:
Data warehousing
ETL tools
Big Data technologies
Data visualization
Soft Skills:
Problem-solving
Communication
Team collaboration
Adaptability
Qualifications:
Bachelor’s degree in Computer Science, Information Technology, or a related field
Experience with data modeling and database design
Proficiency in SQL and NoSQL databases
Years of Experience:
5
Location:
New York, NY, United States
Job Benefits:
Health insurance
401(k) retirement plan
Paid time off
Professional development opportunities
Working Conditions:
Full Time
Employment Type:
Permanent Contract
Company Culture:
We foster a culture of innovation and collaboration, where team members are encouraged to share ideas and contribute to projects that drive our success. Our environment promotes continuous learning and growth, ensuring that employees are equipped with the latest skills and knowledge in data engineering.
Opportunities For Advancement:
Career development training, Mentorship programs, Leadership opportunities
Visa Sponsorship:
Available
]]>Data Engineer
/jobs/data-sciene-and-analytics/data-engineer-38/
Sun, 27 Oct 2024 12:30:02 +0000/wne_live/jobs/jobs-categories/data-engineer-38/Data Engineer
Job Description:
We are seeking a highly skilled Data Engineer to join our dynamic team. In this role, you will be responsible for designing, constructing, and maintaining scalable data pipelines that facilitate the flow of information across various systems. Your expertise will be crucial in transforming raw data into a format that is easily accessible and usable for analytical purposes. You will collaborate closely with data scientists, analysts, and other stakeholders to understand their data requirements and ensure timely delivery of high-quality data solutions. Additionally, you will play a pivotal role in optimizing database performance and implementing best practices in data management. This position offers an exciting opportunity to work with cutting-edge technologies and contribute to impactful data-driven projects.
IT Languages:
Python
SQL
Java
As a Data Engineer, you will undertake a variety of responsibilities that include but are not limited to::
Designing and developing robust data integration solutions;; Building and maintaining data architectures, including databases and data warehouses;; Ensuring data quality and consistency across different data sources;; Collaborating with cross-functional teams to gather and analyze requirements;; Implementing data security measures to protect sensitive information
Spoken Languages:
English;; Spanish
Skillset:
Data modeling
ETL tools
Big Data technologies
Cloud computing
Database management
Soft Skills:
Analytical thinking
Problem-solving
Effective communication
Team collaboration
Qualifications:
Bachelor’s degree in Computer Science, Information Technology, or a related field
Strong understanding of data warehousing concepts and ETL processes
Experience with cloud platforms such as AWS, Azure, or Google Cloud
Years of Experience:
5
Location:
New York, United States
Job Benefits:
Health insurance
Retirement plan
Paid time off
Professional development opportunities
Flexible working hours
Working Conditions:
Full Time
Employment Type:
Permanent Contract
Company Culture:
Our company fosters a culture of innovation, collaboration, and continuous improvement. We value diversity and inclusion, encouraging every team member to contribute their unique perspectives and ideas. We believe in empowering our employees through professional growth opportunities and maintaining a healthy work-life balance.
Opportunities For Advancement:
Career advancement within the data engineering team, Opportunities to lead projects and initiatives, Continuous learning and certification programs
Visa Sponsorship:
Available
]]>Data Scientist
/jobs/emerging-technologies-and-specialized-roles/data-scientist-35/
Sun, 27 Oct 2024 01:30:03 +0000/wne_live/jobs/jobs-categories/data-scientist-35/Data Scientist
Job Description:
We are seeking a skilled Data Scientist to join our dynamic team in New York. In this role, you will analyze intricate data sets using advanced statistical and machine learning models to extract meaningful insights that drive business decisions. Your expertise in Python will be essential for data analysis, visualization, and interacting with various APIs. You will also work with Linux operating systems, databases, big data technologies, and cloud services to deliver impactful results. A significant aspect of this position involves developing cutting-edge solutions for natural language processing and generative modeling tasks, utilizing technologies such as Natural Language Processing, Generative AI, and Large Language Models. Collaboration with cross-functional teams will be crucial, as you will need to comprehend business requirements and translate them into effective data science solutions. Clear communication of your findings to stakeholders, both technical and non-technical, is essential, requiring strong business analysis skills. You will thrive in an Agile environment, participating in sprint planning, daily stand-ups, and retrospectives to ensure timely project delivery.
IT Languages:
Python
SQL
The responsibilities associated with this role include the following tasks::
Analyze complex datasets to derive actionable insights;; Utilize Python for data analysis and visualization;; Develop innovative solutions for NLP and generative modeling;; Collaborate with cross-functional teams to understand business needs;; Communicate findings to both technical and non-technical stakeholders;; Engage actively in Agile methodologies and team ceremonies
Spoken Languages:
English
Skillset:
Statistical analysis
Machine learning
Natural Language Processing
Generative AI
Big Data technologies
Cloud services
Soft Skills:
Excellent communication skills
Strong analytical thinking
Collaborative team player
Adaptability
Qualifications:
Bachelor’s or Master’s degree in a quantitative field
Proven experience in data analysis and statistical modeling
Strong background in machine learning techniques
Years of Experience:
5
Location:
New York, NY, United States
Job Benefits:
Competitive salary
Health insurance
Retirement plan
Flexible working hours
Professional development opportunities
Working Conditions:
Hybrid
Employment Type:
Full-time
Company Culture:
We foster an innovative and inclusive environment that encourages growth and learning. Our team values collaboration, creativity, and the pursuit of excellence, ensuring that every member feels valued and empowered to contribute to their fullest potential.
Opportunities For Advancement:
Career progression opportunities, Access to training and workshops, Mentorship programs
Visa Sponsorship:
Available
]]>Data Engineer
/jobs/data-sciene-and-analytics/data-engineer-35/
Fri, 25 Oct 2024 16:30:03 +0000/wne_live/jobs/jobs-categories/data-engineer-35/Data Engineer
Job Description:
We are seeking a talented Data Engineer to join our dynamic team in Plano, TX. In this role, you will be responsible for designing, building, and maintaining robust data pipelines that support our analytics and business intelligence initiatives. You will work closely with data scientists, analysts, and business stakeholders to ensure that our data architecture is scalable, efficient, and meets the needs of the organization. The ideal candidate will have a passion for data and a strong understanding of data warehousing concepts, ETL processes, and database technologies. You will play a critical role in transforming raw data into actionable insights, enabling our teams to make data-driven decisions that enhance our business outcomes.
IT Languages:
Python
SQL
Java
Scala
The Data Engineer will undertake various responsibilities essential for the effective management and utilization of data within the organization.:
Design and implement data pipelines to collect, process, and store data from various sources;; Optimize existing data processes for improved performance and efficiency;; Collaborate with cross-functional teams to understand data requirements and provide solutions;; Monitor and troubleshoot data pipeline issues to ensure data integrity;; Document data flows, processes, and architecture for reference and compliance
Spoken Languages:
English;; Spanish;; French
Skillset:
ETL tools
Data warehousing
Big data technologies
Data visualization tools
Soft Skills:
Problem-solving
Analytical thinking
Communication
Team collaboration
Qualifications:
Bachelor’s degree in Computer Science, Information Technology, or a related field
Strong understanding of data modeling and database design principles
Experience with cloud platforms such as AWS or Azure
Years of Experience:
5
Location:
Plano, TX, United States
Job Benefits:
Health insurance
Retirement plan
Paid time off
Professional development opportunities
Working Conditions:
Full Time
Employment Type:
Permanent Contract
Company Culture:
We foster an inclusive and collaborative work environment where innovation and creativity are encouraged. Our team members are committed to continuous learning and professional growth, and we value diverse perspectives that drive our success. We believe in maintaining a healthy work-life balance and supporting our employees' well-being.
Opportunities For Advancement:
Career growth within the data engineering team, Access to training and development programs, Potential for leadership roles in the future
Visa Sponsorship:
Available
]]>Data Engineer
/jobs/data-sciene-and-analytics/data-engineer-33/
Thu, 24 Oct 2024 16:30:03 +0000/wne_live/jobs/jobs-categories/data-engineer-33/Data Engineer
Job Description:
We are seeking a skilled Data Engineer who possesses a strong technical background and is passionate about working with data. This position is perfect for individuals who excel in various aspects of data management, including designing, implementing, and optimizing data storage solutions. In this role, you will collaborate closely with various stakeholders, including business customers, product owners, and IT teams, to transform business objectives into effective data storage architectures. Your work will involve participating in agile and lean methodologies, ensuring software quality through automated testing, and contributing to continuous integration and deployment practices. You will be responsible for identifying and documenting requirements, working alongside Data Product Owners to create data storage designs, and implementing solutions using Google Cloud Platform technologies. Additionally, you will take part in performance tuning and provide second-level support to address customer inquiries and incidents.
IT Languages:
SQL
Python
DBT
GCP
Terraform
Airflow
As a Data Engineer, your primary responsibilities will include designing and implementing data storage solutions while ensuring their performance and reliability. You will work alongside cross-functional teams to ensure that the data infrastructure meets the evolving needs of the business.:
Identify, document, and communicate requirements for data solutions;; Design data storage architectures in collaboration with Data Product Owners;; Implement data storage solutions on Google Cloud Platform using DBT for transformations and BigQuery for data storage;; Participate in testing processes and adopt test-driven development methodologies;; Tune data storage systems for improved performance, including SQL query optimization and index management;; Provide Level 2 support for customer inquiries and technical issues;; Collaborate effectively with team members across various departments
Spoken Languages:
English
Skillset:
Big data technologies
Cloud computing
Data architecture
Performance tuning
Data manipulation
Data pipeline orchestration
Soft Skills:
Critical thinking
Strong communication skills
Team collaboration
Problem-solving
Qualifications:
Bachelor’s degree in Computer Science, Computer Engineering, Electrical Engineering, or a related field
At least two years of experience in big data technologies
Minimum one year of experience with cloud computing platforms such as AWS, Azure, or Google Cloud
Years of Experience:
3
Location:
United States
Job Benefits:
Medical, dental, and prescription drug coverage
Flexible family care and parental leave
Vehicle discount program for employees and family members
Tuition assistance
Paid time off for community service
Generous holiday schedule
Option to purchase additional vacation time
Working Conditions:
Full Time
Employment Type:
Permanent Contract
Company Culture:
A diverse and inclusive workplace that values collaboration and innovation. Employees are encouraged to pursue their interests and develop their careers in a supportive environment.
Opportunities For Advancement:
Leadership roles, Technical expert positions, Cross-functional team opportunities
Visa Sponsorship:
Not Available
]]>Data Engineer
/jobs/data-sciene-and-analytics/data-engineer-32/
Thu, 24 Oct 2024 04:30:01 +0000/wne_live/jobs/jobs-categories/data-engineer-32/Data Engineer
Job Description:
We are seeking a skilled Data Engineer to join our dynamic team in Atlanta. The ideal candidate will be responsible for designing, constructing, and maintaining scalable data pipelines. You will work closely with data scientists and analysts to ensure data is accessible and usable for reporting and analytics. Your expertise will help transform complex data sets into actionable insights, driving strategic business decisions. This role requires a strong background in data warehousing, ETL processes, and proficiency in database management. You will also be expected to collaborate in a fast-paced environment, leveraging your problem-solving skills to tackle data-related challenges.
IT Languages:
Python
SQL
Java
Scala
As a Data Engineer, you will have a range of responsibilities critical to our data infrastructure.:
Design and implement robust data pipelines to ingest, process, and analyze large datasets;; Ensure data quality and integrity by implementing best practices and monitoring processes;; Collaborate with cross-functional teams to identify data needs and deliver solutions;; Optimize data storage and retrieval performance for analytics applications;; Document data architecture and processes to facilitate knowledge sharing
Spoken Languages:
English;; Spanish
Skillset:
ETL processes
Data warehousing
Database management
Big data technologies
Cloud computing
Soft Skills:
Analytical thinking
Communication skills
Team collaboration
Problem-solving
Attention to detail
Qualifications:
Bachelor’s degree in Computer Science, Information Technology, or related field
Strong understanding of data modeling and database design principles
Experience with cloud services such as AWS, Google Cloud, or Azure
Years of Experience:
3
Location:
Atlanta, GA, United States
Job Benefits:
Health insurance
Retirement savings plan
Paid time off
Professional development opportunities
Flexible working hours
Working Conditions:
Full Time
Employment Type:
Permanent Contract
Company Culture:
Our company fosters a collaborative and innovative environment where employees are encouraged to share ideas and drive initiatives. We value diversity and inclusion, promoting a workplace where everyone feels respected and empowered to contribute.
Opportunities For Advancement:
Career development programs, Mentorship opportunities, Access to industry conferences
Visa Sponsorship:
Available
]]>Data Engineer II
/jobs/data-sciene-and-analytics/data-engineer-ii-2/
Wed, 23 Oct 2024 16:30:01 +0000/wne_live/jobs/jobs-categories/data-engineer-ii-2/Data Engineer II
Job Description:
We are seeking a talented Data Engineer II to join our dynamic team in Cupertino. The ideal candidate will play a crucial role in designing, building, and maintaining robust data pipelines that effectively collect, process, and transform data from various sources into actionable insights. You will work closely with data scientists and analysts to ensure that our data infrastructure supports the needs of the business. As a Data Engineer, you will be responsible for optimizing data flow and collection processes, implementing data storage solutions, and ensuring data quality and integrity. You should have a strong understanding of data engineering principles and experience with cloud-based data platforms. This position offers a unique opportunity to contribute to innovative projects that drive data-driven decision-making across the organization.
IT Languages:
Python
SQL
Java
Scala
As a Data Engineer II, you will be tasked with the following responsibilities::
Designing and developing scalable and efficient data pipelines;; Building data storage solutions and optimizing database performance;; Collaborating with data scientists to support their data requirements;; Ensuring data quality and integrity by implementing validation checks;; Monitoring and troubleshooting data workflows to ensure reliability;; Documenting data processes and architectures for future reference
Spoken Languages:
English;; Spanish
Skillset:
Big Data technologies
Data warehousing
Database management
Cloud platforms (AWS, GCP, or Azure)
Soft Skills:
Strong problem-solving skills
Effective communication skills
Ability to work collaboratively in a team environment
Adaptability to changing requirements and technologies
Qualifications:
Bachelor’s degree in Computer Science, Engineering, or a related field
Proven experience in data engineering or a related field
Strong understanding of data modeling and ETL processes
Years of Experience:
5
Location:
Cupertino, CA, United States
Job Benefits:
Health and dental insurance
401(k) matching
Flexible working hours
Professional development opportunities
Generous paid time off
Working Conditions:
Full Time
Employment Type:
Permanent Contract
Company Culture:
Our company fosters a culture of innovation and collaboration, where employees are encouraged to share ideas and take ownership of their projects. We value diversity and inclusion, promoting a positive work environment that supports personal and professional growth.
Opportunities For Advancement:
Career development programs, Mentorship opportunities, Pathways to senior data engineering roles