Airflow – Who Needs Engineers https://whoneedsengineers.com/wne_live Software Engineering Recruitment Fri, 25 Oct 2024 09:30:02 +0000 en-US hourly 1 https://wordpress.org/?v=6.6.2 https://whoneedsengineers.com/wne_live/wp-content/uploads/2023/06/cropped-wne_logo-3-32x32.png Airflow – Who Needs Engineers https://whoneedsengineers.com/wne_live 32 32 2025 Intern – Data Scientist https://whoneedsengineers.com/jobs/emerging-technologies-and-specialized-roles/2025-intern-data-scientist/ Fri, 25 Oct 2024 09:30:02 +0000 https://whoneedsengineers.com/wne_live/jobs/jobs-categories/2025-intern-data-scientist/ 2025 Intern – Data Scientist

Job Description:

    Join our innovative team as a Data Science Intern and immerse yourself in the world of generative AI at Adobe. This role presents a unique opportunity to apply cutting-edge data mining, machine learning, and natural language processing techniques to real-world datasets. As part of the Firefly Data Science team, you will engage in analyzing extensive customer data, contributing to various business challenges, and enhancing our product offerings. You will be responsible for developing machine learning models that not only generate insights but also create tangible business impacts. Your work will be instrumental in transforming how our customers interact with our products throughout their lifecycle, ensuring value realization and improving customer experience.

IT Languages:

  • Python
  • SQL

As a Data Science Intern, you will take part in various responsibilities that leverage your technical and analytical skills.:

    Apply data mining and machine learning to analyze and interpret massive datasets.;; Develop scalable machine learning models and assess their business impact.;; Utilize statistical techniques to derive insights and predictions from data.;; Explore customer product life cycles to enhance engagement and service delivery.

Spoken Languages:

  • English

Skillset:

  • Data mining
  • Machine learning
  • Natural Language Processing
  • Statistical modeling
  • Cloud computing
  • ML frameworks
  • Git
  • Jupyter Notebook
  • Azure
  • AWS
  • Databricks
  • Spark-SQL
  • Airflow

Soft Skills:

  • Analytical thinking
  • Problem-solving
  • Team collaboration
  • Effective communication

Qualifications:

  • Currently enrolled in a Master’s or PhD program in Computer Science, Data Science, Information Science, Statistics, Applied Mathematics, or Engineering with an expected graduation date between December 2025 and June 2026.
  • Strong foundation in SQL and Python programming languages.
  • Proven understanding of machine learning, data mining, and statistical modeling concepts.

Years of Experience:

    0

Location:

    United States

Job Benefits:

  • Competitive hourly compensation
  • Hybrid work environment
  • Mentorship from experienced professionals
  • Opportunities for skill development and learning

Working Conditions:

    Hybrid

Employment Type:

    Internship

Company Culture:

  • At Adobe, we believe in the power of creativity and innovation. Our culture fosters collaboration and values diverse perspectives. We are committed to providing equal opportunities and ensuring that every employee feels respected and included. We encourage our employees to share their ideas, as we recognize that the next great innovation can come from anyone within our organization.

Opportunities For Advancement:

  • Potential for future employment after internship, Networking opportunities with industry professionals, Access to training and development programs

Visa Sponsorship:

    Not Available
]]> Senior Data Engineer https://whoneedsengineers.com/jobs/data-sciene-and-analytics/senior-data-engineer-8/ Fri, 25 Oct 2024 04:30:02 +0000 https://whoneedsengineers.com/wne_live/jobs/jobs-categories/senior-data-engineer-8/ Senior Data Engineer

Job Description:

    We are looking for a skilled and experienced Senior Data Engineer to become an integral part of our vibrant team. The successful candidate will excel in creating and maintaining a robust data infrastructure, crafting effective data models, and visualizing critical insights that guide strategic decisions. In this role, you will be pivotal in optimizing our data pipelines to ensure reliability, while also enhancing our data visualization capabilities to support our business initiatives.

IT Languages:

  • SQL
  • Python

As a Senior Data Engineer, you will undertake various responsibilities that are crucial for the success of our data initiatives.:

    Design, develop, and maintain scalable data infrastructure utilizing Snowflake, Airflow, Fivetran, and DBT to facilitate efficient data pipelines.;; Utilize SQL and Python for data manipulation, analysis, and automation tasks.;; Collaborate with stakeholders to create data marts and resolve issues related to data accuracy, completeness, and integrity.;; Develop and execute tests to ensure reliable data ingestion and processing, especially with DBT data models.;; Implement site reliability engineering practices and monitor ETL pipelines using tools like New Relic to ensure system stability.;; Work with cross-functional teams to gather requirements, identify opportunities, and deliver data solutions that yield business value.

Spoken Languages:

  • English

Skillset:

  • Snowflake
  • Airflow
  • Fivetran
  • DBT
  • Data modeling
  • Git version control
  • Continuous integration/deployment
  • Cloud technologies
  • AWS

Soft Skills:

  • Excellent communication skills
  • Collaborative mindset
  • Strong problem-solving abilities
  • Ability to troubleshoot complex issues

Qualifications:

  • Bachelor’s Degree in a related field
  • Minimum five years of experience in data engineering, preferably in the fintech sector

Years of Experience:

    5

Location:

    Chicago, IL, United States

Job Benefits:

  • Competitive salary
  • Health and wellness benefits
  • Professional development opportunities
  • Flexible work arrangements
  • Collaborative work environment

Working Conditions:

    Full Time

Employment Type:

    Permanent Contract

Company Culture:

  • Our company thrives on innovation and teamwork. We are dedicated to creating an environment that fosters professional growth, encourages collaboration, and supports individuals in their mission to improve financial health. Here, your contributions will directly impact our customers' lives.

Opportunities For Advancement:

  • Career growth and development programs, Mentorship opportunities, Leadership training

Visa Sponsorship:

    Not Available
]]> Machine Learning Automation Engineer https://whoneedsengineers.com/jobs/emerging-technologies-and-specialized-roles/machine-learning-automation-engineer/ Sun, 13 Oct 2024 16:00:02 +0000 https://whoneedsengineers.com/wne_live/jobs/jobs-categories/machine-learning-automation-engineer/ Machine Learning Automation Engineer

Job Description:

    Are you passionate about automation and streamlining processes? Do you find repetitive tasks tedious and enjoy creating innovative solutions that drive efficiency? If you have a knack for quantifying and measuring results, we want you to join our team. In this role, you will be a key player in automating machine learning operations and enhancing our MLOps framework. Our innovative technology company is transforming the real estate sector with cutting-edge digital solutions aimed at efficiency and sustainability. As a Machine Learning Automation Engineer, you will work closely with cross-functional teams, enabling the seamless deployment of scalable machine learning models that make meaningful contributions to our projects. Your work will focus on designing and implementing automated ML pipelines, ensuring that our clients receive the highest quality service while optimizing refurbishment projects. This position offers a unique opportunity to be part of a dynamic startup that is making waves in the industry.

IT Languages:

  • Python
  • SQL

As a Machine Learning Automation Engineer, your primary responsibilities will include the design and implementation of automated ML workflows and pipelines to enhance our machine learning capabilities.:

    Design and implement automated ML pipelines for data preprocessing, model training, evaluation, and deployment.;; Collaborate with data scientists and engineers to integrate ML models into production environments, ensuring optimal performance and scalability.;; Develop and maintain CI/CD pipelines for machine learning projects to automate model testing, deployment, and monitoring.;; Implement best practices in MLOps, including version control and performance tracking.;; Work with the data engineering team to ensure high-quality data availability for model training and inference.;; Stay updated on advancements in AI/ML technologies and automation tools to enhance our ML infrastructure.

Spoken Languages:

  • English;; German

Skillset:

  • CI/CD
  • Docker
  • Kubernetes
  • AWS
  • GCP
  • Azure
  • Scikit-learn
  • TensorFlow
  • PyTorch
  • Kubeflow
  • Airflow
  • MLflow
  • Postgres
  • BigQuery
  • Oracle

Soft Skills:

  • Excellent problem-solving abilities
  • Strong communication skills
  • Ability to work independently and as part of a team

Qualifications:

  • Strong understanding of CI/CD principles
  • Experience with containerization technologies
  • Proficiency in Python and familiarity with ML libraries
  • Expertise in automation/orchestration tools
  • Experience with database management systems

Years of Experience:

    3

Location:

    Germany

Job Benefits:

  • Competitive salary
  • Comprehensive benefits package
  • Flexible working arrangements including remote options
  • Opportunities for continuous learning and personal growth
  • Collaborative and innovative work environment

Working Conditions:

    Full Time

Employment Type:

    Permanent Contract

Company Culture:

  • At our company, we foster a culture of creativity and innovation, with an emphasis on teamwork and collaboration. Our flat hierarchies allow for rapid decision-making and a dynamic work environment where employees are valued and encouraged to contribute ideas.

Opportunities For Advancement:

  • Professional development programs, Mentorship opportunities, Room for career progression within the company

Visa Sponsorship:

    Available
]]> Data Engineer https://whoneedsengineers.com/jobs/data-sciene-and-analytics/data-engineer-23/ Thu, 03 Oct 2024 00:45:03 +0000 https://whoneedsengineers.com/wne_live/jobs/jobs-categories/data-engineer-23/ Data Engineer

Job Description:

    Join our innovative team as a Data Engineer, where you will be at the forefront of transforming advertising data into meaningful insights. You will be responsible for designing and building efficient data pipelines that ensure our marketing services have access to reliable advertising data. Your expertise will help us transition to a modern architecture, using tools like Github Actions and dbt. You will collaborate closely with a diverse group of Data Engineers and Analysts, contributing to the development and maintenance of our data warehouse solutions. This role is essential in supporting our mission to provide timely and accurate data insights across various teams within the organization.

IT Languages:

  • SQL
  • Python

Key Responsibilities of the Data Engineer:

    Design and develop robust data pipelines from advertising systems to the data warehouse.;; Model data for optimal storage and efficient query performance.;; Ensure seamless data extraction using Python and SQL.;; Collaborate with teams across Schibsted companies in Norway and Sweden to provide timely and accurate data insights.;; Support stakeholders in defining data requirements for advertising performance.;; Implement Continuous Integration/Continuous Deployment (CI/CD) practices and optimize cloud infrastructure.

Spoken Languages:

  • English;; Swedish

Skillset:

  • DBT
  • Airflow
  • Github Actions
  • AWS
  • Azure
  • GCP

Soft Skills:

  • Team player
  • Strong communication skills
  • Problem-solving mindset
  • Adaptability

Qualifications:

  • Proficient in SQL
  • Strong knowledge of Python for data extraction
  • Experience with data modeling
  • Familiarity with CI/CD practices
  • Understanding of cloud platforms

Years of Experience:

    5

Location:

    Sweden

Job Benefits:

  • Flexible hybrid work policy
  • Opportunity to work on impactful projects
  • Collaborative team environment
  • Professional development opportunities

Working Conditions:

    Hybrid

Employment Type:

    Permanent Contract

Company Culture:

  • We foster a diverse and inclusive environment where collaboration is key. Our team is dedicated to leveraging data to empower journalism and enhance advertising performance, making a real difference in society. We encourage innovation and continuous learning.

Opportunities For Advancement:

  • Career growth within the company, Training and development programs, Networking opportunities across the Nordics

Visa Sponsorship:

    Not Available
]]> Data Engineer https://whoneedsengineers.com/jobs/data-sciene-and-analytics/data-engineer-19/ Wed, 02 Oct 2024 06:45:02 +0000 https://whoneedsengineers.com/wne_live/jobs/jobs-categories/data-engineer-19/ Data Engineer

Job Description:

    Are you ready to embark on an exciting journey to reshape the retail experience of tomorrow? We are seeking a talented Data Engineer to join our innovative team. In this role, you will be instrumental in developing and enhancing our cutting-edge data platform that drives our organizational decision-making. Your expertise will allow you to create and implement data-driven features and solutions, ensuring that our processes are not only efficient but also secure and reliable. You will work extensively with Google Cloud Platform technologies such as BigQuery, Dataflow, Airflow, and App Engine. Utilizing SQL, Python, and Node.js, you will transform data and build robust pipelines tailored to our needs. As a key contributor to our architecture and ELT systems, you will actively identify opportunities for improvement and innovation within our data capabilities. Your collaboration with various stakeholders, including analysts and product teams, will ensure that our data infrastructure aligns with the evolving demands of our organization. If you are passionate about data engineering and eager to create impactful solutions that will shape our future, we encourage you to apply and elevate your career with us.

IT Languages:

  • SQL
  • Python
  • Node.js

As a Data Engineer, you will have a diverse range of responsibilities aimed at improving our data capabilities and infrastructure.:

    Design, develop, and maintain data pipelines and ETL processes;; Collaborate with cross-functional teams to gather requirements and implement data solutions;; Optimize data processing applications for performance and scalability;; Ensure data quality and integrity throughout the data lifecycle;; Proactively identify and resolve data-related issues

Spoken Languages:

  • English;; Swedish

Skillset:

  • GCP
  • BigQuery
  • Dataform
  • Dataflow
  • Airflow
  • Terraform
  • Python
  • Matillion

Soft Skills:

  • Curiosity
  • Team collaboration
  • Problem-solving
  • Adaptability
  • Effective communication

Qualifications:

  • Master’s degree in computer science or engineering
  • Strong experience in data engineering with a focus on high-quality solutions for analysts
  • Proven track record in building data pipelines for large datasets
  • Experience with cloud platforms such as GCP, AWS, or Azure
  • Understanding of Data Warehouse Automation and ETL tools such as Dataform, DBT, and Airflow

Years of Experience:

    5

Location:

    Sweden

Job Benefits:

  • Flexible working hours
  • Professional development opportunities
  • Collaborative work environment
  • Health and wellness programs
  • Competitive salary package

Working Conditions:

    Full Time

Employment Type:

    Permanent Contract

Company Culture:

  • We foster an open, honest, and friendly workplace where every team member's opinion is valued. We believe in creating a fun and engaging environment while working hard to achieve our goals. Our discussions can be intense, but we always support one another.

Opportunities For Advancement:

  • Leadership roles, Specialization in advanced data technologies, Mentorship and training opportunities

Visa Sponsorship:

    Available
]]> Data Engineer https://whoneedsengineers.com/jobs/data-sciene-and-analytics/data-engineer-9/ Sun, 22 Sep 2024 20:20:02 +0000 https://whoneedsengineers.com/wne_live/jobs/jobs-categories/data-engineer-9/ Data Engineer

Job Description:

    Are you ready to embark on an exciting journey that will change the landscape of retail? We are searching for a talented Data Engineer to join our innovative team. In this role, you will be at the forefront of developing and enhancing our advanced data platform, which is crucial for empowering data-driven decisions across the organization. Your expertise in GCP technologies, including BigQuery, Dataflow, and Airflow, will be vital as you work with SQL, Python, and Node.js to construct reliable, efficient, and secure data pipelines. You will also take the lead in optimizing our architecture and ELT systems, identifying and implementing improvements that elevate our data capabilities. Collaboration is key; you will engage with various stakeholders, including analysts and product teams, to ensure that our data infrastructure effectively meets the evolving needs of our company. If you are passionate about data engineering and eager to create impactful solutions that will shape the future, we want to hear from you.

IT Languages:

  • SQL
  • Python
  • Node.js

As a Data Engineer, your primary responsibilities will include designing and implementing data solutions that enhance our data processing capabilities. You will be responsible for creating and maintaining data pipelines, ensuring data integrity and security, and collaborating with cross-functional teams to support the company’s growth.:

    Develop and maintain data ingestion pipelines using GCP technologies;; Collaborate with analysts to understand their data needs and provide solutions;; Optimize existing data processes and explore new methodologies for data handling;; Ensure compliance with data governance and security standards;; Participate in code reviews and contribute to team knowledge sharing

Spoken Languages:

  • English;; Swedish

Skillset:

  • Data Engineering
  • GCP
  • BigQuery
  • Dataflow
  • Airflow
  • ETL
  • SQL
  • Python
  • Node.js

Soft Skills:

  • Strong analytical skills
  • Excellent communication abilities
  • Team-oriented mindset
  • Adaptability and willingness to learn
  • Problem-solving aptitude

Qualifications:

  • Master’s degree in Computer Science or Engineering
  • Proven experience in data engineering for over 5 years
  • Strong background in developing high-quality solutions for data analysts
  • Experience in building data pipelines that handle large datasets
  • Familiarity with cloud platforms such as GCP, AWS, or Azure
  • Understanding of Data Warehouse Automation and ETL tools

Years of Experience:

    5

Location:

    Greater Stockholm Metropolitan Area, EU

Job Benefits:

  • Flexible working hours
  • Professional development opportunities
  • Health and wellness programs
  • Collaborative work environment
  • Fun team-building activities

Working Conditions:

    Full Time

Employment Type:

    Permanent Contract

Company Culture:

  • Our workplace is characterized by openness, honesty, and friendliness, where every team member's opinion is valued. We strive to create a vibrant atmosphere that encourages collaboration and innovation while ensuring that we enjoy our time at work. The discussions are engaging, and we always support each other, fostering a strong team spirit.

Opportunities For Advancement:

  • Career development programs, Mentorship opportunities, Potential for leadership roles in the future

Visa Sponsorship:

    Available
]]> Data Analyst https://whoneedsengineers.com/jobs/data-sciene-and-analytics/data-analyst-18/ Wed, 18 Sep 2024 16:30:02 +0000 https://whoneedsengineers.com/wne_live/jobs/jobs-categories/data-analyst-18/ Data Analyst

Job Description:

    Are you passionate about leveraging data and analytics to drive impactful changes? Would you find it exciting to contribute to the largest digital news destination in Sweden? If so, this opportunity is tailored for you! We are currently seeking a Data Analyst to join our dynamic team at Aftonbladet. As a part of the data and analytics team under Subscription Sweden within Schibsted Media, which also encompasses brands like Omni, Svenska Dagbladet, Wellobe, and Podme, you will be instrumental in creating optimal conditions for growth. You will collaborate closely with various departments including editorial teams, commercial leaders, and central Schibsted teams, focusing on generating actionable insights that enhance journalism and the business segments at Aftonbladet. Your role will involve connecting data points and presenting recommendations to stakeholders, supporting the ongoing development of innovative audio and video formats for journalism. You will be at the forefront of testing, evaluating, and optimizing these formats for our millions of daily visitors, ensuring that your analytical contributions have a tangible impact. We encourage you to influence your role by focusing on areas you are particularly passionate about, making this position a unique opportunity for personal and professional growth.

IT Languages:

  • SQL
  • Python
  • R

As a Data Analyst, your primary responsibilities will include analyzing complex datasets, generating insights, and collaborating with cross-functional teams to enhance our journalistic content and business operations.:

    Break down problems and structure analytical questions to guide investigations;; Visualize data and present insights clearly to diverse audiences;; Drive independent initiatives to explore data-driven opportunities;; Work closely with editorial and commercial teams to align data strategies with business goals;; Evaluate and optimize new audio and video formats for enhanced audience engagement

Spoken Languages:

  • Swedish;; English

Skillset:

  • SQL
  • Python
  • R
  • Tableau
  • Amplitude
  • AWS
  • Snowflake
  • Airflow
  • dbt

Soft Skills:

  • Curiosity
  • Drive
  • Communication
  • Adaptability
  • Team collaboration

Qualifications:

  • Relevant educational background in data analysis or a related field
  • Strong understanding of SQL
  • Experience with programming languages like Python and R
  • Familiarity with visualization tools such as Tableau and Amplitude
  • Knowledge of platforms like AWS, Snowflake, Airflow, and dbt

Years of Experience:

    3

Location:

    Stockholm, Stockholm County, Sweden, EU

Job Benefits:

  • Comprehensive benefits package
  • Career advancement opportunities
  • Hybrid work environment
  • Supportive team culture
  • Access to cutting-edge technologies

Working Conditions:

    Full Time

Employment Type:

    Permanent Contract

Company Culture:

  • A fast-paced, innovative environment that encourages experimentation and values collaboration. The team operates with an open mindset, fostering a supportive atmosphere where ideas are freely exchanged and challenges are tackled collectively. Colleagues are highly skilled and supportive, creating a comfortable and stimulating work environment.

Opportunities For Advancement:

  • Potential to lead projects, Opportunities for skill development, Possibility to work on diverse brands within Schibsted

Visa Sponsorship:

    Available
]]>