Airflow – Who Needs Engineers
/wne_live
Software Engineering RecruitmentFri, 25 Oct 2024 09:30:02 +0000en-US
hourly
1 https://wordpress.org/?v=6.6.2/wne_live/wp-content/uploads/2023/06/cropped-wne_logo-3-32x32.pngAirflow – Who Needs Engineers
/wne_live
32322025 Intern – Data Scientist
/jobs/emerging-technologies-and-specialized-roles/2025-intern-data-scientist/
Fri, 25 Oct 2024 09:30:02 +0000/wne_live/jobs/jobs-categories/2025-intern-data-scientist/2025 Intern – Data Scientist
Job Description:
Join our innovative team as a Data Science Intern and immerse yourself in the world of generative AI at Adobe. This role presents a unique opportunity to apply cutting-edge data mining, machine learning, and natural language processing techniques to real-world datasets. As part of the Firefly Data Science team, you will engage in analyzing extensive customer data, contributing to various business challenges, and enhancing our product offerings. You will be responsible for developing machine learning models that not only generate insights but also create tangible business impacts. Your work will be instrumental in transforming how our customers interact with our products throughout their lifecycle, ensuring value realization and improving customer experience.
IT Languages:
Python
SQL
As a Data Science Intern, you will take part in various responsibilities that leverage your technical and analytical skills.:
Apply data mining and machine learning to analyze and interpret massive datasets.;; Develop scalable machine learning models and assess their business impact.;; Utilize statistical techniques to derive insights and predictions from data.;; Explore customer product life cycles to enhance engagement and service delivery.
Spoken Languages:
English
Skillset:
Data mining
Machine learning
Natural Language Processing
Statistical modeling
Cloud computing
ML frameworks
Git
Jupyter Notebook
Azure
AWS
Databricks
Spark-SQL
Airflow
Soft Skills:
Analytical thinking
Problem-solving
Team collaboration
Effective communication
Qualifications:
Currently enrolled in a Master’s or PhD program in Computer Science, Data Science, Information Science, Statistics, Applied Mathematics, or Engineering with an expected graduation date between December 2025 and June 2026.
Strong foundation in SQL and Python programming languages.
Proven understanding of machine learning, data mining, and statistical modeling concepts.
Years of Experience:
0
Location:
United States
Job Benefits:
Competitive hourly compensation
Hybrid work environment
Mentorship from experienced professionals
Opportunities for skill development and learning
Working Conditions:
Hybrid
Employment Type:
Internship
Company Culture:
At Adobe, we believe in the power of creativity and innovation. Our culture fosters collaboration and values diverse perspectives. We are committed to providing equal opportunities and ensuring that every employee feels respected and included. We encourage our employees to share their ideas, as we recognize that the next great innovation can come from anyone within our organization.
Opportunities For Advancement:
Potential for future employment after internship, Networking opportunities with industry professionals, Access to training and development programs
Visa Sponsorship:
Not Available
]]>Senior Data Engineer
/jobs/data-sciene-and-analytics/senior-data-engineer-8/
Fri, 25 Oct 2024 04:30:02 +0000/wne_live/jobs/jobs-categories/senior-data-engineer-8/Senior Data Engineer
Job Description:
We are looking for a skilled and experienced Senior Data Engineer to become an integral part of our vibrant team. The successful candidate will excel in creating and maintaining a robust data infrastructure, crafting effective data models, and visualizing critical insights that guide strategic decisions. In this role, you will be pivotal in optimizing our data pipelines to ensure reliability, while also enhancing our data visualization capabilities to support our business initiatives.
IT Languages:
SQL
Python
As a Senior Data Engineer, you will undertake various responsibilities that are crucial for the success of our data initiatives.:
Design, develop, and maintain scalable data infrastructure utilizing Snowflake, Airflow, Fivetran, and DBT to facilitate efficient data pipelines.;; Utilize SQL and Python for data manipulation, analysis, and automation tasks.;; Collaborate with stakeholders to create data marts and resolve issues related to data accuracy, completeness, and integrity.;; Develop and execute tests to ensure reliable data ingestion and processing, especially with DBT data models.;; Implement site reliability engineering practices and monitor ETL pipelines using tools like New Relic to ensure system stability.;; Work with cross-functional teams to gather requirements, identify opportunities, and deliver data solutions that yield business value.
Spoken Languages:
English
Skillset:
Snowflake
Airflow
Fivetran
DBT
Data modeling
Git version control
Continuous integration/deployment
Cloud technologies
AWS
Soft Skills:
Excellent communication skills
Collaborative mindset
Strong problem-solving abilities
Ability to troubleshoot complex issues
Qualifications:
Bachelor’s Degree in a related field
Minimum five years of experience in data engineering, preferably in the fintech sector
Years of Experience:
5
Location:
Chicago, IL, United States
Job Benefits:
Competitive salary
Health and wellness benefits
Professional development opportunities
Flexible work arrangements
Collaborative work environment
Working Conditions:
Full Time
Employment Type:
Permanent Contract
Company Culture:
Our company thrives on innovation and teamwork. We are dedicated to creating an environment that fosters professional growth, encourages collaboration, and supports individuals in their mission to improve financial health. Here, your contributions will directly impact our customers' lives.
Opportunities For Advancement:
Career growth and development programs, Mentorship opportunities, Leadership training
Are you passionate about automation and streamlining processes? Do you find repetitive tasks tedious and enjoy creating innovative solutions that drive efficiency? If you have a knack for quantifying and measuring results, we want you to join our team. In this role, you will be a key player in automating machine learning operations and enhancing our MLOps framework. Our innovative technology company is transforming the real estate sector with cutting-edge digital solutions aimed at efficiency and sustainability. As a Machine Learning Automation Engineer, you will work closely with cross-functional teams, enabling the seamless deployment of scalable machine learning models that make meaningful contributions to our projects. Your work will focus on designing and implementing automated ML pipelines, ensuring that our clients receive the highest quality service while optimizing refurbishment projects. This position offers a unique opportunity to be part of a dynamic startup that is making waves in the industry.
IT Languages:
Python
SQL
As a Machine Learning Automation Engineer, your primary responsibilities will include the design and implementation of automated ML workflows and pipelines to enhance our machine learning capabilities.:
Design and implement automated ML pipelines for data preprocessing, model training, evaluation, and deployment.;; Collaborate with data scientists and engineers to integrate ML models into production environments, ensuring optimal performance and scalability.;; Develop and maintain CI/CD pipelines for machine learning projects to automate model testing, deployment, and monitoring.;; Implement best practices in MLOps, including version control and performance tracking.;; Work with the data engineering team to ensure high-quality data availability for model training and inference.;; Stay updated on advancements in AI/ML technologies and automation tools to enhance our ML infrastructure.
Spoken Languages:
English;; German
Skillset:
CI/CD
Docker
Kubernetes
AWS
GCP
Azure
Scikit-learn
TensorFlow
PyTorch
Kubeflow
Airflow
MLflow
Postgres
BigQuery
Oracle
Soft Skills:
Excellent problem-solving abilities
Strong communication skills
Ability to work independently and as part of a team
Qualifications:
Strong understanding of CI/CD principles
Experience with containerization technologies
Proficiency in Python and familiarity with ML libraries
Expertise in automation/orchestration tools
Experience with database management systems
Years of Experience:
3
Location:
Germany
Job Benefits:
Competitive salary
Comprehensive benefits package
Flexible working arrangements including remote options
Opportunities for continuous learning and personal growth
Collaborative and innovative work environment
Working Conditions:
Full Time
Employment Type:
Permanent Contract
Company Culture:
At our company, we foster a culture of creativity and innovation, with an emphasis on teamwork and collaboration. Our flat hierarchies allow for rapid decision-making and a dynamic work environment where employees are valued and encouraged to contribute ideas.
Opportunities For Advancement:
Professional development programs, Mentorship opportunities, Room for career progression within the company
Visa Sponsorship:
Available
]]>Data Engineer
/jobs/data-sciene-and-analytics/data-engineer-23/
Thu, 03 Oct 2024 00:45:03 +0000/wne_live/jobs/jobs-categories/data-engineer-23/Data Engineer
Job Description:
Join our innovative team as a Data Engineer, where you will be at the forefront of transforming advertising data into meaningful insights. You will be responsible for designing and building efficient data pipelines that ensure our marketing services have access to reliable advertising data. Your expertise will help us transition to a modern architecture, using tools like Github Actions and dbt. You will collaborate closely with a diverse group of Data Engineers and Analysts, contributing to the development and maintenance of our data warehouse solutions. This role is essential in supporting our mission to provide timely and accurate data insights across various teams within the organization.
IT Languages:
SQL
Python
Key Responsibilities of the Data Engineer:
Design and develop robust data pipelines from advertising systems to the data warehouse.;; Model data for optimal storage and efficient query performance.;; Ensure seamless data extraction using Python and SQL.;; Collaborate with teams across Schibsted companies in Norway and Sweden to provide timely and accurate data insights.;; Support stakeholders in defining data requirements for advertising performance.;; Implement Continuous Integration/Continuous Deployment (CI/CD) practices and optimize cloud infrastructure.
Spoken Languages:
English;; Swedish
Skillset:
DBT
Airflow
Github Actions
AWS
Azure
GCP
Soft Skills:
Team player
Strong communication skills
Problem-solving mindset
Adaptability
Qualifications:
Proficient in SQL
Strong knowledge of Python for data extraction
Experience with data modeling
Familiarity with CI/CD practices
Understanding of cloud platforms
Years of Experience:
5
Location:
Sweden
Job Benefits:
Flexible hybrid work policy
Opportunity to work on impactful projects
Collaborative team environment
Professional development opportunities
Working Conditions:
Hybrid
Employment Type:
Permanent Contract
Company Culture:
We foster a diverse and inclusive environment where collaboration is key. Our team is dedicated to leveraging data to empower journalism and enhance advertising performance, making a real difference in society. We encourage innovation and continuous learning.
Opportunities For Advancement:
Career growth within the company, Training and development programs, Networking opportunities across the Nordics
Visa Sponsorship:
Not Available
]]>Data Engineer
/jobs/data-sciene-and-analytics/data-engineer-19/
Wed, 02 Oct 2024 06:45:02 +0000/wne_live/jobs/jobs-categories/data-engineer-19/Data Engineer
Job Description:
Are you ready to embark on an exciting journey to reshape the retail experience of tomorrow? We are seeking a talented Data Engineer to join our innovative team. In this role, you will be instrumental in developing and enhancing our cutting-edge data platform that drives our organizational decision-making. Your expertise will allow you to create and implement data-driven features and solutions, ensuring that our processes are not only efficient but also secure and reliable. You will work extensively with Google Cloud Platform technologies such as BigQuery, Dataflow, Airflow, and App Engine. Utilizing SQL, Python, and Node.js, you will transform data and build robust pipelines tailored to our needs. As a key contributor to our architecture and ELT systems, you will actively identify opportunities for improvement and innovation within our data capabilities. Your collaboration with various stakeholders, including analysts and product teams, will ensure that our data infrastructure aligns with the evolving demands of our organization. If you are passionate about data engineering and eager to create impactful solutions that will shape our future, we encourage you to apply and elevate your career with us.
IT Languages:
SQL
Python
Node.js
As a Data Engineer, you will have a diverse range of responsibilities aimed at improving our data capabilities and infrastructure.:
Design, develop, and maintain data pipelines and ETL processes;; Collaborate with cross-functional teams to gather requirements and implement data solutions;; Optimize data processing applications for performance and scalability;; Ensure data quality and integrity throughout the data lifecycle;; Proactively identify and resolve data-related issues
Spoken Languages:
English;; Swedish
Skillset:
GCP
BigQuery
Dataform
Dataflow
Airflow
Terraform
Python
Matillion
Soft Skills:
Curiosity
Team collaboration
Problem-solving
Adaptability
Effective communication
Qualifications:
Master’s degree in computer science or engineering
Strong experience in data engineering with a focus on high-quality solutions for analysts
Proven track record in building data pipelines for large datasets
Experience with cloud platforms such as GCP, AWS, or Azure
Understanding of Data Warehouse Automation and ETL tools such as Dataform, DBT, and Airflow
Years of Experience:
5
Location:
Sweden
Job Benefits:
Flexible working hours
Professional development opportunities
Collaborative work environment
Health and wellness programs
Competitive salary package
Working Conditions:
Full Time
Employment Type:
Permanent Contract
Company Culture:
We foster an open, honest, and friendly workplace where every team member's opinion is valued. We believe in creating a fun and engaging environment while working hard to achieve our goals. Our discussions can be intense, but we always support one another.
Opportunities For Advancement:
Leadership roles, Specialization in advanced data technologies, Mentorship and training opportunities
Are you ready to embark on an exciting journey that will change the landscape of retail? We are searching for a talented Data Engineer to join our innovative team. In this role, you will be at the forefront of developing and enhancing our advanced data platform, which is crucial for empowering data-driven decisions across the organization. Your expertise in GCP technologies, including BigQuery, Dataflow, and Airflow, will be vital as you work with SQL, Python, and Node.js to construct reliable, efficient, and secure data pipelines. You will also take the lead in optimizing our architecture and ELT systems, identifying and implementing improvements that elevate our data capabilities. Collaboration is key; you will engage with various stakeholders, including analysts and product teams, to ensure that our data infrastructure effectively meets the evolving needs of our company. If you are passionate about data engineering and eager to create impactful solutions that will shape the future, we want to hear from you.
IT Languages:
SQL
Python
Node.js
As a Data Engineer, your primary responsibilities will include designing and implementing data solutions that enhance our data processing capabilities. You will be responsible for creating and maintaining data pipelines, ensuring data integrity and security, and collaborating with cross-functional teams to support the company’s growth.:
Develop and maintain data ingestion pipelines using GCP technologies;; Collaborate with analysts to understand their data needs and provide solutions;; Optimize existing data processes and explore new methodologies for data handling;; Ensure compliance with data governance and security standards;; Participate in code reviews and contribute to team knowledge sharing
Spoken Languages:
English;; Swedish
Skillset:
Data Engineering
GCP
BigQuery
Dataflow
Airflow
ETL
SQL
Python
Node.js
Soft Skills:
Strong analytical skills
Excellent communication abilities
Team-oriented mindset
Adaptability and willingness to learn
Problem-solving aptitude
Qualifications:
Master’s degree in Computer Science or Engineering
Proven experience in data engineering for over 5 years
Strong background in developing high-quality solutions for data analysts
Experience in building data pipelines that handle large datasets
Familiarity with cloud platforms such as GCP, AWS, or Azure
Understanding of Data Warehouse Automation and ETL tools
Years of Experience:
5
Location:
Greater Stockholm Metropolitan Area, EU
Job Benefits:
Flexible working hours
Professional development opportunities
Health and wellness programs
Collaborative work environment
Fun team-building activities
Working Conditions:
Full Time
Employment Type:
Permanent Contract
Company Culture:
Our workplace is characterized by openness, honesty, and friendliness, where every team member's opinion is valued. We strive to create a vibrant atmosphere that encourages collaboration and innovation while ensuring that we enjoy our time at work. The discussions are engaging, and we always support each other, fostering a strong team spirit.
Opportunities For Advancement:
Career development programs, Mentorship opportunities, Potential for leadership roles in the future
Are you passionate about leveraging data and analytics to drive impactful changes? Would you find it exciting to contribute to the largest digital news destination in Sweden? If so, this opportunity is tailored for you! We are currently seeking a Data Analyst to join our dynamic team at Aftonbladet. As a part of the data and analytics team under Subscription Sweden within Schibsted Media, which also encompasses brands like Omni, Svenska Dagbladet, Wellobe, and Podme, you will be instrumental in creating optimal conditions for growth. You will collaborate closely with various departments including editorial teams, commercial leaders, and central Schibsted teams, focusing on generating actionable insights that enhance journalism and the business segments at Aftonbladet. Your role will involve connecting data points and presenting recommendations to stakeholders, supporting the ongoing development of innovative audio and video formats for journalism. You will be at the forefront of testing, evaluating, and optimizing these formats for our millions of daily visitors, ensuring that your analytical contributions have a tangible impact. We encourage you to influence your role by focusing on areas you are particularly passionate about, making this position a unique opportunity for personal and professional growth.
IT Languages:
SQL
Python
R
As a Data Analyst, your primary responsibilities will include analyzing complex datasets, generating insights, and collaborating with cross-functional teams to enhance our journalistic content and business operations.:
Break down problems and structure analytical questions to guide investigations;; Visualize data and present insights clearly to diverse audiences;; Drive independent initiatives to explore data-driven opportunities;; Work closely with editorial and commercial teams to align data strategies with business goals;; Evaluate and optimize new audio and video formats for enhanced audience engagement
Spoken Languages:
Swedish;; English
Skillset:
SQL
Python
R
Tableau
Amplitude
AWS
Snowflake
Airflow
dbt
Soft Skills:
Curiosity
Drive
Communication
Adaptability
Team collaboration
Qualifications:
Relevant educational background in data analysis or a related field
Strong understanding of SQL
Experience with programming languages like Python and R
Familiarity with visualization tools such as Tableau and Amplitude
Knowledge of platforms like AWS, Snowflake, Airflow, and dbt
Years of Experience:
3
Location:
Stockholm, Stockholm County, Sweden, EU
Job Benefits:
Comprehensive benefits package
Career advancement opportunities
Hybrid work environment
Supportive team culture
Access to cutting-edge technologies
Working Conditions:
Full Time
Employment Type:
Permanent Contract
Company Culture:
A fast-paced, innovative environment that encourages experimentation and values collaboration. The team operates with an open mindset, fostering a supportive atmosphere where ideas are freely exchanged and challenges are tackled collectively. Colleagues are highly skilled and supportive, creating a comfortable and stimulating work environment.
Opportunities For Advancement:
Potential to lead projects, Opportunities for skill development, Possibility to work on diverse brands within Schibsted