Azure Data Lake – Who Needs Engineers
https://whoneedsengineers.com/wne_live
Software Engineering RecruitmentWed, 02 Oct 2024 20:45:02 +0000en-US
hourly
1 https://wordpress.org/?v=6.6.2https://whoneedsengineers.com/wne_live/wp-content/uploads/2023/06/cropped-wne_logo-3-32x32.pngAzure Data Lake – Who Needs Engineers
https://whoneedsengineers.com/wne_live
3232Data Engineer
https://whoneedsengineers.com/jobs/data-sciene-and-analytics/data-engineer-22/
Wed, 02 Oct 2024 20:45:02 +0000https://whoneedsengineers.com/wne_live/jobs/jobs-categories/data-engineer-22/Data Engineer
Job Description:
Join a leading company in the fire protection industry, where you will play a crucial role in developing and maintaining our data platform. Your primary responsibility will be to ensure that the right data is available for decision-making and analysis, leveraging cutting-edge technologies. You will utilize Azure Data Lake for scalable and flexible storage solutions, and use Databricks to optimize our data pipelines while elevating our data to the cloud. Transforming and modeling data will be performed using dbt Cloud. Your expertise will be instrumental in tackling challenges related to incremental data ingestion from integrated systems and executing data transformations efficiently. Additionally, you will troubleshoot any issues related to data input and establish tests to ensure data quality. Our automated workflows will be under your care, allowing you to oversee the entire pipeline process, from raw data acquisition to transformations, modeling, and updated reports. This position is based in Hägersten, with the potential for remote work part of the time. Your contributions will directly impact our operational development, as the data you refine will be used to measure our climate impact and sustainability efforts across the organization, starting next year. You will have significant creative freedom, with minimal bureaucratic obstacles, and will be responsible for planning and implementing new initiatives. Collaborating with our controller, you will brainstorm ideas and bring projects to fruition, where your technical expertise will be key. Our goal is to enhance our data-driven approach and eventually implement data analysis using ML/AI techniques, where your role will be pivotal.
IT Languages:
Python
SQL
As a Data Engineer, your responsibilities will include data platform development, data availability for decision-making, and data quality assurance.:
Develop and maintain data pipelines;; Ensure scalable storage solutions using Azure Data Lake;; Optimize data workflows with Databricks;; Transform and model data with dbt Cloud;; Troubleshoot data input issues;; Create tests to ensure data quality;; Oversee automated workflows and reporting processes
Spoken Languages:
English;; Swedish
Skillset:
Azure Data Lake
Databricks
dbt Cloud
Power BI
ETL processes
Soft Skills:
Problem-solving
Creativity
Self-motivation
Collaboration
Qualifications:
University degree in a relevant field
Strong analytical skills
Interest in data management
Years of Experience:
3
Location:
Sweden
Job Benefits:
Flexible working hours
Remote work options
Professional development opportunities
Health and wellness programs
Working Conditions:
Full Time
Employment Type:
Permanent Contract
Company Culture:
The company fosters an innovative and collaborative environment, encouraging employees to take initiative and contribute to groundbreaking projects. The culture emphasizes sustainability and technical excellence, with a commitment to professional growth.
Opportunities For Advancement:
Career development programs, Mentorship opportunities, Leadership training
We are seeking a proactive and skilled Application Engineer to join our dynamic team. In this role, you will engage directly with cloud services, primarily utilizing Microsoft Azure as our cloud platform. You will be integral to our development cycle, contributing to every phase including requirement analysis, design, development, testing, deployment, and handover. Your responsibilities will include designing, building, and integrating data from various sources while writing complex data queries. Furthermore, you will create data infrastructure that is both simple and efficient, working closely with our business partners to enhance their understanding of customer demand through insightful data analysis.
IT Languages:
SQL
Python
Azure
As an Application Engineer, you will develop and maintain data pipelines and reporting solutions.:
Integrate data from diverse sources using integration and orchestration tools such as Azure Data Factory and Databricks;; Utilize Microsoft Azure Data Lake, Azure SQL Database, and data warehouse solutions effectively;; Monitor and troubleshoot data pipelines using Azure Monitor or Log Analytics to ensure performance and uptime;; Implement continuous integration and continuous deployment (CI/CD) practices using Azure DevOps;; Conduct data exploration and modeling, leveraging Azure Analysis Services;; Develop and maintain Power BI reports and self-service solutions
Spoken Languages:
Swedish;; English
Skillset:
Azure Data Factory
Databricks
Azure Data Lake
Azure SQL Database
Azure Analysis Services
Power BI
Azure DevOps
Soft Skills:
Self-motivated
Proactive
Strong communication skills
Team player
Qualifications:
Bachelor’s degree in Computer Science or a related field
Minimum two years of experience in software development
Years of Experience:
2
Location:
Solna, Stockholm County, Sweden, EU
Job Benefits:
Flexible working hours
Opportunity for remote work
Health insurance
Professional development programs
Collaborative work environment
Working Conditions:
Full Time
Employment Type:
Permanent Contract
Company Culture:
We foster a culture of innovation and collaboration, encouraging our employees to take initiative and contribute their ideas. Our team values transparency and open communication, which helps in building strong relationships both within the team and with our business partners.
Opportunities For Advancement:
Career growth opportunities, Skill enhancement through training, Promotion based on performance
We are currently in an exciting growth phase and are looking for a talented Application Engineer to join our dynamic team. In this role, you will have the opportunity to work in a varied environment where every day presents new challenges and learning opportunities. As a knowledge-driven company, we prioritize the sharing of expertise among our specialists, fostering an environment where colleagues can grow and develop their skills. You will be responsible for providing insights into client demands and enhancing our cloud service offerings using Microsoft Azure. This position will allow you to engage in the full development cycle, from requirement analysis to deployment, ensuring a comprehensive understanding of the projects you will be working on.
IT Languages:
Python
SQL
Azure
As an Application Engineer, you will be tasked with integrating data from various sources and developing efficient data infrastructures, while collaborating closely with clients and business partners.:
Design and build data solutions using Azure Data Factory and Databricks;; Write complex data queries to extract insights;; Create and maintain data infrastructure using Azure Data Lake and Azure SQL Database;; Monitor data pipelines using Azure Monitor for optimal performance;; Implement CI/CD practices for seamless deployment of data pipelines;; Develop and maintain Power BI reports and self-service solutions
Spoken Languages:
Swedish;; English
Skillset:
Azure Data Factory
Databricks
Azure Data Lake
Azure SQL Database
Power BI
Azure DevOps
Soft Skills:
Self-motivated
Collaborative
Strong communication
Problem-solving
Qualifications:
Proven experience in application engineering with a focus on cloud services
Strong understanding of Microsoft Azure and its various components
Experience with data integration and orchestration tools
Knowledge of data modeling and reporting tools
Years of Experience:
2
Location:
Stockholm, Stockholm County, Sweden, EU
Job Benefits:
Opportunities for continuous learning and development
Flexible working hours
Collaborative and friendly work environment
Access to the latest technologies and tools
Working Conditions:
Hybrid
Employment Type:
Permanent Contract
Company Culture:
We are an entrepreneurial IT company that values innovation, knowledge sharing, and continuous learning. We maintain a fun and familial atmosphere, free from rigid hierarchies, and actively foster a diverse workplace with a mix of experienced and junior employees.
Opportunities For Advancement:
Career growth through training and mentorship, Possibility to lead projects, Exposure to a variety of technologies
Join our innovative IPEX team where we are dedicated to enhancing the IKEA Planning experience. Our mission is to empower customers in their quest for personalized home furnishing solutions. We focus on creating and improving digital tools that enable customers and co-workers to design their ideal spaces, from kitchens to bedrooms, using the full range of IKEA products. As a Data Engineer, you will play a vital role in developing data pipelines and tools that foster a data-driven culture within our teams. You will collaborate closely with Data Scientists, Product Teams, and various stakeholders to ensure that our digital solutions not only meet current business needs but also adapt to future demands. Your expertise will help us deliver an inspiring and seamless planning journey for our customers while supporting our co-workers in delivering an efficient sales process. We are looking for someone who is passionate about leveraging data to create personalized experiences and who thrives on using innovative technologies to solve complex challenges.
IT Languages:
Python
PySpark
SQL
As a Data Engineer, you will have multifaceted responsibilities that are crucial to our data strategy.:
Design, build, and maintain data pipelines to support data-driven decision-making;; Collaborate with product teams to evaluate business needs and objectives;; Enhance data quality and reliability through innovative solutions;; Identify opportunities for data acquisition to expand our datasets;; Develop analytical tools and programs for standardized data access;; Work closely with data scientists and analysts to prepare data for machine learning applications;; Mentor and coach junior data engineers for their professional growth;; Ensure adherence to relevant digital frameworks and standards
Spoken Languages:
English;; Swedish
Skillset:
ETL workflows
Data warehousing
Big Data processing
Azure Databricks
Azure Data Factory
Azure Data Lake
Soft Skills:
Strong communication skills
Team collaboration
Problem-solving mindset
Adaptability to new technologies
Continuous learning attitude
Qualifications:
Bachelor’s degree in Engineering, Computer Science, Information Systems, Mathematics or related fields
Master’s degree preferred in relevant fields
Strong knowledge in designing automated data pipelines and ETL workflows
Proven experience in business process mapping for data analytics solutions
Years of Experience:
5
Location:
Europe
Job Benefits:
Competitive salary
Health and wellness programs
Flexible working hours
Opportunities for professional development
Employee discounts on products
Working Conditions:
Full Time
Employment Type:
Permanent Contract
Company Culture:
We foster an inclusive work environment that values diversity, collaboration, and innovation. Our team is driven by a shared vision to enhance the customer experience through technology and data. We encourage continuous learning and professional development, ensuring our employees are equipped with the latest skills and knowledge in the industry.
Opportunities For Advancement:
Career growth into senior engineering roles, Leadership positions within the data team, Opportunities to work on high-impact projects across the organization
Join a leading force in renewable energy as a Senior Integration Developer, where your expertise in C# and cloud technologies will be instrumental in combating climate change. As a vital part of our Integration and RPA team, you will play a key role in developing our cloud integration platform, facilitating seamless connections between various business areas and processes. This position not only allows you to contribute to innovative integration solutions but also helps streamline operations within a globally recognized company committed to a sustainable future. You'll engage with cutting-edge technologies and collaborate with diverse teams to ensure our digital foundation is robust and forward-looking, tackling the challenges of today and tomorrow in the energy sector.
IT Languages:
C#
Python
Azure
As a Senior Integration Developer, your responsibilities will encompass a range of tasks aimed at enhancing our integration capabilities.:
Design and implement integrations in Azure to optimize business processes;; Contribute to the migration of our on-prem integration platform to cloud services;; Collaborate with cross-functional teams to understand integration needs and deliver effective solutions;; Ensure high quality of code and maintain best practices in software development;; Automate business processes and enhance data management through RPA;; Continuously learn and apply new technologies and trends in cloud integration
Spoken Languages:
English;; German;; Norwegian
Skillset:
Azure Synapse
Azure Data Lake
Databricks
Azure Functions
Azure Logic Apps
Azure Service Bus
Azure API Management
Azure Data Factory
BizTalk
UIPath
Soft Skills:
Strong communication skills
Collaborative mindset
Problem-solving abilities
Adaptability to new technologies
Qualifications:
Proven experience in cloud development, particularly with Azure
Strong proficiency in C# development
Solid understanding of integration concepts and frameworks
Years of Experience:
5
Location:
Berlin, Germany, EU
Job Benefits:
Unlimited learning opportunities
Career growth in a global network
Contributing to environmental sustainability
Flexible working solutions
Competitive salary and benefits
Working Conditions:
Full Time
Employment Type:
Permanent Contract
Company Culture:
We promote an inclusive, diverse work environment where every voice is valued. Employees are encouraged to explore, learn, and contribute to meaningful projects that positively impact the planet.
Opportunities For Advancement:
Potential for leadership roles, Participation in innovative projects, Access to training and development programs