Spark – Who Needs Engineers
/wne_live
Software Engineering RecruitmentTue, 22 Oct 2024 16:30:01 +0000en-US
hourly
1 https://wordpress.org/?v=6.6.2/wne_live/wp-content/uploads/2023/06/cropped-wne_logo-3-32x32.pngSpark – Who Needs Engineers
/wne_live
3232Data Engineer
/jobs/data-sciene-and-analytics/data-engineer-28/
Tue, 22 Oct 2024 16:30:01 +0000/wne_live/jobs/jobs-categories/data-engineer-28/Data Engineer
Job Description:
We are seeking a Data Engineer who possesses a unique blend of technical expertise and strong interpersonal skills. This role is pivotal in managing the complete data lifecycle, starting from gathering requirements to deploying robust data solutions. The ideal candidate will have a deep understanding of data engineering principles and methodologies, as well as the ability to effectively communicate with both technical teams and business stakeholders to ensure that the data solutions align with organizational goals. You will be responsible for designing and implementing scalable data architectures, ensuring data quality, and optimizing data processing workflows. Your proficiency in various programming languages and data management tools will be crucial in transforming raw data into actionable insights, thereby driving data-driven decision-making within the company.
IT Languages:
SQL
Python
Java
Scala
As a Data Engineer, you will take on various responsibilities that are critical to the success of our data initiatives.:
Design and develop data models to support analytical needs;; Implement and maintain data pipelines for extracting, transforming, and loading data;; Collaborate with data scientists and analysts to understand data requirements;; Optimize data storage and management strategies for large datasets;; Monitor and troubleshoot data-related issues to ensure smooth operations
Spoken Languages:
English;; French
Skillset:
AWS
Hadoop
Spark
Kafka
SQL-based transformation frameworks
Apache NiFi
dbt
AWS Glue
Soft Skills:
Excellent communication skills
Strong team collaboration
Problem-solving abilities
Analytical thinking
Qualifications:
Bachelor’s degree in Computer Science, Engineering, or a related field
Strong background in data engineering or similar roles
Proven experience with cloud services, particularly AWS
Familiarity with Agile methodologies and software development lifecycle
Years of Experience:
4
Location:
United States
Job Benefits:
100% paid employee medical and dental benefits
Paid time off
Paid holidays
401(k) with immediately vested company match
Working Conditions:
Remote
Employment Type:
Contract
Company Culture:
We foster a collaborative environment that values innovation and encourages professional growth. Our team is committed to excellence and believes in leveraging technology to solve complex challenges. We prioritize open communication and support diversity and inclusion within our workplace.
Opportunities For Advancement:
Potential for contract renewal, Possibility of transitioning to permanent roles, Opportunities for skill development and training
Visa Sponsorship:
Not Available
]]>DevOps Automation Engineer (relocation to Malta)
/jobs/devops-cloud-and-it-operations/devops-automation-engineer-relocation-to-malta/
Mon, 21 Oct 2024 17:00:01 +0000/wne_live/jobs/jobs-categories/devops-automation-engineer-relocation-to-malta/DevOps Automation Engineer (relocation to Malta)
Job Description:
Join our dynamic team as a DevOps Automation Engineer, where you will play a pivotal role in enhancing our infrastructure and deployment processes. You will work closely with cross-functional teams to automate our systems and optimize the deployment of our innovative products in the iGaming industry. This position involves maintaining and improving our continuous integration and continuous deployment (CI/CD) pipelines while ensuring the security and performance of our environments. Your expertise in Linux administration and automation tools will be critical in streamlining our operations and supporting our growing infrastructure. You will also be responsible for managing databases and implementing various monitoring solutions to ensure our systems run efficiently.
IT Languages:
Python
Bash
Ansible
Terraform
As a DevOps Automation Engineer, your responsibilities will include managing and optimizing CI/CD pipelines, deploying Kubernetes clusters, and automating infrastructure.:
Manage and optimize CI/CD pipelines using Azure DevOps;; Deploy, administer, and scale Kubernetes clusters;; Develop and maintain Helm charts for Kubernetes applications;; Implement and manage GitOps workflows using Flux;; Design and manage Infrastructure as Code (IaC) using Ansible and Terraform;; Administer systems on Google Cloud Platform;; Support and manage Apache Airflow;; Administer and debug databases, particularly ClickHouse and PostgreSQL;; Manage messaging systems like Kafka;; Implement monitoring solutions using Prometheus, Grafana, and Zabbix;; Work with big data technologies like Spark;; Automate tasks using Python and Bash scripting;; Develop DevOps solutions for Business Intelligence and Data Warehouse systems
Spoken Languages:
English;; German
Skillset:
Linux administration
CI/CD
Kubernetes
Ansible
Terraform
ClickHouse
PostgreSQL
Kafka
Prometheus
Grafana
Zabbix
Spark
Soft Skills:
Teamwork
Problem-solving
Adaptability
Communication
Attention to detail
Qualifications:
Strong Linux administration skills
Experience in automation and CI/CD processes
Hands-on knowledge of Ansible
Proficiency in managing cloud services
Experience with AI-related infrastructure and tools
Years of Experience:
5
Location:
Germany
Job Benefits:
Stable and flexible working environment
Career growth opportunities
Training and professional development events
Health insurance for employees and family members
Teamwork and accountability
Sense of community with a defined company culture
International work environment
Diverse workplace
Gym reimbursement after probation
Modern office located in St Julians, Malta
Working Conditions:
Full Time
Employment Type:
Permanent Contract
Company Culture:
We foster a culture of collaboration, innovation, and accountability, encouraging our employees to grow within a supportive environment. Our international team brings diverse perspectives, contributing to a vibrant workplace where creativity and teamwork thrive.
Opportunities For Advancement:
Professional development programs, Leadership training, Mentorship opportunities
Visa Sponsorship:
Available
]]>Data Analyst
/jobs/data-sciene-and-analytics/data-analyst-80/
Mon, 14 Oct 2024 05:10:02 +0000/wne_live/jobs/jobs-categories/data-analyst-80/Data Analyst
Job Description:
We are seeking a skilled Data Analyst to join our Cyber Identity and Access Management team. The ideal candidate will have a strong background in data analysis, particularly in auditing and identifying gaps within datasets. This role will require proficiency in programming languages such as Python and SQL, along with experience in data wrangling and analysis of outliers. You will be responsible for diving deep into databases, managing data stored in Snowflake and Oracle, and ensuring that the data is clean and accurate for analysis. Strong analytical skills are necessary to communicate effectively with stakeholders and assist in analyzing audit findings. This position is hybrid and based in Plano, TX, with potential for work in NYC, McLean VA, or Richmond VA as well.
IT Languages:
Python
SQL
Spark
As a Data Analyst, you will be tasked with various responsibilities aimed at improving data integrity and supporting audit processes.:
Conduct thorough analysis of data to identify anomalies and gaps;; Utilize Python and SQL for data extraction, transformation, and loading;; Work closely with stakeholders to communicate findings and insights;; Support the team in analyzing audit findings to enhance data management practices;; Ensure the accuracy and cleanliness of data in the central platform
Spoken Languages:
English
Skillset:
Python
SQL
Spark
Data wrangling
Data analysis
Database management
Soft Skills:
Strong communication skills
Attention to detail
Problem-solving abilities
Ability to work collaboratively in a team
Qualifications:
Bachelor’s degree in a relevant field such as Data Science, Computer Science, or Information Technology
Experience with data analysis and auditing, particularly in a corporate environment
Familiarity with Cybersecurity principles is a plus but not mandatory
Years of Experience:
5
Location:
Plano, TX, United States
Job Benefits:
Competitive salary
Flexible working hours
Health insurance
Professional development opportunities
Working Conditions:
Hybrid
Employment Type:
Temporary Contract
Company Culture:
We foster a collaborative and innovative environment, emphasizing continuous learning and development. Our team values open communication and the importance of diverse perspectives in problem-solving.
Opportunities For Advancement:
Potential for full-time employment, Opportunities for career growth within the organization, Access to training and professional development resources
Join our dynamic team as a Senior Software Engineer, where your expertise in machine learning and software development will play a pivotal role in shaping the future of advertising technology. You will be at the forefront of building powerful systems that connect our brands and partners with a vast audience, enabling highly relevant advertising experiences. In this role, you will collaborate closely with data scientists and product teams to translate complex requirements into robust software solutions. Your work will involve designing and implementing large-scale distributed machine learning architectures, performing operations that include feature engineering, model tuning, and deployment, all while ensuring optimal performance monitoring. This is a unique opportunity to leverage cutting-edge AI technologies to impact our business and the broader digital landscape significantly.
IT Languages:
Java
Python
Spark Scala
SQL
As a Senior Software Engineer, you will handle a variety of critical tasks that ensure the successful development and deployment of machine learning solutions.:
Collaborate with data scientists and product teams to understand requirements for prototype and production software development;; Design and build large-scale distributed machine learning architecture on both public and private clouds;; Execute large-scale machine learning operations, including feature engineering, model tuning, and model deployment;; Utilize your knowledge of distributed file systems and database architecture to efficiently manage large datasets;; Develop a streaming platform using the latest streaming technologies to support both research and production needs;; Identify and resolve potential performance bottlenecks and scalability issues in algorithm designs;; Adopt modern development methodologies like Agile and Scrum to enhance project delivery
Spoken Languages:
English;; German;; French
Skillset:
Machine Learning
Big Data Technologies
Hadoop
Hive
Spark
Flink
AWS
AWS SageMaker
CI/CD
DevOps
Soft Skills:
Excellent communication skills
Team collaboration
Adaptability
Creative problem-solving
Qualifications:
M.S. in Computer Science, Engineering, or related field
Proven ability to thrive in a fast-paced, technical environment
Strong analytical and problem-solving skills
Years of Experience:
5
Location:
Ireland
Job Benefits:
Competitive salary
Flexible working hours
Hybrid work environment
Professional development opportunities
Health insurance
Retirement plans
Working Conditions:
Full Time
Employment Type:
Permanent Contract
Company Culture:
We foster an inclusive and collaborative culture where innovation thrives. Our flexible-hybrid work approach allows employees to maintain a healthy work-life balance, and we value diversity and equal opportunities for all team members.
Opportunities For Advancement:
Career growth through mentorship programs, Access to advanced training and certifications, Participation in strategic projects
Visa Sponsorship:
Available
]]>Intern Data Science & AI
/jobs/emerging-technologies-and-specialized-roles/intern-data-science-ai-3/
Thu, 26 Sep 2024 03:20:03 +0000/wne_live/jobs/jobs-categories/intern-data-science-ai-3/Intern Data Science & AI
Job Description:
Join our dynamic team as a Data Science and AI Intern, where you will gain invaluable insights and hands-on experience in the realms of data science and artificial intelligence. This internship offers the perfect opportunity to delve into the core principles essential for a flourishing career as a Data Scientist or Machine Learning Engineer. You will collaborate closely with a project team dedicated to developing machine learning products aimed at addressing real-world business challenges. This role will empower you to create effective machine learning applications utilizing a petabyte-scale data lake, putting into practice methodologies such as Infrastructure as Code, Continuous Delivery, Test Driven Development, and ETL Pipelines. You will also engage in model development and deployment on our cutting-edge AI/ML Cloud Platform. Furthermore, your analytical skills will be honed through data analysis using SQL and Spark on distributed systems, alongside model selection and training with contemporary frameworks like TensorFlow and PyTorch. Emphasis on teamwork and personal growth is paramount; you will receive close mentorship from our seasoned professionals, ensuring you are well-prepared for your future endeavors. Based on your performance, there is a potential pathway to a permanent position following your internship.
IT Languages:
Python
Bash
Java
As an intern, you will engage in various responsibilities aimed at enhancing your skills in data science and AI.:
Participate in the development of machine learning applications;; Contribute to the analysis of large datasets using SQL and Spark;; Assist in the implementation of ETL pipelines and model deployment;; Collaborate with team members on AI-driven projects;; Learn and apply best practices in software development and project management
Spoken Languages:
English;; German
Skillset:
Machine Learning
Data Analysis
SQL
Spark
TensorFlow
PyTorch
Cloud Computing
Soft Skills:
Proactive communication
Team collaboration
Adaptability
Curiosity for new technologies
Qualifications:
Master’s degree in a technical or natural science related field or recent graduate
Experience in programming with Bash, Python, or Java
Familiarity with cloud services (AWS, Azure, or GCP) and machine learning concepts
Years of Experience:
0
Location:
Munich, Bavaria, Germany, EU
Job Benefits:
Open corporate culture with no dress code
Flexible work arrangements in coordination with your manager
Modern workplaces with various campus services including a canteen and coffee bars
Discounted membership at Urban Sports Club
Networking opportunities with professionals across different fields
Working Conditions:
Full Time
Employment Type:
Internship
Company Culture:
We pride ourselves on fostering an inclusive and diverse work environment that encourages creativity and collaboration. Our team values open communication and the free exchange of ideas, creating a dynamic atmosphere where innovation thrives.
Opportunities For Advancement:
Potential full-time employment after internship based on performance, Opportunities to network with other professionals, Access to mentorship and coaching from experienced team members
Visa Sponsorship:
Available
]]>Senior Data Analyst – Customer Analytics
/jobs/data-sciene-and-analytics/senior-data-analyst-customer-analytics/
Fri, 20 Sep 2024 06:30:02 +0000/wne_live/jobs/jobs-categories/senior-data-analyst-customer-analytics/Senior Data Analyst – Customer Analytics
Job Description:
As a Senior Data Analyst within the Customer Analytics team, you will play a pivotal role in shaping data-driven strategies for Zalando's operations across more than twenty countries. Your primary focus will be to extract actionable insights from customer data, which will be crucial for informing our marketing and retail decisions. Leveraging a variety of analytical methods, you will conduct in-depth analyses using diverse data sources, including transactional and onsite data. Your role will involve presenting your findings to senior management, utilizing compelling visualizations and storytelling to convey your messages effectively. You will also be responsible for developing and refining forecasting models that will aid in central planning efforts. By collaborating closely with commercial planning teams, you will help illuminate current and future trends that impact our customer metrics. In addition to your analytical work, you will foster a culture of data-driven decision-making within the team, providing mentorship and guidance to less experienced team members. Your innovative approach will enable you to identify new opportunities for business growth by tapping into new data sources and methodologies.
IT Languages:
SQL
Python
The responsibilities of this role encompass a variety of tasks aimed at leveraging customer data to drive business outcomes.:
Conduct deep dive analyses to derive actionable customer insights.;; Create and present compelling visualizations and stories to senior management.;; Develop and optimize forecasting models for key customer metrics.;; Collaborate with commercial planning teams to understand trends and forecast future performance.;; Mentor junior team members and promote an analytical mindset within the team.
Spoken Languages:
English;; German
Skillset:
Data visualization
Statistical analysis
Time series forecasting techniques
Google Analytics
BigQuery
MicroStrategy
Tableau
Spark
DataBricks
GitHub
Soft Skills:
Strong communication skills
Curiosity and proactivity
Ability to innovate and find pragmatic solutions
Mentorship and leadership skills
Qualifications:
Bachelor’s or Master’s degree in Economics, Social Science, Statistics, Mathematics, Computer Science or a related field
Strong background in statistical analysis and data transformation
Years of Experience:
5
Location:
Europe
Job Benefits:
Employee shares program
40% discount on fashion and beauty products
30% discount on Zalando Lounge
Discounts from external partners
Two paid volunteering days per year
Hybrid working model (60% remote)
Work from abroad for up to 30 working days annually
27 days of vacation per year
Relocation assistance available
Family services including counseling and support
Health and wellbeing options including Gympass
Mental health support and coaching
Working Conditions:
Hybrid
Employment Type:
Permanent Contract
Company Culture:
The company fosters an inclusive and dynamic work environment that prioritizes employee wellbeing, collaboration, and innovation. A strong emphasis is placed on professional development and mentorship, enabling team members to grow and thrive in their roles.
Opportunities For Advancement:
Potential for career growth within the analytics team, Opportunities to lead projects and initiatives, Access to continuous learning and professional development resources
We are in search of a highly skilled and business-focused Data Analytics Expert to support our client's subdomains in becoming data-driven. In this pivotal role, you will primarily engage with the business side, dedicating 80-90% of your time to various subdomains. Your main responsibilities will include conducting Exploratory Data Analysis (EDA) and experimenting with diverse datasets. When stakeholders present inquiries, you will leverage your analytical skills to query the necessary datasets and develop insightful Power BI dashboards that visualize key findings. Another significant aspect of your role will involve enriching metadata, as many datasets lack proper documentation. You will collaborate closely with subject matter experts within the subdomains to enhance the data catalog in Unity Catalog. Additionally, you will undertake some data engineering tasks, such as transforming multiple tables in the Databricks Unity Catalog to create aggregated tables for analysis. You will also be responsible for establishing Databricks Genie Rooms for stakeholders to facilitate collaboration and data sharing.
IT Languages:
SQL
Python
R
The Data Analytics Expert will perform various critical tasks to bridge the gap between data and business insights.:
Conduct exploratory data analysis to identify trends and insights;; Create and maintain Power BI dashboards for data visualization;; Collaborate with business SMEs to document datasets and enhance the data catalog;; Transform datasets within Databricks Unity Catalog for analysis;; Build Databricks Genie Rooms for stakeholder collaboration
Spoken Languages:
English;; Swedish
Skillset:
Databricks
Power BI
Spark
Data analysis
Metadata management
Soft Skills:
Strong communication skills
Natural curiosity
Proactive problem-solving
Team-oriented mindset
Qualifications:
Proficient in Databricks
Experience with Power BI
Familiarity with Spark
Years of Experience:
5
Location:
Europe
Job Benefits:
Occupational pension
Salary change options
Flexpension
Access to benefits portal
Corporate health care
Wellness allowance
Working Conditions:
Full Time
Employment Type:
Permanent Contract
Company Culture:
The work environment emphasizes collaboration, innovation, and a commitment to the well-being of employees. The company values a supportive atmosphere that encourages professional growth and development.
Opportunities For Advancement:
Potential to take on leadership roles, Opportunities for professional development, Exposure to diverse projects
We are in search of a talented and inquisitive Data Analyst who is passionate about transforming business operations through data-driven insights. In this pivotal role, you will primarily immerse yourself within various business subdomains, dedicating a significant portion of your time to collaborating closely with stakeholders. Your main focus will be on conducting Exploratory Data Analysis (EDA) and experimenting with diverse datasets to uncover valuable insights. When business questions arise, you will leverage your analytical skills to query relevant datasets and develop impactful Power BI dashboards that effectively visualize these insights. A crucial aspect of your responsibilities will involve enriching metadata, as many datasets currently lack proper documentation. To address this gap, you will actively engage with subject matter experts within the business subdomains to complete the data catalog in Unity Catalog. Additionally, you will tackle some high-level data engineering tasks, such as transforming multiple tables in the Databricks Unity Catalog to create necessary aggregated tables for deeper analysis. Furthermore, you will be tasked with establishing Databricks Genie Rooms for stakeholders, enhancing their access to data-driven insights.
IT Languages:
SQL
Python
R
As a Data Analyst, you will be responsible for a variety of tasks that bridge data analysis and business strategy.:
Perform Exploratory Data Analysis to uncover trends and insights.;; Create and maintain Power BI dashboards for data visualization.;; Collaborate with business SMEs to enrich metadata and improve data cataloging.;; Transform datasets in Databricks for comprehensive analysis.;; Build Databricks Genie Rooms to facilitate stakeholder access to data.
Spoken Languages:
English;; Swedish
Skillset:
Databricks
Power BI
Spark
Soft Skills:
Strong communication skills
Natural curiosity
Proactive problem-solving
Team-oriented mindset
Qualifications:
Experience with Databricks
Proficiency in Power BI
Familiarity with Spark
Years of Experience:
5
Location:
Europe
Job Benefits:
Occupational pension
Salary change options
Flexpension
Access to wellness allowance
Corporate health care services
Working Conditions:
Full Time
Employment Type:
Permanent Contract
Company Culture:
We foster a supportive and secure environment for our consultants, ensuring they feel valued and part of a community. Our emphasis on well-being and professional growth creates a culture where individuals thrive and are encouraged to influence the future of household appliances.
Opportunities For Advancement:
Professional development programs, Networking opportunities with industry leaders