Spark – Who Needs Engineers https://whoneedsengineers.com/wne_live Software Engineering Recruitment Tue, 22 Oct 2024 16:30:01 +0000 en-US hourly 1 https://wordpress.org/?v=6.6.2 https://whoneedsengineers.com/wne_live/wp-content/uploads/2023/06/cropped-wne_logo-3-32x32.png Spark – Who Needs Engineers https://whoneedsengineers.com/wne_live 32 32 Data Engineer https://whoneedsengineers.com/jobs/data-sciene-and-analytics/data-engineer-28/ Tue, 22 Oct 2024 16:30:01 +0000 https://whoneedsengineers.com/wne_live/jobs/jobs-categories/data-engineer-28/ Data Engineer

Job Description:

    We are seeking a Data Engineer who possesses a unique blend of technical expertise and strong interpersonal skills. This role is pivotal in managing the complete data lifecycle, starting from gathering requirements to deploying robust data solutions. The ideal candidate will have a deep understanding of data engineering principles and methodologies, as well as the ability to effectively communicate with both technical teams and business stakeholders to ensure that the data solutions align with organizational goals. You will be responsible for designing and implementing scalable data architectures, ensuring data quality, and optimizing data processing workflows. Your proficiency in various programming languages and data management tools will be crucial in transforming raw data into actionable insights, thereby driving data-driven decision-making within the company.

IT Languages:

  • SQL
  • Python
  • Java
  • Scala

As a Data Engineer, you will take on various responsibilities that are critical to the success of our data initiatives.:

    Design and develop data models to support analytical needs;; Implement and maintain data pipelines for extracting, transforming, and loading data;; Collaborate with data scientists and analysts to understand data requirements;; Optimize data storage and management strategies for large datasets;; Monitor and troubleshoot data-related issues to ensure smooth operations

Spoken Languages:

  • English;; French

Skillset:

  • AWS
  • Hadoop
  • Spark
  • Kafka
  • SQL-based transformation frameworks
  • Apache NiFi
  • dbt
  • AWS Glue

Soft Skills:

  • Excellent communication skills
  • Strong team collaboration
  • Problem-solving abilities
  • Analytical thinking

Qualifications:

  • Bachelor’s degree in Computer Science, Engineering, or a related field
  • Strong background in data engineering or similar roles
  • Proven experience with cloud services, particularly AWS
  • Familiarity with Agile methodologies and software development lifecycle

Years of Experience:

    4

Location:

    United States

Job Benefits:

  • 100% paid employee medical and dental benefits
  • Paid time off
  • Paid holidays
  • 401(k) with immediately vested company match

Working Conditions:

    Remote

Employment Type:

    Contract

Company Culture:

  • We foster a collaborative environment that values innovation and encourages professional growth. Our team is committed to excellence and believes in leveraging technology to solve complex challenges. We prioritize open communication and support diversity and inclusion within our workplace.

Opportunities For Advancement:

  • Potential for contract renewal, Possibility of transitioning to permanent roles, Opportunities for skill development and training

Visa Sponsorship:

    Not Available
]]>
DevOps Automation Engineer (relocation to Malta) https://whoneedsengineers.com/jobs/devops-cloud-and-it-operations/devops-automation-engineer-relocation-to-malta/ Mon, 21 Oct 2024 17:00:01 +0000 https://whoneedsengineers.com/wne_live/jobs/jobs-categories/devops-automation-engineer-relocation-to-malta/ DevOps Automation Engineer (relocation to Malta)

Job Description:

    Join our dynamic team as a DevOps Automation Engineer, where you will play a pivotal role in enhancing our infrastructure and deployment processes. You will work closely with cross-functional teams to automate our systems and optimize the deployment of our innovative products in the iGaming industry. This position involves maintaining and improving our continuous integration and continuous deployment (CI/CD) pipelines while ensuring the security and performance of our environments. Your expertise in Linux administration and automation tools will be critical in streamlining our operations and supporting our growing infrastructure. You will also be responsible for managing databases and implementing various monitoring solutions to ensure our systems run efficiently.

IT Languages:

  • Python
  • Bash
  • Ansible
  • Terraform

As a DevOps Automation Engineer, your responsibilities will include managing and optimizing CI/CD pipelines, deploying Kubernetes clusters, and automating infrastructure.:

    Manage and optimize CI/CD pipelines using Azure DevOps;; Deploy, administer, and scale Kubernetes clusters;; Develop and maintain Helm charts for Kubernetes applications;; Implement and manage GitOps workflows using Flux;; Design and manage Infrastructure as Code (IaC) using Ansible and Terraform;; Administer systems on Google Cloud Platform;; Support and manage Apache Airflow;; Administer and debug databases, particularly ClickHouse and PostgreSQL;; Manage messaging systems like Kafka;; Implement monitoring solutions using Prometheus, Grafana, and Zabbix;; Work with big data technologies like Spark;; Automate tasks using Python and Bash scripting;; Develop DevOps solutions for Business Intelligence and Data Warehouse systems

Spoken Languages:

  • English;; German

Skillset:

  • Linux administration
  • CI/CD
  • Kubernetes
  • Ansible
  • Terraform
  • ClickHouse
  • PostgreSQL
  • Kafka
  • Prometheus
  • Grafana
  • Zabbix
  • Spark

Soft Skills:

  • Teamwork
  • Problem-solving
  • Adaptability
  • Communication
  • Attention to detail

Qualifications:

  • Strong Linux administration skills
  • Experience in automation and CI/CD processes
  • Hands-on knowledge of Ansible
  • Proficiency in managing cloud services
  • Experience with AI-related infrastructure and tools

Years of Experience:

    5

Location:

    Germany

Job Benefits:

  • Stable and flexible working environment
  • Career growth opportunities
  • Training and professional development events
  • Health insurance for employees and family members
  • Teamwork and accountability
  • Sense of community with a defined company culture
  • International work environment
  • Diverse workplace
  • Gym reimbursement after probation
  • Modern office located in St Julians, Malta

Working Conditions:

    Full Time

Employment Type:

    Permanent Contract

Company Culture:

  • We foster a culture of collaboration, innovation, and accountability, encouraging our employees to grow within a supportive environment. Our international team brings diverse perspectives, contributing to a vibrant workplace where creativity and teamwork thrive.

Opportunities For Advancement:

  • Professional development programs, Leadership training, Mentorship opportunities

Visa Sponsorship:

    Available
]]>
Data Analyst https://whoneedsengineers.com/jobs/data-sciene-and-analytics/data-analyst-80/ Mon, 14 Oct 2024 05:10:02 +0000 https://whoneedsengineers.com/wne_live/jobs/jobs-categories/data-analyst-80/ Data Analyst

Job Description:

    We are seeking a skilled Data Analyst to join our Cyber Identity and Access Management team. The ideal candidate will have a strong background in data analysis, particularly in auditing and identifying gaps within datasets. This role will require proficiency in programming languages such as Python and SQL, along with experience in data wrangling and analysis of outliers. You will be responsible for diving deep into databases, managing data stored in Snowflake and Oracle, and ensuring that the data is clean and accurate for analysis. Strong analytical skills are necessary to communicate effectively with stakeholders and assist in analyzing audit findings. This position is hybrid and based in Plano, TX, with potential for work in NYC, McLean VA, or Richmond VA as well.

IT Languages:

  • Python
  • SQL
  • Spark

As a Data Analyst, you will be tasked with various responsibilities aimed at improving data integrity and supporting audit processes.:

    Conduct thorough analysis of data to identify anomalies and gaps;; Utilize Python and SQL for data extraction, transformation, and loading;; Work closely with stakeholders to communicate findings and insights;; Support the team in analyzing audit findings to enhance data management practices;; Ensure the accuracy and cleanliness of data in the central platform

Spoken Languages:

  • English

Skillset:

  • Python
  • SQL
  • Spark
  • Data wrangling
  • Data analysis
  • Database management

Soft Skills:

  • Strong communication skills
  • Attention to detail
  • Problem-solving abilities
  • Ability to work collaboratively in a team

Qualifications:

  • Bachelor’s degree in a relevant field such as Data Science, Computer Science, or Information Technology
  • Experience with data analysis and auditing, particularly in a corporate environment
  • Familiarity with Cybersecurity principles is a plus but not mandatory

Years of Experience:

    5

Location:

    Plano, TX, United States

Job Benefits:

  • Competitive salary
  • Flexible working hours
  • Health insurance
  • Professional development opportunities

Working Conditions:

    Hybrid

Employment Type:

    Temporary Contract

Company Culture:

  • We foster a collaborative and innovative environment, emphasizing continuous learning and development. Our team values open communication and the importance of diverse perspectives in problem-solving.

Opportunities For Advancement:

  • Potential for full-time employment, Opportunities for career growth within the organization, Access to training and professional development resources

Visa Sponsorship:

    Not Available
]]>
Senior Software Engineer https://whoneedsengineers.com/jobs/devops-cloud-and-it-operations/senior-software-engineer-9/ Tue, 01 Oct 2024 15:00:02 +0000 https://whoneedsengineers.com/wne_live/jobs/jobs-categories/senior-software-engineer-9/ Senior Software Engineer

Job Description:

    Join our dynamic team as a Senior Software Engineer, where your expertise in machine learning and software development will play a pivotal role in shaping the future of advertising technology. You will be at the forefront of building powerful systems that connect our brands and partners with a vast audience, enabling highly relevant advertising experiences. In this role, you will collaborate closely with data scientists and product teams to translate complex requirements into robust software solutions. Your work will involve designing and implementing large-scale distributed machine learning architectures, performing operations that include feature engineering, model tuning, and deployment, all while ensuring optimal performance monitoring. This is a unique opportunity to leverage cutting-edge AI technologies to impact our business and the broader digital landscape significantly.

IT Languages:

  • Java
  • Python
  • Spark Scala
  • SQL

As a Senior Software Engineer, you will handle a variety of critical tasks that ensure the successful development and deployment of machine learning solutions.:

    Collaborate with data scientists and product teams to understand requirements for prototype and production software development;; Design and build large-scale distributed machine learning architecture on both public and private clouds;; Execute large-scale machine learning operations, including feature engineering, model tuning, and model deployment;; Utilize your knowledge of distributed file systems and database architecture to efficiently manage large datasets;; Develop a streaming platform using the latest streaming technologies to support both research and production needs;; Identify and resolve potential performance bottlenecks and scalability issues in algorithm designs;; Adopt modern development methodologies like Agile and Scrum to enhance project delivery

Spoken Languages:

  • English;; German;; French

Skillset:

  • Machine Learning
  • Big Data Technologies
  • Hadoop
  • Hive
  • Spark
  • Flink
  • AWS
  • AWS SageMaker
  • CI/CD
  • DevOps

Soft Skills:

  • Excellent communication skills
  • Team collaboration
  • Adaptability
  • Creative problem-solving

Qualifications:

  • M.S. in Computer Science, Engineering, or related field
  • Proven ability to thrive in a fast-paced, technical environment
  • Strong analytical and problem-solving skills

Years of Experience:

    5

Location:

    Ireland

Job Benefits:

  • Competitive salary
  • Flexible working hours
  • Hybrid work environment
  • Professional development opportunities
  • Health insurance
  • Retirement plans

Working Conditions:

    Full Time

Employment Type:

    Permanent Contract

Company Culture:

  • We foster an inclusive and collaborative culture where innovation thrives. Our flexible-hybrid work approach allows employees to maintain a healthy work-life balance, and we value diversity and equal opportunities for all team members.

Opportunities For Advancement:

  • Career growth through mentorship programs, Access to advanced training and certifications, Participation in strategic projects

Visa Sponsorship:

    Available
]]>
Intern Data Science & AI https://whoneedsengineers.com/jobs/emerging-technologies-and-specialized-roles/intern-data-science-ai-3/ Thu, 26 Sep 2024 03:20:03 +0000 https://whoneedsengineers.com/wne_live/jobs/jobs-categories/intern-data-science-ai-3/ Intern Data Science & AI

Job Description:

    Join our dynamic team as a Data Science and AI Intern, where you will gain invaluable insights and hands-on experience in the realms of data science and artificial intelligence. This internship offers the perfect opportunity to delve into the core principles essential for a flourishing career as a Data Scientist or Machine Learning Engineer. You will collaborate closely with a project team dedicated to developing machine learning products aimed at addressing real-world business challenges. This role will empower you to create effective machine learning applications utilizing a petabyte-scale data lake, putting into practice methodologies such as Infrastructure as Code, Continuous Delivery, Test Driven Development, and ETL Pipelines. You will also engage in model development and deployment on our cutting-edge AI/ML Cloud Platform. Furthermore, your analytical skills will be honed through data analysis using SQL and Spark on distributed systems, alongside model selection and training with contemporary frameworks like TensorFlow and PyTorch. Emphasis on teamwork and personal growth is paramount; you will receive close mentorship from our seasoned professionals, ensuring you are well-prepared for your future endeavors. Based on your performance, there is a potential pathway to a permanent position following your internship.

IT Languages:

  • Python
  • Bash
  • Java

As an intern, you will engage in various responsibilities aimed at enhancing your skills in data science and AI.:

    Participate in the development of machine learning applications;; Contribute to the analysis of large datasets using SQL and Spark;; Assist in the implementation of ETL pipelines and model deployment;; Collaborate with team members on AI-driven projects;; Learn and apply best practices in software development and project management

Spoken Languages:

  • English;; German

Skillset:

  • Machine Learning
  • Data Analysis
  • SQL
  • Spark
  • TensorFlow
  • PyTorch
  • Cloud Computing

Soft Skills:

  • Proactive communication
  • Team collaboration
  • Adaptability
  • Curiosity for new technologies

Qualifications:

  • Master’s degree in a technical or natural science related field or recent graduate
  • Experience in programming with Bash, Python, or Java
  • Familiarity with cloud services (AWS, Azure, or GCP) and machine learning concepts

Years of Experience:

    0

Location:

    Munich, Bavaria, Germany, EU

Job Benefits:

  • Open corporate culture with no dress code
  • Flexible work arrangements in coordination with your manager
  • Modern workplaces with various campus services including a canteen and coffee bars
  • Discounted membership at Urban Sports Club
  • Networking opportunities with professionals across different fields

Working Conditions:

    Full Time

Employment Type:

    Internship

Company Culture:

  • We pride ourselves on fostering an inclusive and diverse work environment that encourages creativity and collaboration. Our team values open communication and the free exchange of ideas, creating a dynamic atmosphere where innovation thrives.

Opportunities For Advancement:

  • Potential full-time employment after internship based on performance, Opportunities to network with other professionals, Access to mentorship and coaching from experienced team members

Visa Sponsorship:

    Available
]]>
Senior Data Analyst – Customer Analytics https://whoneedsengineers.com/jobs/data-sciene-and-analytics/senior-data-analyst-customer-analytics/ Fri, 20 Sep 2024 06:30:02 +0000 https://whoneedsengineers.com/wne_live/jobs/jobs-categories/senior-data-analyst-customer-analytics/ Senior Data Analyst – Customer Analytics

Job Description:

    As a Senior Data Analyst within the Customer Analytics team, you will play a pivotal role in shaping data-driven strategies for Zalando's operations across more than twenty countries. Your primary focus will be to extract actionable insights from customer data, which will be crucial for informing our marketing and retail decisions. Leveraging a variety of analytical methods, you will conduct in-depth analyses using diverse data sources, including transactional and onsite data. Your role will involve presenting your findings to senior management, utilizing compelling visualizations and storytelling to convey your messages effectively. You will also be responsible for developing and refining forecasting models that will aid in central planning efforts. By collaborating closely with commercial planning teams, you will help illuminate current and future trends that impact our customer metrics. In addition to your analytical work, you will foster a culture of data-driven decision-making within the team, providing mentorship and guidance to less experienced team members. Your innovative approach will enable you to identify new opportunities for business growth by tapping into new data sources and methodologies.

IT Languages:

  • SQL
  • Python

The responsibilities of this role encompass a variety of tasks aimed at leveraging customer data to drive business outcomes.:

    Conduct deep dive analyses to derive actionable customer insights.;; Create and present compelling visualizations and stories to senior management.;; Develop and optimize forecasting models for key customer metrics.;; Collaborate with commercial planning teams to understand trends and forecast future performance.;; Mentor junior team members and promote an analytical mindset within the team.

Spoken Languages:

  • English;; German

Skillset:

  • Data visualization
  • Statistical analysis
  • Time series forecasting techniques
  • Google Analytics
  • BigQuery
  • MicroStrategy
  • Tableau
  • Spark
  • DataBricks
  • GitHub

Soft Skills:

  • Strong communication skills
  • Curiosity and proactivity
  • Ability to innovate and find pragmatic solutions
  • Mentorship and leadership skills

Qualifications:

  • Bachelor’s or Master’s degree in Economics, Social Science, Statistics, Mathematics, Computer Science or a related field
  • Strong background in statistical analysis and data transformation

Years of Experience:

    5

Location:

    Europe

Job Benefits:

  • Employee shares program
  • 40% discount on fashion and beauty products
  • 30% discount on Zalando Lounge
  • Discounts from external partners
  • Two paid volunteering days per year
  • Hybrid working model (60% remote)
  • Work from abroad for up to 30 working days annually
  • 27 days of vacation per year
  • Relocation assistance available
  • Family services including counseling and support
  • Health and wellbeing options including Gympass
  • Mental health support and coaching

Working Conditions:

    Hybrid

Employment Type:

    Permanent Contract

Company Culture:

  • The company fosters an inclusive and dynamic work environment that prioritizes employee wellbeing, collaboration, and innovation. A strong emphasis is placed on professional development and mentorship, enabling team members to grow and thrive in their roles.

Opportunities For Advancement:

  • Potential for career growth within the analytics team, Opportunities to lead projects and initiatives, Access to continuous learning and professional development resources

Visa Sponsorship:

    Available
]]>
Data Analytics Expert https://whoneedsengineers.com/jobs/data-sciene-and-analytics/data-analytics-expert/ Tue, 17 Sep 2024 10:30:02 +0000 https://whoneedsengineers.com/wne_live/jobs/jobs-categories/data-analytics-expert/ Data Analytics Expert

Job Description:

    We are in search of a highly skilled and business-focused Data Analytics Expert to support our client's subdomains in becoming data-driven. In this pivotal role, you will primarily engage with the business side, dedicating 80-90% of your time to various subdomains. Your main responsibilities will include conducting Exploratory Data Analysis (EDA) and experimenting with diverse datasets. When stakeholders present inquiries, you will leverage your analytical skills to query the necessary datasets and develop insightful Power BI dashboards that visualize key findings. Another significant aspect of your role will involve enriching metadata, as many datasets lack proper documentation. You will collaborate closely with subject matter experts within the subdomains to enhance the data catalog in Unity Catalog. Additionally, you will undertake some data engineering tasks, such as transforming multiple tables in the Databricks Unity Catalog to create aggregated tables for analysis. You will also be responsible for establishing Databricks Genie Rooms for stakeholders to facilitate collaboration and data sharing.

IT Languages:

  • SQL
  • Python
  • R

The Data Analytics Expert will perform various critical tasks to bridge the gap between data and business insights.:

    Conduct exploratory data analysis to identify trends and insights;; Create and maintain Power BI dashboards for data visualization;; Collaborate with business SMEs to document datasets and enhance the data catalog;; Transform datasets within Databricks Unity Catalog for analysis;; Build Databricks Genie Rooms for stakeholder collaboration

Spoken Languages:

  • English;; Swedish

Skillset:

  • Databricks
  • Power BI
  • Spark
  • Data analysis
  • Metadata management

Soft Skills:

  • Strong communication skills
  • Natural curiosity
  • Proactive problem-solving
  • Team-oriented mindset

Qualifications:

  • Proficient in Databricks
  • Experience with Power BI
  • Familiarity with Spark

Years of Experience:

    5

Location:

    Europe

Job Benefits:

  • Occupational pension
  • Salary change options
  • Flexpension
  • Access to benefits portal
  • Corporate health care
  • Wellness allowance

Working Conditions:

    Full Time

Employment Type:

    Permanent Contract

Company Culture:

  • The work environment emphasizes collaboration, innovation, and a commitment to the well-being of employees. The company values a supportive atmosphere that encourages professional growth and development.

Opportunities For Advancement:

  • Potential to take on leadership roles, Opportunities for professional development, Exposure to diverse projects

Visa Sponsorship:

    Available
]]>
Data Analyst https://whoneedsengineers.com/jobs/data-sciene-and-analytics/data-analyst-14/ Sun, 15 Sep 2024 16:30:02 +0000 https://whoneedsengineers.com/wne_live/jobs/jobs-categories/data-analyst-14/ Data Analyst

Job Description:

    We are in search of a talented and inquisitive Data Analyst who is passionate about transforming business operations through data-driven insights. In this pivotal role, you will primarily immerse yourself within various business subdomains, dedicating a significant portion of your time to collaborating closely with stakeholders. Your main focus will be on conducting Exploratory Data Analysis (EDA) and experimenting with diverse datasets to uncover valuable insights. When business questions arise, you will leverage your analytical skills to query relevant datasets and develop impactful Power BI dashboards that effectively visualize these insights. A crucial aspect of your responsibilities will involve enriching metadata, as many datasets currently lack proper documentation. To address this gap, you will actively engage with subject matter experts within the business subdomains to complete the data catalog in Unity Catalog. Additionally, you will tackle some high-level data engineering tasks, such as transforming multiple tables in the Databricks Unity Catalog to create necessary aggregated tables for deeper analysis. Furthermore, you will be tasked with establishing Databricks Genie Rooms for stakeholders, enhancing their access to data-driven insights.

IT Languages:

  • SQL
  • Python
  • R

As a Data Analyst, you will be responsible for a variety of tasks that bridge data analysis and business strategy.:

    Perform Exploratory Data Analysis to uncover trends and insights.;; Create and maintain Power BI dashboards for data visualization.;; Collaborate with business SMEs to enrich metadata and improve data cataloging.;; Transform datasets in Databricks for comprehensive analysis.;; Build Databricks Genie Rooms to facilitate stakeholder access to data.

Spoken Languages:

  • English;; Swedish

Skillset:

  • Databricks
  • Power BI
  • Spark

Soft Skills:

  • Strong communication skills
  • Natural curiosity
  • Proactive problem-solving
  • Team-oriented mindset

Qualifications:

  • Experience with Databricks
  • Proficiency in Power BI
  • Familiarity with Spark

Years of Experience:

    5

Location:

    Europe

Job Benefits:

  • Occupational pension
  • Salary change options
  • Flexpension
  • Access to wellness allowance
  • Corporate health care services

Working Conditions:

    Full Time

Employment Type:

    Permanent Contract

Company Culture:

  • We foster a supportive and secure environment for our consultants, ensuring they feel valued and part of a community. Our emphasis on well-being and professional growth creates a culture where individuals thrive and are encouraged to influence the future of household appliances.

Opportunities For Advancement:

  • Professional development programs, Networking opportunities with industry leaders

Visa Sponsorship:

    Available
]]>