Apache Spark – Who Needs Engineers https://whoneedsengineers.com/wne_live Software Engineering Recruitment Tue, 24 Sep 2024 04:30:02 +0000 en-US hourly 1 https://wordpress.org/?v=6.6.2 https://whoneedsengineers.com/wne_live/wp-content/uploads/2023/06/cropped-wne_logo-3-32x32.png Apache Spark – Who Needs Engineers https://whoneedsengineers.com/wne_live 32 32 Data Engineer AWS https://whoneedsengineers.com/jobs/devops-cloud-and-it-operations/data-engineer-aws/ Tue, 24 Sep 2024 04:30:02 +0000 https://whoneedsengineers.com/wne_live/jobs/jobs-categories/data-engineer-aws/ Data Engineer AWS

Job Description:

    We are seeking a skilled Data Engineer with expertise in AWS to join our dynamic team. The ideal candidate will be responsible for designing, implementing, and maintaining data pipelines and architectures that facilitate the collection and analysis of large sets of data. You will work closely with data scientists and analysts to ensure our data infrastructure meets the needs of the business, enabling data-driven decision-making. The role requires a deep understanding of data modeling, ETL processes, and cloud technologies, particularly within the AWS ecosystem. You will be instrumental in optimizing our data flows and ensuring data quality and accessibility across various platforms. The position offers a unique opportunity to work on innovative projects that drive business growth and improve operational efficiency.

IT Languages:

  • Python
  • SQL
  • Java
  • Scala

As a Data Engineer, you will be tasked with a variety of responsibilities, including::

    Designing and building robust data pipelines to support data ingestion and processing.;; Collaborating with cross-functional teams to gather requirements and deliver data solutions.;; Implementing data quality checks and monitoring processes to ensure data integrity.;; Optimizing existing data systems and databases for performance and efficiency.;; Documenting data workflows and maintaining data dictionaries for clarity and compliance.

Spoken Languages:

  • English;; Swedish

Skillset:

  • AWS
  • ETL
  • Data Warehousing
  • Data Modeling
  • Apache Spark

Soft Skills:

  • Analytical thinking
  • Problem-solving
  • Team collaboration
  • Effective communication
  • Adaptability

Qualifications:

  • Bachelor’s degree in Computer Science, Information Technology, or a related field.
  • Proven experience as a Data Engineer or in a similar role.
  • Strong understanding of database systems, data warehousing, and data modeling.

Years of Experience:

    5

Location:

    Malmo, Skåne County, Sweden, EU

Job Benefits:

  • Competitive salary
  • Flexible working hours
  • Health insurance
  • Professional development opportunities
  • Remote work options

Working Conditions:

    Full Time

Employment Type:

    Permanent Contract

Company Culture:

  • Our company fosters a collaborative and inclusive work environment that encourages innovation and growth. We value diversity and believe that different perspectives contribute to our overall success. Our team is committed to continuous learning and professional development, and we support our employees in achieving their career goals.

Opportunities For Advancement:

  • Leadership training programs, Mentorship opportunities, Pathways to senior engineering roles

Visa Sponsorship:

    Available
]]>
Data Scientist https://whoneedsengineers.com/jobs/emerging-technologies-and-specialized-roles/data-scientist-8/ Mon, 23 Sep 2024 10:00:03 +0000 https://whoneedsengineers.com/wne_live/jobs/jobs-categories/data-scientist-8/ Data Scientist

Job Description:

    We are seeking a full-time Data Scientist to join our IT & Digital division within the IT Cluster for Sports, located in Frankfurt am Main. This role is crucial in shaping modern IT structures and digital solutions for both professional and amateur football in Germany. You will work collaboratively with national teams, clubs, referees, and educational participants to design and implement data-driven products that enhance decision-making and automate processes. Your contributions will play a vital role in advancing German football towards the next World Cup, making this a unique opportunity to impact the sport significantly. If you are passionate about football, possess an open mindset, and are eager to grow personally and professionally, we want to hear from you!

IT Languages:

  • Python
  • R

As a Data Scientist, you will be instrumental in developing and managing metrics and algorithms that support the decision-making processes of various experts in German professional and youth football.:

    Create, implement, and automate data analyses and models using football-related data for expert use, especially for coaches and analysts.;; Develop new machine learning algorithms and models to optimize performance in both professional and youth football.;; Design metrics for monitoring performance structures in German elite and youth football.;; Develop applications such as reports and dashboards for national teams and other expert departments.

Spoken Languages:

  • German;; English

Skillset:

  • Machine Learning
  • Data Analysis
  • Cloud Computing
  • Apache Spark
  • Infrastructure as Code

Soft Skills:

  • Proactive team player
  • Strong organizational skills
  • Analytical thinking
  • Ability to communicate complex data effectively
  • High degree of initiative

Qualifications:

  • Master’s degree in Mathematics, Computer Science, Statistics, Physics or related fields (PhD preferred)
  • Practical experience in Data Science and Machine Learning

Years of Experience:

    5

Location:

    Frankfurt am Main, Hesse, Germany, EU

Job Benefits:

  • Diverse and dynamic work environment
  • Flexible working hours
  • Opportunity for mobile work
  • Access to modern sports facilities
  • Free beverages and subsidized lunches
  • Free parking
  • Various discounts with partner organizations

Working Conditions:

    Full Time

Employment Type:

    Permanent Contract

Company Culture:

  • Our work culture is characterized by respect, openness, passion, and teamwork. We value collaboration and creativity, making it a fun and engaging place to work.

Opportunities For Advancement:

  • Continuous professional development, Networking opportunities within the football community, Potential for leadership roles in future projects

Visa Sponsorship:

    Available
]]>