1.692 Jobs für Data Scientists in Deutschland

Big Data Engineer

Positium

Vor 8 Tagen gepostet

Job angesehen

Tippen Sie erneut, um zu schließen

Arbeitsbeschreibung

employee

Positium produces impactful statistics that are effective and easy to use for decision-makers around the world. We believe that through better-informed decisions we can do our bit to improve societies around the world.

As Big Data Engineer at Positium, you will be at the forefront of designing and optimising robust data pipelines that process vast datasets from mobile positioning data sources. You will work with cutting-edge big data technologies, contribute to the architecture of scalable cloud-based systems, and streamline data integration processes. Join our expert team in developing efficient, high-performing solutions that drive meaningful insights for our global clients.

Tasks
  • Design, build, and optimise data pipelines using big data technologies to efficiently process and integrate large datasets from mobile positioning data sources.
  • Collaborate in the design and implementation of relational database schemas and ensure effective data storage and retrieval practices.
  • Deploy and manage data solutions on major cloud platforms to enhance scalability and accessibility of data resources.
  • Use command-line tools and shell scripting (e.g., bash, Python) to automate data processing tasks and improve operational efficiency.
  • Stay up-to-date with the latest advancements in data engineering and big data technologies and be ready to share knowledge with colleagues.
Requirements
  • BSc/MSc in Computer Science or MSc in Data Science.
  • At least two years of work experience as a Data Engineer or similar.
  • Proficiency in programming : working proficiency in Python and SQL. Familiarity with JavaScript for data visualisation is also beneficial.
  • Databases : working experience with relational databases (preferably PostgreSQL) and familiarity with designing data models.
  • Big data technologies and engineering : experience with Apache Spark for large-scale data processing, familiarity with Hadoop ecosystem and distributed storage solutions (e.g. S3, Azure Blob Storage, MinIO). Experience in designing, building, and managing data pipelines. Experience in working with APIs for data sourcing, integration and delivery.
  • Cloud platforms : familiarity with major cloud providers and services (AWS, Azure, Google Cloud); work experience with at least one of them is a plus.
  • Unix/Linux systems : proficient with Unix/Linux command-line tools and shell scripting (e.g. bash). Experience with system administration and automation tasks.
  • Containerisation and orchestration : experience with Docker; experience with Kubernetes is a plus.
  • Software development practices : familiarity with object-oriented programming (OOP), design patterns, clean code practices, and testing frameworks (e.g., pytest, unittest). Experience using Git for version control and collaboration on platforms like GitHub and GitLab, including code reviews and refactoring.
  • Agile methodologies : understanding of software development life cycles and agile methodologies.
  • Being a team player with great communication skills.
  • Good speaking and writing skills in English .
  • We expect the candidate to be located in Estonia and have a right to work here .

Additional experience that would be beneficial:

  • Geospatial database experience: proficiency with spatial extensions for relational databases (e.g. PostGIS, Oracle Spatial, DuckDB Spatial).
  • Python geospatial libraries: familiarity with Python libraries for geospatial analysis, such as GeoPandas and Shapely.
  • Geospatial data formats: experience handling various geospatial data formats, including GeoParquet, GeoJSON, Shapefiles, and raster data formats.
  • Big geospatial data frameworks: familiarity with Apache Sedona.
  • Understanding of geospatial concepts: knowledge of spatial reference systems, coordinate transformations, and familiarity with spatial analysis and GIS theory.
Benefits
  • Working in our HQ in Tartu with an amazing view of the city (working from home is also a possibility, depending on the nature of the projects).
  • Flexible working hours – just make sure you are available to other team members and complete your tasks on time.
  • Global reach – you get to be part of different client projects across the globe and a chance to travel.
  • Support for your active life. Your wellbeing is important to us – we provide compensation for sporting activities and taking care of your mental health so that you can feel your best every day.
  • Fun team – we enjoy each other’s company and organise regular social activities.

Positium is the only data analytics company in the world specialising in mobile positioning data for official statistics. Founded in 2003, we have nearly two decades of experience working with global clients and scientists alike. Positium develops cool GIS solutions, high-quality methodology, software and expertise to process MPD for insights on the spatio-temporal behaviour of human beings. At Positium you will be a part of a close group of industry experts who are determined to make a positive impact on the world.

If you share our passion, we invite you to apply to join Positium’s data-driven mission!

Leider ist dieser Job in Ihrer Region nicht verfügbar

Wissenschaftlicher Mitarbeiter Big Data Analyse

04103 Leipzig, Sachsen WhatJobs

Vor 6 Tagen gepostet

Job angesehen

Tippen Sie erneut, um zu schließen

Arbeitsbeschreibung

full-time
Unser Kunde in **Leipzig** sucht einen motivierten Wissenschaftlichen Mitarbeiter für den Bereich Big Data Analyse zur Verstärkung seines Forschungs- und Entwicklungsteams. In dieser Rolle sind Sie maßgeblich an der Erhebung, Verarbeitung und Analyse großer Datenmengen beteiligt, um komplexe wissenschaftliche Fragestellungen zu beantworten und neue Erkenntnisse zu gewinnen. Sie entwickeln und implementieren fortschrittliche Analysemethoden und Algorithmen unter Verwendung von Big Data-Technologien und Machine Learning. Die Erstellung von Visualisierungen und Berichten zur Darstellung von Analyseergebnissen für interne und externe Stakeholder gehört ebenso zu Ihren Aufgaben wie die Mitwirkung an der Konzeption und Durchführung von Forschungsprojekten. Sie arbeiten eng mit interdisziplinären Teams zusammen, um die Datenanalyse an den aktuellen Forschungsbedarf anzupassen und innovative Lösungen zu entwickeln. Die Identifizierung von Trends und Mustern in komplexen Datensätzen sowie deren Interpretation zur Ableitung von Handlungsempfehlungen sind Kern Ihrer Tätigkeit. Sie sind verantwortlich für die Qualitätssicherung und Validierung der verarbeiteten Daten und Analysemodelle. Die Dokumentation von Analysemethoden und Code ist unerlässlich für die Reproduzierbarkeit von Forschungsergebnissen. Sie bringen Ihre Expertise aktiv in die Weiterentwicklung unserer Dateninfrastruktur und Analysepraktiken ein.

Anforderungen:
  • Abgeschlossenes Masterstudium oder Promotion in Informatik, Statistik, Physik, Mathematik oder einem verwandten quantitativen Fachgebiet.
  • Nachweisbare Erfahrung in der Big Data Analyse, Datenmodellierung und im Umgang mit großen Datensätzen.
  • Sehr gute Kenntnisse in Programmiersprachen wie Python oder R und relevanter Bibliotheken (Pandas, NumPy, Scikit-learn etc.).
  • Erfahrung mit Big Data-Technologien wie Spark, Hadoop oder ähnlichen Frameworks.
  • Fundierte Kenntnisse in Machine Learning Algorithmen und deren Anwendung.
  • Erfahrung in der Datenvisualisierung (z.B. mit Matplotlib, Seaborn, Tableau).
  • Starke analytische Fähigkeiten und die Fähigkeit, komplexe Probleme zu lösen.
  • Gute Deutsch- und Englischkenntnisse in Wort und Schrift.
  • Fähigkeit zur eigenständigen Arbeit sowie zur effektiven Zusammenarbeit in einem Team.
  • Interesse an aktuellen Forschungsthemen und der Bereitschaft, sich kontinuierlich weiterzubilden.

Wir bieten eine herausfordernde wissenschaftliche Tätigkeit in einem dynamischen Forschungsumfeld im Herzen von **Leipzig**. Profitieren Sie von flexiblen Arbeitszeiten und einer hybriden Arbeitsweise, die eine gute Work-Life-Balance ermöglicht.
Leider ist dieser Job in Ihrer Region nicht verfügbar

Consultant Big Data F/H

75008 €55000 - €75000 year OLCYA

Vor 11 Tagen gepostet

Job angesehen

Tippen Sie erneut, um zu schließen

Arbeitsbeschreibung

employee

Olcya est un cabinet de niche spécialisé dans l'Hyper automatisation, soit l'agrégation des offres suivantes : Big Data, Cloud, DevOps, IA & RPA, APM et Agilité .

lusieurs clients grands compte nous font déjà confiance (BNPP, SG, Total, Crédit Agricole ).

Cela fait 7 ans que nous existons et beaucoup de nos consultants nous accompagnent depuis le début de l'aventure pour notre plus grande fierté !

Venir chez Olcya ne se fait pas par hasard car en plus d'une mission challengeante, vous y trouverez des responsabilités et la possibilité de devenir référent sur votre domaine d'intervention (sans compter les afterworks et un suivi de qualité).

Vos missions

Au sein d une équipe mature sur les sujets liés au Big Data, vous allez, avec d autres Olcyiens (Projet avec du BUILD et du RUN) :

  • Administrer et monitorer les outils Big Data.
  • Participer à l automatisation de l'infrastructure Bigdata (basée sur le logiciel de l éditeur Cloudera CDP 7.1) s appuyant sur TERRAFORM et ANSIBLE.
  • Ajouter des extensions automatisées des clusters Bigdata (avec l ajout de nouveaux datanodes).
  • Ajouter de nouvelles fonctionnalités automatisées (Hbase, Encryption).
  • Assurer le maintien opérationnel du système (sécurisation des clusters, la mise en place d environnements de développement et de test, au support et à la résolution des problèmes N2 et N3).
Vos compétences

Stack technique :

Installation et configuration des différents composants : Zookeeper, HDFS, Spark, Hive, Kerberos, Sentry, Anaconda, Hue, Kafka, Pyspark, Hortonworks, Cloudera Data Platform (CDP/HDP).

Langage de programmation : Python, Scala.

Système : Linux, Windows.

Monitoring des clusters avec Ambari, Cloudera manager, MCS

Administration des clusters : droits d accès, Policy Ranger, création d environnements

Configuration et mise en place de la chaine CI/CD est un plus : Ansible, Jenkins, Docker, Terraform, Nexus

Avantages

Forfait télétravail, excellente mutuelle (prise en charge à 80% par l’employeur), CSE, formations au sein de l’Olcya academy…

Leider ist dieser Job in Ihrer Region nicht verfügbar

KI-Systemarchitekt für Big Data Analytik

50667 Köln, Nordrhein Westfalen WhatJobs

Heute

Job angesehen

Tippen Sie erneut, um zu schließen

Arbeitsbeschreibung

full-time
Unser Auftraggeber, ein Innovationsführer im Bereich KI und aufstrebende Technologien, sucht einen erfahrenen KI-Systemarchitekten für Big Data Analytik zur Verstärkung seines Teams. Die Stelle ist als vollständig remote ausgeschrieben. Sie werden für das Design und die Implementierung skalierbarer und robuster KI-gestützter Big Data-Lösungen verantwortlich sein. Dies beinhaltet die Auswahl geeigneter Technologien, die Definition von Datenpipelines und die Gewährleistung der Datenqualität und -sicherheit. Sie arbeiten an der Schnittstelle von Datenwissenschaft, Ingenieurwesen und Geschäftsstrategie, um datengesteuerte Entscheidungen zu ermöglichen. Zu Ihren Kernaufgaben gehören die Konzeption von Architekturen für maschinelles Lernen, die Integration von Echtzeit-Datenströmen sowie die Optimierung von Algorithmen für die Verarbeitung großer Datenmengen. Sie werden eng mit Data Scientists und Softwareentwicklern zusammenarbeiten, um KI-Modelle in Produktionsumgebungen zu deployen und zu warten. Die Durchführung von Machbarkeitsstudien, die Bewertung neuer Technologien und die Erstellung technischer Dokumentationen sind ebenfalls Teil Ihres Aufgabengebiets. Wir erwarten fundierte Kenntnisse in Big-Data-Technologien wie Hadoop oder Spark, Erfahrung mit Cloud-Plattformen (AWS, Azure, GCP) und ein tiefes Verständnis von KI/ML-Konzepten. Programmierkenntnisse in Python oder Java sowie Erfahrung mit Datenbanken (SQL, NoSQL) sind unerlässlich. Sie sollten ein starkes analytisches Denkvermögen und die Fähigkeit besitzen, komplexe Systeme zu entwerfen und zu managen. Die Bereitschaft, sich kontinuierlich über neue Entwicklungen im KI-Bereich auf dem Laufenden zu halten, ist entscheidend für diesen zukunftsorientierten Job.
Leider ist dieser Job in Ihrer Region nicht verfügbar

Senior Big Data Engineer (AI Enthusiast)

Berlin, Berlin Stepstone GmbH

Vor 3 Tagen gepostet

Job angesehen

Tippen Sie erneut, um zu schließen

Arbeitsbeschreibung

At The Stepstone Group, we have a simple yet very important mission: The right job for everyone. Using our data, platform, and technology, we create opportunities for job seekers and companies around the world to find a perfect match, in a fair and equitable way. With over 20 brands across 30+ countries, we strive for fair and unbiased hiring, and we are particularly focused on building a diverse, inclusive workforce.

At our Tech Hub, located near Wilanowska Metro, we are over 300 passionate and driven specialists who work on the development of our IT products. We are proud to be part of The Stepstone Group, a global leader in job-tech platforms and e-recruiting.

Join our team of 4,000+ employees and help us reshape the labour market. Together, we will create a future where everyone—regardless of background—has equal opportunities in the job market.

bit.ly/3NGPzQQ
Leider ist dieser Job in Ihrer Region nicht verfügbar

Senior Big Data Engineer (AI Enthusiast)

Düsseldorf, Nordrhein Westfalen Stepstone GmbH

Vor 3 Tagen gepostet

Job angesehen

Tippen Sie erneut, um zu schließen

Arbeitsbeschreibung

At The Stepstone Group, we have a simple yet very important mission: The right job for everyone. Using our data, platform, and technology, we create opportunities for job seekers and companies around the world to find a perfect match, in a fair and equitable way. With over 20 brands across 30+ countries, we strive for fair and unbiased hiring, and we are particularly focused on building a diverse, inclusive workforce.

At our Tech Hub, located near Wilanowska Metro, we are over 300 passionate and driven specialists who work on the development of our IT products. We are proud to be part of The Stepstone Group, a global leader in job-tech platforms and e-recruiting.

Join our team of 4,000+ employees and help us reshape the labour market. Together, we will create a future where everyone—regardless of background—has equal opportunities in the job market.

bit.ly/3NGPzQQ
Leider ist dieser Job in Ihrer Region nicht verfügbar

Senior Big Data Engineer (AI Enthusiast)

Confidential

Heute

Job angesehen

Tippen Sie erneut, um zu schließen

Arbeitsbeschreibung

At The Stepstone Group, we have a simple yet very important mission: The right job for everyone. Using our data, platform, and technology, we create opportunities for job seekers and companies around the world to find a perfect match, in a fair and equitable way. With over 20 brands across 30+ countries, we strive for fair and unbiased hiring, and we are particularly focused on building a diverse, inclusive workforce.

At our Tech Hub, located near Wilanowska Metro, we are over 300 passionate and driven specialists who work on the development of our IT products. We are proud to be part of The Stepstone Group, a global leader in job-tech platforms and e-recruiting.

Join our team of 4,000+ employees and help us reshape the labour market. Together, we will create a future where everyone—regardless of background—has equal opportunities in the job market.


As a Senior Big Data Engineer and AI Enthusiast, you will join the Marketplace Enablement department, working inside a cross-functional team to design and implement cutting-edge, high-performance central streaming data products that power our recruitment AI applications, including deploying advanced machine learning models.

Your expertise will help create a more inclusive and efficient recruitment experience globally, directly supporting our mission to reshape the labour market for everyone. You will have a strong sense of ownership and proactively provide solutions before a situation deteriorates.


Your Responsibilities

  • Lead the design and build of modern big data platforms and AI-powered tools that promote fair and inclusive hiring.
  • Champion code quality by applying best practices like clean code, automated testing, CI/CD, observability, security, and Federated Governance.
  • Design, implement, and optimize high-performance data pipelines and real-time applications using tools like Apache Kafka and Apache Spark.
  • Manage and optimize complex ETL/ELT processes and data orchestration workflows.
  • Continuously evaluate, improve, and scale our data infrastructure, advocating for new technologies and architectural patterns.
  • Collaborate and mentor in an international, agile, cross-functional team, helping others grow and succeed.
  • Contribute to building an inclusive team culture where every voice is valued.
  • Work in a collaborative environment that values diverse perspectives and inclusive decision-making.

Your Skills & Qualifications

  • Excellent communication skills in spoken and written English (B2+ level).
  • Genuine passion for leveraging data and AI to solve complex problems and make a tangible impact.
  • Deep expertise and proven track record in Python for building large-scale data and backend applications (5+ years professional experience).
  • Strong experience with AWS cloud services (e.g., EMR, Glue, ECS with Docker, Redshift, DynamoDB, S3) and understanding of cloud-native architectures (3+ years).
  • Professional experience in Big Data architecture, Data Warehousing, designing complex ETL/ELT pipelines, and data pipeline orchestration (2+ years).
  • Solid experience with Apache Kafka (MSK) for real-time data ingestion and processing (1+ years).
  • Familiarity with Infrastructure as Code (Terraform) and Huggingface Transformers (considered a plus).
  • We value different career paths — if you have taken career breaks, switched disciplines, or balanced work with family life, we still encourage you to apply.

If you don't meet every single requirement but are excited about this role, we still would love to see you applying :)


We believe in supporting our team members both inside and outside the office. We strive to ensure that your job enriches your life. Here are just some of the benefits we offer:

  • Premium medical and dental care
  • Life insurance
  • Flex Benefits - Worksmile Cafeteria System (Multisport, vouchers, tickets, etc.)
  • Employee Referral Program
  • Hackathons, Knowledge Sharing Hours, In-house projects
  • Tech and sport communities
  • Events and integration parties
  • Charity initiatives, including 2 extra volunteer days
  • English/German language classes
  • A supportive and inclusive workplace that promotes professional and personal growth for everyone
  • Flexible working hours and hybrid work model to support work–life balance.

Our commitment
At The Stepstone Group, diversity and inclusion are key to our success. We encourage applications from everyone, regardless of gender identity, sexual orientation, disability status, ethnicity, belief, age, family or parental status, or any other characteristic. We are particularly passionate about attracting more women into tech and leadership roles and provide an environment that supports your growth. We offer mentoring and support networks to help women and underrepresented colleagues grow into senior and leadership roles.


JBGL1_DE

Leider ist dieser Job in Ihrer Region nicht verfügbar
Seien Sie der Erste, der es erfährt

Über das Neueste Data scientists Jobs In Deutschland !

Senior Big Data Engineer (AI Enthusiast)

Confidential

Heute

Job angesehen

Tippen Sie erneut, um zu schließen

Arbeitsbeschreibung

At The Stepstone Group, we have a simple yet very important mission: The right job for everyone. Using our data, platform, and technology, we create opportunities for job seekers and companies around the world to find a perfect match, in a fair and equitable way. With over 20 brands across 30+ countries, we strive for fair and unbiased hiring, and we are particularly focused on building a diverse, inclusive workforce.

At our Tech Hub, located near Wilanowska Metro, we are over 300 passionate and driven specialists who work on the development of our IT products. We are proud to be part of The Stepstone Group, a global leader in job-tech platforms and e-recruiting.

Join our team of 4,000+ employees and help us reshape the labour market. Together, we will create a future where everyone—regardless of background—has equal opportunities in the job market.


As a Senior Big Data Engineer and AI Enthusiast, you will join the Marketplace Enablement department, working inside a cross-functional team to design and implement cutting-edge, high-performance central streaming data products that power our recruitment AI applications, including deploying advanced machine learning models.

Your expertise will help create a more inclusive and efficient recruitment experience globally, directly supporting our mission to reshape the labour market for everyone. You will have a strong sense of ownership and proactively provide solutions before a situation deteriorates.


Your Responsibilities

  • Lead the design and build of modern big data platforms and AI-powered tools that promote fair and inclusive hiring.
  • Champion code quality by applying best practices like clean code, automated testing, CI/CD, observability, security, and Federated Governance.
  • Design, implement, and optimize high-performance data pipelines and real-time applications using tools like Apache Kafka and Apache Spark.
  • Manage and optimize complex ETL/ELT processes and data orchestration workflows.
  • Continuously evaluate, improve, and scale our data infrastructure, advocating for new technologies and architectural patterns.
  • Collaborate and mentor in an international, agile, cross-functional team, helping others grow and succeed.
  • Contribute to building an inclusive team culture where every voice is valued.
  • Work in a collaborative environment that values diverse perspectives and inclusive decision-making.

Your Skills & Qualifications

  • Excellent communication skills in spoken and written English (B2+ level).
  • Genuine passion for leveraging data and AI to solve complex problems and make a tangible impact.
  • Deep expertise and proven track record in Python for building large-scale data and backend applications (5+ years professional experience).
  • Strong experience with AWS cloud services (e.g., EMR, Glue, ECS with Docker, Redshift, DynamoDB, S3) and understanding of cloud-native architectures (3+ years).
  • Professional experience in Big Data architecture, Data Warehousing, designing complex ETL/ELT pipelines, and data pipeline orchestration (2+ years).
  • Solid experience with Apache Kafka (MSK) for real-time data ingestion and processing (1+ years).
  • Familiarity with Infrastructure as Code (Terraform) and Huggingface Transformers (considered a plus).
  • We value different career paths — if you have taken career breaks, switched disciplines, or balanced work with family life, we still encourage you to apply.

If you don't meet every single requirement but are excited about this role, we still would love to see you applying :)


We believe in supporting our team members both inside and outside the office. We strive to ensure that your job enriches your life. Here are just some of the benefits we offer:

  • Premium medical and dental care
  • Life insurance
  • Flex Benefits - Worksmile Cafeteria System (Multisport, vouchers, tickets, etc.)
  • Employee Referral Program
  • Hackathons, Knowledge Sharing Hours, In-house projects
  • Tech and sport communities
  • Events and integration parties
  • Charity initiatives, including 2 extra volunteer days
  • English/German language classes
  • A supportive and inclusive workplace that promotes professional and personal growth for everyone
  • Flexible working hours and hybrid work model to support work–life balance.

Our commitment
At The Stepstone Group, diversity and inclusion are key to our success. We encourage applications from everyone, regardless of gender identity, sexual orientation, disability status, ethnicity, belief, age, family or parental status, or any other characteristic. We are particularly passionate about attracting more women into tech and leadership roles and provide an environment that supports your growth. We offer mentoring and support networks to help women and underrepresented colleagues grow into senior and leadership roles.


JBGL1_DE

Leider ist dieser Job in Ihrer Region nicht verfügbar

Senior Big Data Engineer (AI Enthusiast)

Düsseldorf, Nordrhein Westfalen Stepstone GmbH

Heute

Job angesehen

Tippen Sie erneut, um zu schließen

Arbeitsbeschreibung

At The Stepstone Group, we have a simple yet very important mission: The right job for everyone. Using our data, platform, and technology, we create opportunities for job seekers and companies around the world to find a perfect match, in a fair and equitable way. With over 20 brands across 30+ countries, we strive for fair and unbiased hiring, and we are particularly focused on building a diverse, inclusive workforce.

At our Tech Hub, located near Wilanowska Metro, we are over 300 passionate and driven specialists who work on the development of our IT products. We are proud to be part of The Stepstone Group, a global leader in job-tech platforms and e-recruiting.

Join our team of 4,000+ employees and help us reshape the labour market. Together, we will create a future where everyone—regardless of background—has equal opportunities in the job market.


As a Senior Big Data Engineer and AI Enthusiast, you will join the Marketplace Enablement department, working inside a cross-functional team to design and implement cutting-edge, high-performance central streaming data products that power our recruitment AI applications, including deploying advanced machine learning models.

Your expertise will help create a more inclusive and efficient recruitment experience globally, directly supporting our mission to reshape the labour market for everyone. You will have a strong sense of ownership and proactively provide solutions before a situation deteriorates.


Your Responsibilities

  • Lead the design and build of modern big data platforms and AI-powered tools that promote fair and inclusive hiring.
  • Champion code quality by applying best practices like clean code, automated testing, CI/CD, observability, security, and Federated Governance.
  • Design, implement, and optimize high-performance data pipelines and real-time applications using tools like Apache Kafka and Apache Spark.
  • Manage and optimize complex ETL/ELT processes and data orchestration workflows.
  • Continuously evaluate, improve, and scale our data infrastructure, advocating for new technologies and architectural patterns.
  • Collaborate and mentor in an international, agile, cross-functional team, helping others grow and succeed.
  • Contribute to building an inclusive team culture where every voice is valued.
  • Work in a collaborative environment that values diverse perspectives and inclusive decision-making.

Your Skills & Qualifications

  • Excellent communication skills in spoken and written English (B2+ level).
  • Genuine passion for leveraging data and AI to solve complex problems and make a tangible impact.
  • Deep expertise and proven track record in Python for building large-scale data and backend applications (5+ years professional experience).
  • Strong experience with AWS cloud services (e.g., EMR, Glue, ECS with Docker, Redshift, DynamoDB, S3) and understanding of cloud-native architectures (3+ years).
  • Professional experience in Big Data architecture, Data Warehousing, designing complex ETL/ELT pipelines, and data pipeline orchestration (2+ years).
  • Solid experience with Apache Kafka (MSK) for real-time data ingestion and processing (1+ years).
  • Familiarity with Infrastructure as Code (Terraform) and Huggingface Transformers (considered a plus).
  • We value different career paths — if you have taken career breaks, switched disciplines, or balanced work with family life, we still encourage you to apply.

If you don't meet every single requirement but are excited about this role, we still would love to see you applying :)


We believe in supporting our team members both inside and outside the office. We strive to ensure that your job enriches your life. Here are just some of the benefits we offer:

  • Premium medical and dental care
  • Life insurance
  • Flex Benefits - Worksmile Cafeteria System (Multisport, vouchers, tickets, etc.)
  • Employee Referral Program
  • Hackathons, Knowledge Sharing Hours, In-house projects
  • Tech and sport communities
  • Events and integration parties
  • Charity initiatives, including 2 extra volunteer days
  • English/German language classes
  • A supportive and inclusive workplace that promotes professional and personal growth for everyone
  • Flexible working hours and hybrid work model to support work–life balance.

Our commitment
At The Stepstone Group, diversity and inclusion are key to our success. We encourage applications from everyone, regardless of gender identity, sexual orientation, disability status, ethnicity, belief, age, family or parental status, or any other characteristic. We are particularly passionate about attracting more women into tech and leadership roles and provide an environment that supports your growth. We offer mentoring and support networks to help women and underrepresented colleagues grow into senior and leadership roles.


JBRP1_DE

Leider ist dieser Job in Ihrer Region nicht verfügbar

Senior Big Data Engineer (AI Enthusiast)

Stepstone GmbH

Vor 2 Tagen gepostet

Job angesehen

Tippen Sie erneut, um zu schließen

Arbeitsbeschreibung

At The Stepstone Group, we have a simple yet very important mission: The right job for everyone. Using our data, platform, and technology, we create opportunities for job seekers and companies around the world to find a perfect match, in a fair and equitable way. With over 20 brands across 30+ countries, we strive for fair and unbiased hiring, and we are particularly focused on building a diverse, inclusive workforce.

At our Tech Hub, located near Wilanowska Metro, we are over 300 passionate and driven specialists who work on the development of our IT products. We are proud to be part of The Stepstone Group, a global leader in job-tech platforms and e-recruiting.

Join our team of 4,000+ employees and help us reshape the labour market. Together, we will create a future where everyone—regardless of background—has equal opportunities in the job market.


As a Senior Big Data Engineer and AI Enthusiast, you will join the Marketplace Enablement department, working inside a cross-functional team to design and implement cutting-edge, high-performance central streaming data products that power our recruitment AI applications, including deploying advanced machine learning models.

Your expertise will help create a more inclusive and efficient recruitment experience globally, directly supporting our mission to reshape the labour market for everyone. You will have a strong sense of ownership and proactively provide solutions before a situation deteriorates.


Your Responsibilities

  • Lead the design and build of modern big data platforms and AI-powered tools that promote fair and inclusive hiring.
  • Champion code quality by applying best practices like clean code, automated testing, CI/CD, observability, security, and Federated Governance.
  • Design, implement, and optimize high-performance data pipelines and real-time applications using tools like Apache Kafka and Apache Spark.
  • Manage and optimize complex ETL/ELT processes and data orchestration workflows.
  • Continuously evaluate, improve, and scale our data infrastructure, advocating for new technologies and architectural patterns.
  • Collaborate and mentor in an international, agile, cross-functional team, helping others grow and succeed.
  • Contribute to building an inclusive team culture where every voice is valued.
  • Work in a collaborative environment that values diverse perspectives and inclusive decision-making.

Your Skills & Qualifications

  • Excellent communication skills in spoken and written English (B2+ level).
  • Genuine passion for leveraging data and AI to solve complex problems and make a tangible impact.
  • Deep expertise and proven track record in Python for building large-scale data and backend applications (5+ years professional experience).
  • Strong experience with AWS cloud services (e.g., EMR, Glue, ECS with Docker, Redshift, DynamoDB, S3) and understanding of cloud-native architectures (3+ years).
  • Professional experience in Big Data architecture, Data Warehousing, designing complex ETL/ELT pipelines, and data pipeline orchestration (2+ years).
  • Solid experience with Apache Kafka (MSK) for real-time data ingestion and processing (1+ years).
  • Familiarity with Infrastructure as Code (Terraform) and Huggingface Transformers (considered a plus).
  • We value different career paths — if you have taken career breaks, switched disciplines, or balanced work with family life, we still encourage you to apply.

If you don't meet every single requirement but are excited about this role, we still would love to see you applying :)


We believe in supporting our team members both inside and outside the office. We strive to ensure that your job enriches your life. Here are just some of the benefits we offer:

  • Premium medical and dental care
  • Life insurance
  • Flex Benefits - Worksmile Cafeteria System (Multisport, vouchers, tickets, etc.)
  • Employee Referral Program
  • Hackathons, Knowledge Sharing Hours, In-house projects
  • Tech and sport communities
  • Events and integration parties
  • Charity initiatives, including 2 extra volunteer days
  • English/German language classes
  • A supportive and inclusive workplace that promotes professional and personal growth for everyone
  • Flexible working hours and hybrid work model to support work–life balance.

Our commitment
At The Stepstone Group, diversity and inclusion are key to our success. We encourage applications from everyone, regardless of gender identity, sexual orientation, disability status, ethnicity, belief, age, family or parental status, or any other characteristic. We are particularly passionate about attracting more women into tech and leadership roles and provide an environment that supports your growth. We offer mentoring and support networks to help women and underrepresented colleagues grow into senior and leadership roles.


JBRP1_DE

Leider ist dieser Job in Ihrer Region nicht verfügbar

Standorte in der Nähe

Andere Jobs in meiner Nähe

Industrie

  1. emoji_eventsAbsolventen
  2. apartmentArchitektur
  3. schoolAusbildungsplätze und Trainee
  4. directions_carAutomobilindustrie
  5. account_balanceBanken und Finanzen
  6. foundationBauingenieurwesen
  7. constructionBauwesen
  8. constructionBergbau
  9. schoolBildung und Lehre
  10. request_quoteBuchhaltung
  11. restaurantCatering
  12. scienceChemieingenieurwesen
  13. shopping_cartE-commerce und Social Media
  14. shopping_bagEinkauf
  15. storeEinzelhandel
  16. electrical_servicesElektrotechnik
  17. boltEnergie
  18. local_shippingFahren und Transport
  19. precision_manufacturingFertigung und Produktion
  20. sports_soccerFreizeit und Sport
  21. beach_accessGastgewerbe und Tourismus
  22. diversity_3Gemeinschaft und Sozialpflege
  23. health_and_safetyGesundheitswesen
  24. home_workImmobilien
  25. securityInformationssicherheit
  26. handymanInstallation und Wartung
  27. codeIT und Software
  28. smart_toyKI und aufstrebende Technologien
  29. child_friendlyKinderbetreuung
  30. child_friendlyKonsumgüterindustrie
  31. medical_servicesKrankenpflege
  32. brushKreativ und Digital
  33. currency_bitcoinKryptowährungen und Blockchain
  34. support_agentKundendienst und Helpdesk
  35. paletteKunst und Unterhaltung
  36. ecoLandwirtschaft und Forstwirtschaft
  37. inventory_2Logistik und Lagerhaltung
  38. flight_takeoffLuftfahrt
  39. supervisor_accountManagement
  40. campaignMarketing
  41. buildMaschinenbau
  42. perm_mediaMedien und Öffentlichkeitsarbeit
  43. local_hospitalMedizin
  44. local_hospitalMilitär und öffentliche Sicherheit
  45. local_gas_stationÖl und Gas
  46. person_searchPersonalberatung
  47. groupsPersonalwesen
  48. groupsPharmaindustrie
  49. checklist_rtlProjektmanagement
  50. gavelRecht
  51. clean_handsReinigung und Sanierung
  52. local_floristSchönheit und Wellness
  53. gavelStaatliche und gemeinnützige Organisationen
  54. wifiTelekommunikation
  55. psychologyTherapie
  56. petsTierarzt
  57. supervisor_accountUnternehmensberatung
  58. policyVersicherung
  59. point_of_saleVertrieb
  60. workVerwaltung
  61. precision_manufacturingWirtschaftsingenieurwesen
  62. scienceWissenschaftliche Forschung und Entwicklung
  63. volunteer_activismWohltätigkeit und Freiwilligenarbeit
  64. medical_servicesZahnmedizin
Alle anzeigen Data scientists Jobs