Senior Data Engineer - Intelligent Search (f/m/d)

Join to apply for the Senior Data Engineer - Intelligent Search (f/m/d) role at SAP

Summary: The Senior Data Engineer - Intelligent Search (f/m/d) builds scalable crawlers, ingestion, enrichment, and indexing pipelines that power SAP's AI Search service offering for multiple scenarios within the company. Join a collaborative team delivering fresh, high-quality content and reliable search across the enterprise.

Responsibilities

• Join a global, agile delivery team to extract, enrich, and deliver high-quality data powering a wide range of SAP use cases
• Develop and continuously evolve a JavaScript/TypeScript-based modular crawler framework for high-performance, large-scale data extraction
• Configure new crawler jobs in close collaboration with data source owners and service teams
• Integrate with REST and GraphQL APIs to acquire and enrich data
• Ingest and process datasets with AI/ML in Databricks using PySpark and Delta Lake to integrate processed data into target systems such as OpenSearch and Coveo
• Monitor and troubleshoot crawler jobs on Kubernetes; analyze logs, execute tests, and debug issues
• Improve data quality and optimize/maintain crawlers and modules using established tooling
• Collaborate closely within your team and with supporting units and stakeholders

Qualifications

• University Degree in Computer Science, Engineering, or similar
• 5+ years of professional working experience in software development
• Strong proficiency in Node.js, TypeScript, and Python/PySpark
• Proven web crawling, HTML parsing, and REST/GraphQL API integration skills
• Experience applying AI/ML to data enrichment workflows
• Hands‑on with Databricks, Delta Lake, and Azure ADLS Gen2
• Experience with OpenSearch/Elasticsearch (optionally Coveo)
• Understanding of Kubernetes, Docker, and containerized execution
• Experience with designing, implementing, and maintaining CI/CD pipelines
• Strong log analysis and troubleshooting skills
• Proficient in both German and English, with strong communication skills

Team

The Intelligent Search team, part of CPIT, develops, enhances, and operates the Intelligent Search Service end‑to‑end, from content gathering to UI development and integration into consuming platforms. The team collaborates with multiple lines of business across SAP.

Benefits: Constant learning, skill growth, great benefits, and a team that wants you to grow and succeed.

Location

Berlin, Germany

Equal Employment Opportunity

SAP is committed to the values of Equal Employment Opportunity and provides accessibility accommodations to applicants with physical and/or mental disabilities. For assistance, contact Recruiting Operations Team:

Recruitment Process

For information on the responsible use of AI in our recruitment process, please refer to our Guidelines for Ethical Usage of AI in the Recruiting Process. Violation may result in disqualification.

Requisition Information

Requisition ID: | Work Area: Information Technology | Expected Travel: 0 - 10% | Career Status: Professional | Employment Type: Part Time or Regular Full Time

#J-18808-Ljbffr