Senior Data Streaming Engineer - Data Platform (m/f/d)

We are seeking a highly skilled **Data Engineer** with deep expertise in **real-time data streaming, cloud data platforms (Google Cloud Platform), and Apache Beam**. In this role, you will design, build, and optimize streaming data pipelines that enable scalable, reliable, and high-quality data flows. You’ll collaborate closely with data scientists, analysts, and software engineers to ensure data is efficiently stitched, transformed, and delivered to power analytics, AI, and business intelligence initiatives.**Key Responsibilities:*** Design, implement, and maintain real-time streaming pipelines using Apache Beam and GCP services (e.g., Dataflow, Pub/Sub, BigQuery, Cloud Storage).* Develop scalable ETL/ELT solutions for both streaming and batch processing.* Implement data stitching strategies to integrate multiple data sources into unified, high-quality datasets.* Ensure data quality, reliability, and observability across pipelines.* Optimize data workflows for performance and cost-efficiency in cloud environments.* Apply best practices in CI/CD, infrastructure-as-code, and monitoring for data pipelines.* Contribute to data governance, security, and compliance efforts.**Key Requirements:*** 4+ years of experience in Data Engineering with a focus on real-time/streaming pipelines.* Strong expertise with Google Cloud Platform (GCP): Dataflow, Pub/Sub, BigQuery, Cloud Storage, Cloud Composer, etc.* Proficiency in Apache Beam (or equivalent frameworks such as Spark Structured Streaming, Flink).* Solid programming skills in Python.* Experience with data modeling, schema design, and data stitching across multiple sources.* Knowledge of cloud-native DevOps practices (Terraform, Cloud Deployment Manager, CI/CD pipelines).* Strong problem-solving skills and ability to work in fast-paced environments.* Hands-on knowledge of data observability tools (e.g., Datadog, Prometheus, OpenLineage).* Strong understanding of event-driven architectures and message queues.* Prior experience in high-volume, mission-critical data environments. **Benefits*** 30 days of paid vacation plus the option of up to 15 days of unpaid leave* 25 days of workation within the EU* Flexible working hours* Sofa Concerts and employee events* Discounts on ticket purchases & opportunities for clearing assignments* Corporate benefits and discounts at KESS* Central location & subsidy for a Job Ticket or Germany Ticket* Bike leasing* Mental health program & company pension scheme* “GoFluent” language learning platform as well as Lunch & Learn sessions We value diversity and treat all applications equally – regardless of gender, background, age, religion, disability, or sexual orientation. Different perspectives enrich our team and make EVENTIM stronger.
#J-18808-Ljbffr