Senior Data Engineer - Real Time Streams

We're looking for a Senior Data Engineer to own a real-time streaming platform end-to-end from ingestion and CDC pipelines to analytics and operational decision-making systems.

What You'll Be Doing:

• Design, build, and operate stateful Apache Flink streaming pipelines.

• Develop and maintain Change Data Capture (CDC) pipelines using Flink CDC and Debezium.

• Build and operate Kafka and Kafka Connect infrastructure, including topics, schemas, connectors, and DLQ routing.

• Own the full data flow from Kafka → Flink → Postgres / TimescaleDB / ClickHouse / BigQuery.

• Design schemas, optimize performance, and ensure data consistency across systems.

• Diagnose and resolve production issues including backpressure, checkpoint failures, state growth, and sink bottlenecks.

• Improve platform reliability through delivery guarantees, schema evolution strategies, alerting, and observability.

• Mentor engineers through code reviews and technical leadership.

• Contribute to infrastructure and deployment tooling using Helm, ArgoCD, Kubernetes, Prometheus, and Grafana.

• Influence architectural decisions across the streaming platform and data ecosystem.

Requirements:

• 5+ years of production experience building data-intensive systems.

• Strong Java expertise with modern Java features and deep JVM understanding.

• Hands-on experience with Apache Flink or similar streaming technologies in production.

• Deep understanding of stateful stream processing, checkpointing, savepoints, and scaling strategies.

• Strong Apache Kafka knowledge including delivery guarantees, consumer groups, transactions, and schema management.

• Experience designing and operating Kafka Connect deployments.

• Proven experience building and maintaining CDC pipelines using Debezium or Flink CDC.

• Strong database expertise across PostgreSQL, ClickHouse, BigQuery, and similar systems.

• Experience optimizing query performance, schema design, and storage strategies.

• Familiarity with TimescaleDB, PostGIS, and spatial data workloads.

• Experience with Kubernetes-based production environments and cloud-native deployments.