Senior Backend/Data Engineer

We are looking for a Senior Data Engineer to architect and build our core real-time data infrastructure. You will design low-latency streaming pipelines and lakehouse solutions processing live spatial telemetry, coordination data, and AI/game-theoretic decision streams from 200+ autonomous platforms in contested environments.

Core Responsibilities

• Real-Time Data Pipelines: Design and build scalable, low-latency streaming architectures handling millions of daily spatial messages.

• Streaming & Lakehouse: Implement distributed streaming frameworks and lakehouse schemas to support real-time C2 execution and post-mission analytics.

• Full-Lifecycle Ownership: Lead end-to-end data modeling, IaC deployment, performance tracking, security, and infrastructure optimization.

• R&D Collaboration: Partner with AI/Algorithm engineers to integrate decision models and simulation telemetry.

• Performance & Scale: Optimize system throughput, memory footprints, and cloud infrastructure costs for mission-critical deployments.

Requirements

• 6+ years of production experience building data/backend systems in Python or Java.

• 3+ years of hands-on experience with streaming platforms (Kafka, RabbitMQ, Kinesis) processing high-volume real-time data (~10M+ messages/day).

• Data Storage: Deep proficiency with SQL/NoSQL databases (PostgreSQL, Elastic, DynamoDB, Redis) and high-concurrency schema design.

• Cloud & DevOps: Strong experience with AWS, Docker, Kubernetes, CI/CD, and IaC (Terraform/CDK).

• System Design: Solid understanding of microservices, distributed systems, and distributed state management.

• Education: B.Sc. in Computer Science, Software Engineering, or equivalent practical background.

• Security Clearance: Active Security Clearance (or eligibility to obtain one) – Mandatory.