Data Engineer Team Lead

A distinguished and well-established cyber defense and intelligence technology company delivering advanced software, research, and big data solutions primarily to Israel’s defense establishment and intelligence community.

The company leads high-impact, mission-critical R&D projects of national significance, engineering resilient architectures across complex on-premise containerized systems and cloud environments processing immense data scales.

Employing approximately 230 professionals, the organization offers exceptional organizational stability, rigorous engineering standards, and direct involvement in mission-critical national security technologies.

The offices are located in the Sharon region with dedicated on-site parking.

Role Description-

• Serving as a Data Engineering Team Lead, leading a specialized engineering squad of 4 Data Engineers while remaining active Hands-On in core software architecture and backend data development.

• Architecting and building robust, distributed Big Data pipelines, ingestion engines, and data storage workflows powering sensitive intelligence and cyber operations.

• Developing production-grade data processing pipelines primarily in Python running on enterprise Linux environments.

• Designing and managing scalable database and search platforms utilizing Elasticsearch / OpenSearch, MongoDB, and PostgreSQL.

• Deploying and orchestrating high-scale services across both Cloud environments and containerized On-Premises infrastructures (OpenShift, Kubernetes, Docker).

• Implementing automated CI/CD pipelines (GitLab) and engineering methodologies to ensure high system reliability, observability, and data integrity.

• Providing technical direction, task prioritization, design reviews, and hands-on professional mentorship to the team.

Requirements-

• 3 years of proven experience in engineering team management / leadership – Mandatory

• 5 years of proven hands-on experience as a Big Data Engineer or Data Engineer – Mandatory

• 4 years of hands-on software development experience with Python – Mandatory

• Deep understanding of Cloud environments alongside containerized On-Prem infrastructure (OpenShift, Kubernetes, Docker, Linux) – Mandatory

• Proven hands-on experience with relational and NoSQL databases (SQL & NoSQL) – Mandatory

• Demonstrated track record processing large-scale datasets and implementing CI/CD methodologies (e.g., GitLab) – Mandatory

• Bachelor’s Degree (B.Sc.) in Computer Science, Software Engineering, or a related technical discipline – Mandatory

• Substantial hands-on experience with PostgreSQL and OpenSearch / Elasticsearch – Significant Advantage

• Prior background working on defense, intelligence, or cybersecurity data systems – Advantage