Data Engineer (Elasticsearch & Kafka) | חובה סיווג ביטחוני אזרחי רמה 3

We are seeking a skilled and motivated Data Engineer with expertise in Elasticsearch, cloud technologies, and Kafka. As a data engineer, you will be responsible for designing, building and maintaining scalable and efficient data pipelines that will support our organization's data processing needs.

The role will entail:

• Design and develop data platforms based on Elasticsearch, Databricks, and Kafka

• Build and maintain data pipelines that are efficient, reliable and scalable

• Collaborate with cross-functional teams to identify data requirements and design solutions that meet those requirements

• Write efficient and optimized code that can handle large volumes of data

• Implement data quality checks to ensure accuracy and completeness of the data

• Troubleshoot and resolve data pipeline issues in a timely manner

Requirements

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field

• 3+ years of experience in data engineering

• Expertise in Elasticsearch, cloud technologies (such as AWS, Azure, or GCP), Kafka and Databricks

• Proficiency in programming languages such as Python, Java, or Scala

• Experience with distributed systems, data warehousing and ETL processes

• Experience with Container environment such AKS\EKS\OpenShift is a plus

• Valid Civilian Security Clearance (Level 3 or higher) – Mandatory

The position is open for all genders as well as people with disabilities.