Data Engineer (25396)

Who We Are:

Yael Group is a leading group of companies in the Israeli market, providing advanced technological solutions across a wide range of domains to organizations in all sectors.

Job Description:

Join the Data & AI unit in a key role responsible for building a large-scale enterprise Data Lake from end to end in an on-premises environment.

• Design, develop, and maintain scalable data infrastructures based on the Cloudera platform.

• Design and implement enterprise data architecture, including high-volume data ingestion, processing, and Data Pipelines in a distributed environment.

• Develop and maintain data processing pipelines to support advanced analytics capabilities and AI model development.

• Work in a cutting-edge technology environment combining Big Data, Data Engineering, and Artificial Intelligence.

• Collaborate closely with Data, Analytics, and Development teams to build enterprise-grade data infrastructure.

• Hybrid work model.

Job Requirements:

• Relevant academic background.

• At least 4 years of hands-on experience as a Data Engineer or in a Big Data development role.

• Proven experience working with the Apache ecosystem, including core technologies such as Apache Spark, Apache Hive, and Apache Impala.

• Strong proficiency in developing ETL/ELT data pipelines using at least one of the following programming languages: Python, Scala, or Java.

• Expertise in writing complex analytical SQL queries and optimizing performance in distributed data environments.

• Deep understanding of distributed systems architecture and data modeling.

• Experience with workflow orchestration tools such as Apache Airflow – an advantage.

• Hands-on experience with streaming data processing using Apache Kafka – an advantage.

• Experience preparing data infrastructure for Machine Learning and AI projects – an advantage.

• Experience working in hybrid environments and familiarity with Google Cloud Platform (GCP) services – an advantage.

• Willingness and availability to support critical systems when required, including after-hours and weekend work.