Data Engineer ( 23931)

We are Yael Group, one of Israel’s leading technology solutions providers, delivering innovative and advanced IT services to organizations across a wide range of industries.

We are looking for a highly skilled and experienced Senior Data Engineer to lead the design, development, and optimization of our data ecosystem. In this role, you will be a key architect of our Lakehouse environment, responsible for building complex data pipelines, defining modeling standards, and selecting the cutting-edge tools that drive our business intelligence and AI initiatives.

You will serve as a technical mentor to our data teams and play a pivotal role in our transition to cloud-based infrastructures.

Key Responsibilities

• Pipeline Architecture: Design, develop, and manage complex ETL/ELT processes and robust Data Pipelines within a Lakehouse environment.

• Strategic Modeling: Define data modeling methodologies and select development tools based on environment, data volume, and specific business requirements.

• Data Lifecycle Management: Oversee data preparation, cleansing, enrichment, and sophisticated modeling to ensure high-quality analytical outputs.

• Integration & Governance: Define and execute processes for data access, extraction, flow, and integration across various platforms and sources.

• Real-time & Batch Processing: Lead the planning and execution of both Batch and Streaming processes, building specialized data layers for high-scale consumption.

• Cloud Transformation: Take an active role in planning and executing the migration of data assets to cloud environments.

• Collaboration & Leadership: Work closely with DBAs, infrastructure teams, and Data Scientists. Provide technical guidance and mentorship to junior developers and engineers.

• Innovation: Stay at the forefront of BI, Big Data, and AI technologies, implementing new tools and methodologies to maintain a competitive edge.

Professional Requirements

• Experience: At least 5 years of hands-on experience as a Data Engineer (Mandatory).

• Academic Background: Master’s Degree (M.Sc./M.A.) in Engineering, Computer Science, Statistics, OR, or Mathematics (Mandatory).

• Alternative: A Ph.D. in any field combined with at least 7 years of relevant experience.

• Data Modeling: Proven expertise in complex data modeling and architectural design (Mandatory).

• Technical Stack: * High-level proficiency in SQL (Mandatory).

• High-level proficiency in Python, Java, or R (Mandatory).

• Tools: Extensive experience with ETL tools, analytical platforms, and BI ecosystems.

• Expertise: Demonstrated success in building complex, large-scale Data Pipelines and managing diverse data sources.