Data Engineer

About the Company

At Nogamy, we help leading organizations turn data into business value through cutting-edge Data & AI solutions. If you're passionate about building scalable data platforms and working alongside top AI professionals, we'd love to hear from you.

About the Role

We're looking for a Data Engineer to join our team and work on innovative AI-driven projects.

Responsibilities

• Design, build, and maintain scalable and complex data pipelines.

• Ingest and process large volumes of data from diverse sources.

• Perform data analysis and gain deep insights from complex datasets.

• Collaborate closely with Data Scientists to support AI and Machine Learning initiatives.

• Work across both Cloud and On-Prem environments.

Qualifications

• Bachelor's degree in Computer Science, Engineering, Mathematics, Statistics, or a related field.

Required Skills

• 3+ years of experience as a Data Engineer.

• 3+ years of experience with Object-Oriented Programming (OOP).

• 3+ years of hands-on Python development.

• Strong experience with Apache Spark for large-scale data processing.

• Deep understanding of designing, developing, and optimizing high-volume data processing solutions.

• Experience with data formats and partitioning strategies such as Parquet, Avro, HDF5, and Delta Lake.

• Hands-on experience with Docker, Linux, CI/CD tools, and Kubernetes.

• Experience with data orchestration tools such as Airflow or Kubeflow.

• Understanding of Machine Learning concepts and workflows.

Preferred Skills

• 2+ years of hands-on AWS experience with services such as Athena, Glue, Step Functions, EMR, Redshift, and RDS.

• Familiarity with GenAI solutions and Prompt Engineering.