Data Engineer
Posted 20 days ago · 0 applicants
Saving, applying or scoring takes a few seconds to set up your free account.
The role in plain words
This role involves designing, building, and maintaining scalable data pipelines to ingest and process large volumes of data from diverse sources. The day-to-day work includes performing data analysis, working across cloud and on-prem environments, and collaborating with Data Scientists to support AI and Machine Learning initiatives.
- Bachelor's degree in Computer Science, Engineering, Mathematics, Statistics, or a related field
- 3+ years of experience as a Data Engineer
- 3+ years of experience with Object-Oriented Programming (OOP)
- 3+ years of hands-on Python development
- Strong experience with Apache Spark for large-scale data processing
- 2+ years of hands-on AWS experience with services such as Athena, Glue, Step Functions, EMR, Redshift, and RDS
- Familiarity with GenAI solutions and Prompt Engineering
Extracted from the job description · kept up to date automatically
Who this suits
This role suits professionals with at least 3 years of experience in data engineering, object-oriented programming, and Python development, who also have strong experience with Apache Spark. It is less ideal for those without hands-on experience in Docker, Kubernetes, and data orchestration tools like Airflow or Kubeflow.
Full job description
Original listing · kept for referenceAbout the Company
At Nogamy, we help leading organizations turn data into business value through cutting-edge Data & AI solutions. If you're passionate about building scalable data platforms and working alongside top AI professionals, we'd love to hear from you.
About the Role
We're looking for a Data Engineer to join our team and work on innovative AI-driven projects.
Responsibilities
• Design, build, and maintain scalable and complex data pipelines.
• Ingest and process large volumes of data from diverse sources.
• Perform data analysis and gain deep insights from complex datasets.
• Collaborate closely with Data Scientists to support AI and Machine Learning initiatives.
• Work across both Cloud and On-Prem environments.
Qualifications
• Bachelor's degree in Computer Science, Engineering, Mathematics, Statistics, or a related field.
Required Skills
• 3+ years of experience as a Data Engineer.
• 3+ years of experience with Object-Oriented Programming (OOP).
• 3+ years of hands-on Python development.
• Strong experience with Apache Spark for large-scale data processing.
• Deep understanding of designing, developing, and optimizing high-volume data processing solutions.
• Experience with data formats and partitioning strategies such as Parquet, Avro, HDF5, and Delta Lake.
• Hands-on experience with Docker, Linux, CI/CD tools, and Kubernetes.
• Experience with data orchestration tools such as Airflow or Kubeflow.
• Understanding of Machine Learning concepts and workflows.
Preferred Skills
• 2+ years of hands-on AWS experience with services such as Athena, Glue, Step Functions, EMR, Redshift, and RDS.
• Familiarity with GenAI solutions and Prompt Engineering.
Questions about this role
- This listing did not state a salary. We only show pay when the employer publishes it.
- Bachelor's degree in Computer Science, Engineering, Mathematics, Statistics, or a related field, 3+ years of experience as a Data Engineer, 3+ years of experience with Object-Oriented Programming (OOP), 3+ years of hands-on Python development, Strong experience with Apache Spark for large-scale data processing