Senior Data Engineer

Join a Company That Invests in You Seeking Alpha is the world’s leading community of engaged investors. We’re the go-to destination for investors looking for actionable stock market opinions, real-time market analysis, and unique financial insights. At the same time, we’re also dedicated to creating a workplace where our team thrives. We’re passionate about fostering a flexible, balanced environment with remote work options and an array of perks that make a real difference. Here, your growth matters. We prioritize your development through ongoing learning and career advancement opportunities, helping you reach new milestones. Join Seeking Alpha to be part of a company that values your unique journey, supports your success, and champions both your personal well-being and professional goals. What We're Looking For Seeking Alpha is looking for a Senior Data Engineer responsible for designing, building, and maintaining the infrastructure necessary for analyzing large data sets. This individual should be an expert in data management, ETL (extract, transform, load) processes, and data warehousing and should have experience working with various big data technologies, such as Hadoop, Spark, and NoSQL databases. In addition to technical skills, a Senior Data Engineer should have strong communication and collaboration abilities, as they will be working closely with other members of the data and analytics team, as well as other stakeholders, to identify and prioritize data engineering projects and to ensure that the data infrastructure is aligned with the overall business goals and objectives.

Requirements: • Bachelor's or Master's degree in Computer Science, Engineering, or a related field • 2+ years of proven experience developing large-scale software using an object-oriented or functional language. • 5+ years of professional experience in data engineering, focusing on building and maintaining data pipelines and data warehouses • Strong experience with Spark, Scala, and Python, including the ability to write high-performance, maintainable code • Experience with AWS services, including EC2, S3, Athena, Kinesis/Firehose Lambda and EMR • Familiarity with data warehousing concepts and technologies, such as columnar storage, data lakes, and SQL • Experience with data pipeline orchestration and scheduling using tools such as Airflow • Strong problem-solving skills and the ability to work independently as well as part of a team • High-level English - a must. • A team player with excellent collaboration skills. Nice to Have: • Expertise with Vertica or Redshift, including experience with query optimization and performance tuning • Experience with machine learning and/or data science projects • Knowledge of data governance and security best practices, including data privacy regulations such as GDPR and CCPA. • Knowledge of Spark internals (tuning, query optimization)