Overview
As a Senior Data Engineer, you will play a pivotal role in the data and technology transformation of a globally recognized travel organization. Collaborating with a team of data engineers, developers, and business stakeholders, you will help to build and enhance a modern, scalable data platform while modernizing legacy systems and developing a contemporary Event Sourcing architecture.
Responsibilities
- Build and evolve a modern, scalable data platform.
- Collaborate with data engineers, developers, and business stakeholders to create high-quality data products.
- Support the modernization of legacy systems and the development of Event Sourcing architecture.
- Implement data ingestion strategies via APIs, databases, and other sources.
- Ensure best practices in CI/CD, testing, and DevOps are followed.
- Utilize Azure technologies and advanced data modeling techniques.
- Participate in Agile development processes to deliver effective solutions.
Requirements
- 5+ years of experience in Data Engineering.
- Strong expertise in Databricks and Spark / PySpark.
- Advanced proficiency in Python and SQL.
- Experience with Azure data services.
- Solid understanding of data modeling and data platform concepts.
- Familiarity with CI/CD practices, testing, and DevOps methodologies.
- Experience in Agile environments.
- Knowledge of Event Sourcing, Delta Lake, PostgreSQL, dbt, and AI/ML data platforms is desirable.