Overview
We are seeking a Senior Data Engineer to join a remote-first SaaS business specializing in transforming complex transactional data into actionable business insights. Working as part of a small team, you will engage in multiple AI pipeline and LLM projects, leveraging your expertise to enhance client analytics. This position is ideal for individuals with a solid data engineering background who are ready to contribute to innovative solutions across diverse industries.
Responsibilities
- Develop and implement data engineering solutions for AI pipeline projects.
- Collaborate with team members to integrate multiple data sources.
- Utilize tools such as Python, SQL, Airflow, and Kafka to manage data workflows.
- Optimize and maintain data storage solutions utilizing Snowflake.
- Assist in the design and deployment of machine learning models in cloud environments.
Requirements
- Proven experience in AI engineering and working with LLM models.
- Strong proficiency in multi-cloud platforms, particularly AWS, with knowledge of GCP and Azure.
- Extensive background in data engineering using Python and SQL.
- Experience with data orchestration tools like Airflow and messaging systems like Kafka.
- Familiarity with data warehousing solutions, particularly Snowflake.