Lead Data Engineer

Work Type: On-site 5 days a week

Role overview:
As a Team Lead of Data Engineering, you’ll drive the design, development, and optimization of our data engineering pipelines and services with a strong software engineering mindset.

You'll also play a pivotal role in fostering growth and collaboration within the team, mentoring junior colleagues, and refining processes to help us maintain excellence. If you’re excited to make a lasting impact both technically and as a team leader, we’d love to meet you.

Desired skills:
We are looking for candidates with a strong educational background in Mathematics, Computer Science, Engineering, Physics, or a related field, along with 8+ years of proven experience in Data Engineering, including data warehousing, ETL, automation, cloud technologies, or Software Engineering in datarelated areas. Every day, you will rely on these hard skills, so if you haven’t already mastered them yet, we expect you to become confident quickly:

●  Very strong software engineering principles to write maintainable, scalable code, primarily in Python (experience with Rust or C# is a plus).
●  Data processing and manipulation using Polars and Pandas, scaled via Apache Ray.
●  Efficient use of various open-source data storage technologies such as S3, Apache Iceberg, DuckDB, Clickhouse, PostgreSQL, and others.
●  Containerization and orchestration tools like Docker and Kubernetes, with automated deployments in cloud environments (AWS, Azure, GCP).
●  Complex workflow orchestration using open-source tools such as Apache Airflow.
●  Big data and distributed processing technologies, including Hadoop, Spark, and Kafka.

On the soft skills side, you will need:
●  Experience leading and mentoring junior team members, fostering skill development, collaboration, and process improvements.
●  Cross-functional collaboration experience, working with software engineers, data scientists, and ML engineers to deliver high-impact solutions.