Senior Data Software Engineer (Big Data Engineer)

We are seeking an open-minded Senior Data Software Engineer to drive the development and maintenance of our data-driven architecture.

In this role, you will work on developing pipelines to build business-related data products and designing cloud-based platform solutions to support DataHub functionality. If you’re passionate about shaping the future of data engineering and thrive in an environment where innovation and collaboration are key, we invite you to join us.

This position offers remote setup with the flexibility to work from any location in Kazakhstan, whether it's your home or well-equipped offices in Astana, Almaty or Karaganda.

Responsibilities

• Design and implement data pipelines

• Perform data ingestion processes to integrate existing data sources into the new platform

• Participate in platform engineering, including cloud-based solutions to support the architecture, such as ingestion frameworks, platform orchestrators and exploratory environments

• Conduct MLOps activities to build production-ready cloud-based solutions to support existing ML pipelines

• Take part in the design of on-premises to cloud migration activities

Requirements

• Strong production experience in Java, Python or Scala

• Proficiency in SQL

• Understanding of common Big Data challenges (splitability, massive parallel processing, load-balancing, data locality, streaming, etc.) and relevant technologies (Apache Spark, Kafka, NoSQL databases)

• Familiarity with data modeling concepts such as relational/dimensional data, SCD and snowflaking

• Hands-on production experience with any major cloud provider: Azure, AWS or GCP

• B2 English level, both verbal and written

• Hands-on production experience with any major cloud provider: Azure, AWS or GCP

Nice to have

• Competency in common data-related architectures such as Data Hub or Data Lake

• Knowledge of Databricks

We offer/Benefits

We connect like-minded people:

• Delivering innovative solutions to…