Job Details

Data Engineer at BI Group, a leading developer in Central Asia. Salary from 200,000 RUB. Office-based in Astana. Requires over 3 years of experience in data pipelines, ClickHouse, Kafka, Airflow, DBT, SQL, Python, and data quality.

BI Group is the largest development company in Central Asia.

– Over 3 years of experience as a Data Engineer or in a related role focusing on building data pipelines; – ClickHouse – deep understanding of MergeTree family engines (ReplacingMergeTree, AggregatingMergeTree, SummingMergeTree), partitioning, projections, materialized views; – Experience in setting up sharding and replication; – Skills in optimizing heavy queries; – Debezium + Kafka – experience in setting up CDC connectors for relational and NoSQL sources, understanding of snapshot/streaming modes, handling schema evolution, working with Kafka Connect; – Apache Airflow – confident DAG writing, experience with TaskFlow API, developing custom operators and hooks, understanding architecture (scheduler, executor, workers), setting up monitoring and alerting; – DBT – building models and tests (generic and singular), macros, incremental models, working with sources and snapshots, maintaining documentation; – Confident SQL: window functions, CTE, reading and optimizing execution plans; – Python at production code level; – Experience with data quality: writing tests, data contracts, observability practices.