Job Details

Data Engineer at Облако.ру. Responsibilities include designing and developing data pipelines for cybersecurity event processing, normalizing and enriching security events, and designing/optimizing analytical data storage.

Designing and developing data pipelines for cybersecurity event processing; Normalization and enrichment of security events; Designing and optimizing analytical data storage (ClickHouse / StarRocks / analogs); Preparing data marts for fast queries and analytics; Operating data services in Kubernetes: deployment, resources, fault tolerance, scaling; Ensuring observability and data quality (metrics, alerts, replay/backfill); Participating in incident analysis and optimization of data platform performance.

Experience in building and operating data pipelines (ETL, ELT, and/or streaming) in a production environment; Proficient SQL, including query optimization and performance analysis; Experience with OLAP DBMS (ClickHouse/StarRocks/Druid/Pinot or analogs); Understanding of data stream processing principles (idempotency, deduplication, error handling); Experience in designing and optimizing data marts and storage schemas; Proficient knowledge of Kubernetes and experience operating services in a production environment; Understanding of reliability, scaling, and observability principles of data systems.