Job Details

Data Engineer at Облако.ру, focusing on designing and developing data pipelines for cybersecurity event processing, normalizing security events, and optimizing analytical data storage. Remote position.

Responsibilities: - Design and development of data pipelines for processing cybersecurity events; - Normalization and enrichment of security events; - Design and optimization of analytical data storage (ClickHouse / StarRocks / similar); - Preparation of data marts for fast queries and analytics; - Operation of data services in Kubernetes: deployment, resources, fault tolerance, scaling; - Ensuring observability and data quality (metrics, alerts, replay/backfill); - Participation in incident analysis and optimization of data platform performance.

Requirements: - Experience in building and operating data pipelines (ETL, ELT and/or streaming) in a production environment; - Confident SQL, including query optimization and performance analysis; - Experience with OLAP DBMS (ClickHouse/StarRocks/Druid/Pinot or similar); - Understanding of data stream processing principles (idempotency, deduplication, error handling); - Experience in designing and optimizing data marts and data storage schemas; - Confident knowledge of Kubernetes and experience operating services in a production environment; - Understanding of the principles of reliability, scalability, and observability of data systems.