Job Details

Top Selection is looking for a Data Platform Engineer / Big Data SRE (Linux) for project employment. Middle+|senior grade, full-time, long-term. Rate: 256K-280K RUB. Location: RF. оформление: only ИП.

Exploitation and development of a large corporate data platform in an industrial company. Tasks: Exploitation and development of the platform - Administration and support of the Data Platform (Arenadata DB / Greenplum, Kafka, ClickHouse) - Management of data storage and processing clusters - Configuration and support of fault tolerance (HA), replication, balancing - Management of updates, patches, and releases Kafka and streaming data - Administration of Kafka clusters (topology, partitioning, replication, retention) - Tuning producer/consumer, working with lag and performance - Support of streaming ETL and ingestion pipelines Integrations and data work - Integration of the platform with DWH, BI, and ML systems - Support and development of data transfer and processing circuits between systems - Participation in ensuring the stability of data pipelines Performance and reliability - Platform monitoring (Prometheus, Grafana, ELK/OpenSearch) - Performance analysis (SQL, storage, network) - Optimization of queries and cluster operation - Incident response (L2/L3), root cause analysis Infrastructure and automation - Automation of operation (Bash / Python / Ansible / Terraform) - Development of CI/CD for data infrastructure - Configuration management (Infrastructure as Code) Integrations and access - Integration with DWH, BI, and ML systems - RBAC configuration and access control Access and security - RBAC configuration and access differentiation

- Experience in administering Data Platform / Big Data / DWH for at least 3 years - Confident knowledge of Linux (RHEL/CentOS/Ubuntu) at the system administration level - Practical experience in operating production clusters: Arenadata DB / Greenplum (or similar MPP systems), Apache Kafka (must have administration experience, not just usage), ClickHouse - Understanding of distributed systems: replication, partitioning, fault tolerance, network interactions (TCP/IP), storage - Experience with: PostgreSQL / Greenplum architecture, SQL query optimization - Practical experience with Kafka: configuring topics and retention policy, working with replication/partitioning, performance tuning producer/consumer - Automation skills: Bash and/or Python, Ansible and/or Terraform - Monitoring experience: Prometheus, Grafana, ELK / OpenSearch - Incident management experience: L2/L3 support, root cause analysis Desirable: - Docker / Kubernetes - Hadoop ecosystem - Spark / Flink - Airflow - Experience with high-load enterprise DWH - Experience in industry / telecom / fintech

Rate: from 256K to 280K RUB Employment type: only ИП (Individual Entrepreneur) Loading: full-time Term: long-term