Senior Data Engineer

Senior Data Engineer at RedLab, remote, full-time/project-based, salary 350k-380k RUB gross, contract via GPH. 5+ years experience required.

Tasks: • Design, development and support of scalable data integration, processing and storage solutions in a corporate data platform. • Development and optimization of batch and streaming pipelines for data loading, transformation and publishing. • Development of ETL/ELT processes using modern data tools. • Data modeling for analytical and operational scenarios. • Performance optimization of data processing and SQL queries. • Ensuring data quality: validation, monitoring and completeness control. • Participation in data platform architecture design and technology selection. • Implementation and development of DataOps and CI/CD practices. • Preparation of technical documentation and architectural artifacts. • Code review, technical mentoring and team development.

• 5+ years of Data Engineer experience. • Knowledge of Data Vault 2.0 methodology. • Strong Python/Scala/Java for ETL/ELT development and data services. • Excellent SQL, complex query optimization and big data experience. • Experience in industrial Data Warehouse, Data Lake or Lakehouse design and development. • Practical experience with Apache Spark. • Experience with Apache Airflow, Apache Kafka. • Experience with streaming processing systems. • Experience with distributed file systems and formats: HDFS, Parquet, Avro. • Experience with Hadoop/Apache Iceberg ecosystem or modern data storage and processing platforms. • Experience with relational DBMS (PostgreSQL, Oracle, ClickHouse, Greenplum). • Strong Git and CI/CD understanding. • Experience with Jira, Confluence or similar. • Understanding of fault-tolerant and scalable solution principles. • Experience with dbt for transformation layers. • Data Quality implementation practice (Great Expectations, Soda, etc.). • Experience with Data Catalog and Data Governance tools.

Salary: 350,000 - 380,000 RUB (gross), contract via GPH. Work format: remote. Employment: full-time/project-based.