Data Engineer in CDP team

Remote full-time Data Engineer for internal Customer Data Platform at 2GIS. Build batch and realtime pipelines on Kafka, process billions of events.

2GIS is developing an internal Customer Data Platform. It combines data from different sources, builds user profiles and helps personalize the product. Improve batch pipelines of daily features, create a realtime pipeline on Kafka and design processing of billions of events.

Experience with highload systems and designing data architecture or platform code. Experience with Kafka, ClickHouse or other streaming and analytical processing systems. Understanding and ability to work with Spark. Good command of a programming language, e.g., Python or Scala. Plus: Airflow, SQL, Data Quality and Data Contracts, Data Lineage and Data Catalog, knowledge of S3, and experience with personalization, segmentation, or real-time analytics.

Remote, full-time. Salary and grade not specified. The platform stack is still being formed, so you can influence the architecture.