Job Details

Data Engineer with Java and Spark skills for a large Russian bank. Remote work within Russia. Salary 300k+ RUB/month. Full-time. Project involves data replication and indexing for real-time processing.

Project: Data replication from sources to a distributed cloud cluster and data indexing for real-time query processing. Tasks: The team's global tasks are replication and indexing of data from various sources (mainly Apache Hive) into a distributed cloud cluster (also Apache Hive), to then process queries in real-time via REST or message brokers (Kafka or IBM MQ) to this data (e.g., balances of individuals' accounts in response to government requests, data on goods in a check for a purchase in a mobile application, etc.).

Basic knowledge of Java (loops, conditions, hashmaps, etc.) Basic knowledge and understanding of CI/CD Linux (basic), Ansible, SQL, Git, XML, JSON, XSLT, YAML Basic knowledge of the Hadoop ecosystem and its components (Apache Solr, Apache Hive, Apache HBase, Apache Spark, Apache Zookeper, Apache Oozie, Apache Camel) Language: English, technical level (reading documentation, professional resources)

Salary: 300k+ RUB/month Format: remote within Russia Employment: full-time