Senior Data Engineer

Senior Data Engineer for a product team building corporate data platforms and data products for Trading & Supply. Remote. Requires Python, PySpark, Databricks, SQL Server, FastAPI, Azure, Docker, Kubernetes.

We are looking for a Senior Data Engineer for a product team that develops corporate data platforms and data products for the Trading & Supply direction. Main tasks: • Design, development, and support of scalable data pipelines and data products. • Development of backend services and REST APIs using FastAPI. • Work with Databricks, Python, PySpark, SQL Server, and cloud technologies. • Interaction with business customers, Product Owner, architects, and development teams. • Participation in the full SDLC: design, development, testing, deployment, monitoring, and support. • Setup and support of CI/CD processes, automated testing, and code quality control. • Development and support of containerized applications (Docker, Kubernetes). • Implementation of engineering best practices: code review, testing, security, monitoring, and observability. • Monitoring, performance optimization, incident resolution, and ensuring service reliability.

Mandatory skills: • Python, PySpark, Databricks, SQL Server • FastAPI, REST API • Azure, Docker, Kubernetes, GitOps, CI/CD Nice to have / Important: • Experience building modern data platforms and data products. • Understanding of data architecture, data modeling, and data governance principles. • Experience with cloud solutions and cloud-native architecture. • Experience setting up CI/CD and DevOps practices (GitHub Actions or similar tools). • Strong analytical skills and experience solving complex technical problems. • Experience working in Agile/Product teams.

Remote work