Job Details

ML Engineer at T1. Design and implement AI agents, develop GenOps platform, organize quality monitoring. Requires Python, LLM frameworks, and message broker experience.

With us, you will: - Design and implement AI agents for specific bank business tasks - Develop the GenOps platform — participate in the creation of self-service backend services (REST/gRPC) that will allow data scientists and business users to quickly deploy and configure agents without delving into infrastructure. - Organize quality monitoring — build a system for evaluating agent performance: from generation quality metrics (responses, hallucinations) to business indicators (accuracy, task completion speed). - Conduct code reviews, refactoring, and code optimization; - Write unit tests; - Ensure high availability and scalability of LLM-based systems

What knowledge and skills are important to us: - Knowledge of Python, FastAPI, aiohttp, aiokafka; - Understanding of the basics of algorithms and data structures; - Experience with message brokers (Kafka, RabbitMQ); - Ability to work with asynchronous/multithreaded code; - Mandatory experience with frameworks for developing applications based on LLM models (llamaindex/langgraph/langchain/haystack) - Knowledge of quality evaluation metrics (BLEU, ROUGE, BERTScore, etc.), approaches to identifying hallucinations. - FullStack development experience, experience interacting with front-end developers in terms of API transfer, experience with layout from mockups is welcome;