Job Details
Software Development
Senior
Remote
Full time
Russian
Oct 24

Tech Lead Python / LLM Agents

Senior Tech Lead Python / LLM Agent role, remote or hybrid, full-time, 6+ years experience, leading platform core and agent cycle.

Core platform development in Python: sessions, agent steps, customer policies, accounting; agent loop under step budget. Migrating users from pilot architecture to target without downtime. Reducing step cost: input composition, prefix cache, tool limits, model routing, per-user and per-step accounting. Quality assessment: reference from real traces, comparison of Russian models, regression on each prompt, tool, model. Company data via MCP with user permissions: 1C, KHD, SED, HR, document search with ACL. Reliable background procedures and writes to external systems: schedules, human confirmation, exactly-once writes. Sandbox for agent code: per session, no secrets and outgoing connections. Team: decomposition, review, work with AI agents for code, hiring. Aligning requirements and security with the customer.

Backend 7+ years, with at least 2 years as tech lead/principal engineer responsible for production. Python in production: asyncio, FastAPI, Pydantic, typing, tests. Able to read and modify Go. LLM agents in production with real users: tool calling, agent loop, constraints, error handling. Understanding context and cost: call input, prefix cache, history compression, tool limits, calculate step price based on usage. Eval: reference sets, LLM judge and its validation, regression, tracing (Langfuse, OpenTelemetry). Hybrid search, reranking, chunking, document access rights. MCP, OAuth 2.0/OIDC, token exchange — agent on behalf of user. Durable execution (Temporal, Restate or similar), idempotency, retries. PostgreSQL, Redis, S3, Docker, Kubernetes, GitLab CI. Open models via OpenAI-compatible APIs, LiteLLM or similar. Higher technical education.

Full-time employment, schedule 5/2, remote or hybrid work format.

OIDC
Restate
Kubernetes
Redis
OAuth
Pydantic
LLM
Temporal
LiteLLM
Python
asyncio
OpenTelemetry
Docker
S3
Langfuse
Go
MCP
GitLab CI
PostgreSQL
FastAPI

Don't miss a single job

Subscribe to our Telegram channel

Subscribe

Similar jobs

Tech Lead Python / LLM Agents

Tech Lead Python/LLM Agents, remote in Russia, full-time. Lead backend and AI agent development.

Russia
N
NDA

Java Tech Lead

X5 Tech is hiring a Java Tech Lead (6+ years experience, full-time, remote) to lead development, write code, and shape team plans.

X
X5 Tech

Tech Lead Node.js

Tech Lead Node.js at PixelPlex, a leading blockchain development company. Office or hybrid in Belarus.

Belarus
P
PixelPlex