Backend Software Engineer

Job Description

Our client is seeking a high-caliber Backend Engineer to own the critical inference and orchestration layer that powers every single AI interaction in the platform. You’ll sit right between state-of-the-art models and millions of user interactions, where latency, correctness, and absolute reliability determine product success.What You’ll Be DoingInference & Orchestration: Design, build, and scale the core orchestration layers, service boundaries, and inference pipelines that serve production AI features across mobile and desktop apps.Tame Non-Deterministic AI: Build high-reliability, long-running workflows that handle multi-step reasoning, external tool interaction, and persistent context despite non-deterministic model behavior.Performance Optimization: Drive low-latency and high-throughput across inference, caching, batching, and streaming strategies.Production Excellence: Own end-to-end operational quality—from monitoring, logging, and alerting to rapid incident response for high-traffic API endpoints.What We’re Looking ForSolid Backend Fundamentals: Proven track record building and operating high-throughput, low-latency production services.AI/LLM Familiarity: Practical experience with AI inference patterns (LLMs, embeddings, multimodal systems) and integrating providers like OpenAI, Anthropic, or open-source models.Distributed Systems Mastery: Comfortable debugging distributed backend architectures under heavy load.Product-Minded Execution: A strong bias toward shipping fast, learning from production metrics, and taking full ownership of your systems.Tech StackLanguages: Python, Node.jsAI/ML: PyTorch, OpenAI / Anthropic APIs, Open-Source LLMsData: SQL & NoSQL databasesInfra & Ops: Kubernetes, Docker, modern cloud architecture