AI Backend Engineer – LLM Systems & Orchestration ( 5+ Years)
Actively Reviewing the ApplicationsThinkvibes Software Private Limited
Job Description
Title: Senior AI Backend Engineer - LLM Infrastructure
Location: Jaipur
Experience: 4-8 years
Reports To: Principal AI Architect
Role OverviewWe are building scalable AI infrastructure for enterprise-grade LLM applications.
We are looking for a strong backend engineer who has experience integrating LLM systems into production environments and building orchestration services around them.
This role will focus on service-layer architecture, API design, performance optimization, and secure deployment of AI systems.
Key Responsibilities- Build scalable microservices around LLM applications
- Integrate RAG pipelines into backend systems
- Develop APIs for AI orchestration layers
- Implement streaming and async LLM workflows
- Build logging and observability pipelines for AI responses
- Optimize performance and latency of LLM-based systems
- Implement secure access control and rate limiting
- Work closely with AI Architect on evaluation integration
- Containerize and deploy AI services using Docker/Kubernetes
- 4+ years backend engineering experience
- Strong Python (FastAPI preferred)
- Experience integrating OpenAI / Anthropic / open-source LLM APIs
- Familiarity with vector databases
- Experience with REST APIs and event-driven systems
- Experience with Docker and cloud deployment
- Strong understanding of async processing
Candidates must demonstrate:
- LLM API integration in production
- Backend service around LLMs (not just scripts)
- Deployment of AI services to cloud
- Logging and monitoring setup
- Performance optimization experience
- Experience with Kafka / message queues
- Experience with CI/CD for ML services
- Experience with embeddings and search tuning
- Familiarity with OpenTelemetry
Required Skills
Quick Tip
Customize your resume and cover letter to highlight relevant skills for this position to increase your chances of getting hired.
Related Similar Jobs
View All
Biotechnology Tutor K12 (Freelancer)
Deccan AI Experts
Full-Stack Software Engineer MTS [ Frontend / Javascript Focus] - Hyderabad
griddable.io
Sr. Python Developer (GenAI / LLM) | Any UST Location | Immediate Joiner
UST
Sr. Engineering Manager
Larsen & Toubro
Technical Writer
Harris Computer
Share
Quick Apply
Upload your resume to apply for this position