Senior AI Engineer

Job Title: Senior AI Engineer (Generative AI & RAG)

Location: Pune / Mohali / Hyderabad (India)

Experience: 5+ Years

Job Summary:

We are seeking a seasoned Senior AI Engineer with 5+ years of software engineering experience to own, architect, and optimize our Generative AI and Retrieval-Augmented Generation (RAG) pipelines. In this role, you won't just tinker with wrappers; you will bridge the gap between complex foundation models and production-grade enterprise data. You will design reliable, low-latency AI applications that deliver highly accurate, contextual answers.

Responsibilities:

• Design end-to-end RAG systems including document chunking strategies, embedding model selection, hybrid search (semantic + BM25), and cross-encoder reranking.
• Build robust AI workflows using orchestration frameworks (e.g., LangChain, LlamaIndex, LangGraph) or custom-built asynchronous Python frameworks.
• Deploy and manage vector databases (e.g., Pinecone, Milvus, Weaviate, or PGVector) at enterprise scale.
• Implement automated evaluation harnesses (e.g., RAGAS, TruLens) to rigorously track context recall, faithfulness, and reduce hallucinations.
• Wrap AI services in high-performance, async backend APIs (FastAPI) and collaborate with MLOps/DevOps teams to deploy them securely via cloud environments (AWS/Azure/GCP).

Qualifications

• Core Experience: 5+ years of professional software engineering experience, with at least 2+ years of hands-on experience building production-level LLM and RAG applications.
• Programming: Expert-level proficiency in Python (async/await paradigms, concurrency, and performance tuning).
• AI/LLM Stack: Strong familiarity with frontier models (OpenAI, Anthropic, Gemini, Llama) and fine-tuning or prompt/context engineering nuances.
• Data Layer: Deep understanding of embeddings, vector spaces, semantic search, and metadata filtering.
• Engineering Best Practices: Proven experience navigating non-deterministic system testing, rate-limiting, latency constraints, and cost optimization workflows.

What We Offer

• Opportunity to work at the forefront of the Generative AI shift.
• Collaborative and fast-paced engineering culture.
• Competitive compensation package and flexible working arrangements in our modern Pune, Mohali, or Hyderabad tech hubs.

Company Description: Bits in Glass - India

Bits in Glass is a leading software consulting firm specializing in innovative data solutions and enterprise applications.

• Industry Leader:
• Bits in Glass(BIG) has been in business for more than 20 years. In 2021 Bits in Glass joined hands with Crochet Technologies, forming a larger organization under the Bits In Glass brand to better serve customers across the globe.
• Offices across three locations in India: Pune, Hyderabad & Chandigarh.
• Specialized Pega partner since 2017, delivering Pega solutions with deep industry expertise and experience.
• Proudly ranked among the top 30 Pega partners, Bits In Glass has been one of the very few sponsors of the annual PegaWorld event.
• Elite Appian partner since 2008, delivering Appian solutions with deep industry expertise and experience.
• Operating in the United States, Canada, United Kingdom, and India.
• Dedicated global Pega CoE to support our customers and internal dev teams.
• Specializes in Databricks, AI, and cloud-based data engineering to help companies transition from manual to automated workflows.
• Employee Benefits:
• Career Growth: Opportunities for career advancement and professional development.
• Challenging Projects: Work on innovative, cutting-edge projects that make a global impact.
• Global Exposure: Collaborate with international teams and clients to broaden your professional network.
• Flexible Work Arrangements: Support for work-life balance through flexible working conditions.
• Comprehensive Benefits: Competitive compensation packages and comprehensive benefits including health insurance, and paid time off.
• Learning Opportunities- Great opportunity to upskill yourself and work on new technologies like AI-enabled Pega solutions, Data engineering, Integration, cloud migration etc.
• Company Culture:
• Collaborative Environment: Emphasizes teamwork, innovation, and knowledge sharing.
• Inclusive Workplace: Values diversity and fosters an inclusive environment where all ideas are respected.
• Continuous Learning: Encourages professional development through ongoing learning opportunities and certifications.
• Core Values:
• Integrity: Commitment to ethical practices and transparency in all business dealings.
• Excellence: Strive for the highest standards in everything we do.
• Client-Centric Approach: Focus on delivering the best solutions tailored to client needs.