Lead Data Scientist

Job Description

How is this team contributing to vision of Providence? Ensure a continual and seamless service for customers regardless of which services they access. What will you be responsible for? End-to-end development and quality of solutions and services in conversational & Agentic AI capability Understanding and Implementing advanced techniques in Agentic AI & Conversational AI Frameworks. Introduce best practices in AI Frameworks. What would your day look like? Lead the design and development of Agentic AI Frameworks, models and systems, ensuring high performance and scalability. Good in Python, RestAPI and data structure skills Fine-tune and optimize pre-trained large language models (LLMs) such as GPT, LLAMA, Falcon, and Mistral. Implement and manage model quantization techniques (e.g., GPTQ, AWQ, 8-bit/4-bit models) to enhance model efficiency. Utilize Langchain, Dagster etc for orchestration and memory management in agentic applications. Conduct thorough model evaluations using metrics such as BLEU, ROUGE, and perplexity to ensure model quality and performance. Develop and maintain systems for intent recognition, entity extraction, and generative dialogue management. Stay updated with the latest advancements in NLP and AI technologies and apply them to ongoing projects. Mentor and guide junior engineers, fostering a culture of continuous learning and innovation. Who are we looking for? Minimum 6 years of experience in Programming Languages & AI Platforms Strong understanding of deep learning fundamentals, including LSTM, RNN, ANN, POS tagging, and Transformer models. Strong understanding and proficiency in Agentic AI Frameworks. Proven experience in fine-tuning pre-trained LLMs (e.g., GPT, LLAMA, Falcon, Mistral) and Quantization. Knowledge of model quantization techniques (GPTQ, AWQ, 8-bit/4-bit models). Proficiency in using orchestration frameworks, state and memory management. Experience with model evaluation metrics such as BLEU, ROUGE, and perplexity. Understanding of intent recognition, entity extraction, and generative dialogue management systems. Excellent problem-solving skills and the ability to work in a fast-paced, collaborative environment. Strong communication skills and the ability to convey complex technical concepts to non-technical stakeholders. Good Understanding with Azure AI Foundary, Azure AI search, Indexing Knowledge in Kubernetes is good to have. Knowledge of Microsoft Event Hubs or Kafka Technologies Experience with load testing and unit testing tools. Proficient understanding source control and code versioning tools such as GIT, Azure DevOps etc. Familiarity with CICD and DevOps.