AI ML Engineer

Job Description

This role is for one of the Weekday's clients Salary range: Rs 800000 - Rs 2000000 (ie INR 8-20 LPA) Min Experience: 6 years Location: Bengaluru, Karnataka, NCR, Delhi JobType: full-time Requirements Key Responsibilities: ML Pipeline Design Design and implement scalable ML pipelines for experiment tracking, model management, feature management, and model retraining. Develop APIs for high-performance model inferencing. Hands-on experience with MLflow, SageMaker, Vertex AI, and Azure AI. LLM Serving & GPU Architecture Deep understanding of GPU architectures for ML workloads. Expertise in distributed training and serving of large language models (LLMs). Skilled in model/data parallel training using frameworks such as DeepSpeed and serving frameworks like vLLM. Model Fine-Tuning & Optimization Fine-tune and optimize LLM and LVM models for improved latency and accuracy. Reduce training time and resource requirements for large-scale model deployments. DevOps & LLMOps Proficient in DevOps and LLMOps practices, including Kubernetes, Docker, and container orchestration. Experience with LLM orchestration frameworks such as Flowise, Langflow, and Langgraph. Technical Skills & Tools: LLM Frameworks: Hugging Face OSS LLMs, GPT, Gemini, Claude, Mixtral, Llama LLMOps Tools: MLflow, Langchain, Langgraph, LangFlow, Flowise, LlamaIndex, SageMaker, AWS Bedrock, Vertex AI, Azure AI Databases/Data Warehouses: DynamoDB, Cosmos, MongoDB, RDS, MySQL, PostgreSQL, Aurora, Spanner, Google BigQuery Cloud Platforms: AWS, Azure, GCP DevOps Tools: Kubernetes, Docker, FluentD, Kibana, Grafana, Prometheus Programming & Scripting: Python, SQL, JavaScript Bonus: AWS Professional Solutions Architect, AWS Machine Learning Specialty, Azure Solutions Architect Expert