Solution Architect (NVIDIA H100 Specialist) | Experince: 12 Years | Location: Pan India | Work Mode: Hybrid

Job Title: Solution Architect (NVIDIA H100 Specialist)

Experience: 12+ Years

Location: Pan India

Work Mode: Hybrid

Role Overview

We are seeking a highly experienced Solution Architect to own and drive end-to-end architecture across hybrid enterprise environments.

This role requires deep expertise in on-prem NVIDIA H100 GPU cluster architecture, hybrid cloud design, AI/ML system architecture, and large-scale distributed systems.

The ideal candidate will define workload boundaries between GCP and on-prem environments, govern integrations across OT systems, GPU platforms, and cloud infrastructure, and lead architectural governance across stakeholders.

Project Responsibilities

• Own end-to-end architecture across all capabilities
• Design and drive on-prem NVIDIA H100 GPU cluster architecture
• Define GCP vs on-prem workload boundaries based on data classification
• Govern integration between:
• OT systems
• GPU platforms
• Cloud environments
• Lead architecture design reviews
• Manage risk tracking and mitigation strategies
• Align stakeholders across engineering, security, and business teams
• Ensure scalability, performance, security, and compliance

Must Have Skills

1. NVIDIA GPU Ecosystem (Mandatory)

• Hands-on experience with NVIDIA H100 clusters
• Strong understanding of:
• GPU-based distributed training
• High-performance compute (HPC) architecture
• NVIDIA AI stack
• Experience with:
• NVIDIA NeMo
• NVIDIA Modulus
• GPU orchestration and workload optimization

2. Distributed Systems & Hybrid Architecture

• Large-scale distributed system design
• Hybrid on-prem + cloud architecture
• High availability and fault-tolerant systems
• Performance optimization at scale

3. Kubernetes (On-Prem) & GCP

• On-prem Kubernetes architecture
• Google Kubernetes Engine (GKE)
• Container orchestration at enterprise scale
• Multi-cluster management
• Hybrid workload deployment strategies

4. AI/ML System Design

• LLM architecture design
• RAG (Retrieval-Augmented Generation) systems
• Agent-based AI systems
• Model deployment pipelines
• MLOps architecture

5. API Architecture

• RESTful API design
• gRPC-based systems
• Event-driven architecture
• Microservices patterns
• Integration frameworks

6. Security & Compliance

• NERC CIP fundamentals
• OT-IT security principles
• Data classification strategies
• Secure workload segregation
• Enterprise governance models

Good to Have

• Experience in Energy / Critical Infrastructure domain
• TOGAF Certification
• GCP Professional Architect Certification
• Experience with enterprise governance frameworks

Key Competencies

• Strategic architecture leadership
• Strong stakeholder management
• Risk assessment and mitigation
• Design documentation and governance
• Cross-functional collaboration
• Enterprise-level decision making

Required Experience & Qualifications

• 12+ years of experience in architecture roles
• Proven experience in hybrid cloud environments
• Mandatory hands-on exposure to NVIDIA GPU-based architecture
• Strong background in distributed systems
• Experience leading enterprise architecture initiatives
• Excellent communication and leadership skills