Senior LLM Engineer

Job Description

Role Overview:

We are looking for AI Engineers with strong experience in AI, Machine Learning, Deep Learning ,LLM, Agentic AI and software development (Python) to join our team. This role involves designing, developing, training, and deploying language models, as well as building the frameworks and libraries that support them.

Responsibilities:

·        Develop and optimize large language models using advanced techniques such as RAG (Retrieval-Augmented Generation) with hybrid vector stores and traditional databases.

·        Create and maintain Python libraries that facilitate model training, evaluation, and deployment.

·        Utilize platforms like axolotl and unsloth for model training, and vllm for model serving.

·        Design comprehensive training data sets for various cybersecurity use cases.

·        Evaluate LLM performance using both qualitative insights and quantitative metrics.

·        Develop APIs using FastAPI for efficient model integration and interaction within our applications.

Qualifications:

·        2+ years of professional experience

·        Deep expertise in machine learning, natural language processing, and software development.

·        Proficient in Python with strong experience developing reusable libraries.

·        Experience with API development, preferably using Fast API.

·        Solid foundation in developing and deploying AI models in production environments.

Preferred Skills:

·        Familiarity with QLORA, LORA, RAG, Transformers, axolotl, unsloth, and vllm.

·        Understanding of cybersecurity principles and applications, though not mandatory.

·        Proven track record of designing complex AI solutions within product architectures.

·        Ability to work effectively in fast-paced and collaborative startup environments.

·        Software Knowledge on python

·        Ability to architect the full LLM solution within our broader product ecosystem, ensuring seamless integration and scalability for senior roles.