01Overview
APPIT Software Solutions is hiring a LLM Engineer in Bangalore, India. Develop and optimize large language model applications at APPIT Software in Bangalore, building intelligent text generation, summarization, and conversational AI systems for enterprise clients.
ResponsibilitiesBuild and integrate LLM-powered features into enterprise applicationsOptimize LLM inference performance through quantization, caching, and batching strategiesDevelop custom prompt templates and chain-of-thought reasoning workflowsImplement structured output parsing and validation for reliable LLM responsesEvaluate and benchmark different LLM providers for cost, quality, and latency trade-offsBuild LLM-powered data extraction and document understanding pipelinesRequirements3-5 years of software engineering experience with strong ML fundamentalsHands-on experience with LLM APIs (OpenAI, Anthropic, Google Gemini, or open-source models)Strong understanding of transformer architecture and tokenizationExperience with LLM serving frameworks (vLLM, TGI, or Ollama)Proficiency in Python and experience with async programming patternsKnowledge of embedding models and semantic search techniquesNice to HaveExperience with open-source LLMs (Llama, Mistral, Qwen)Knowledge of model distillation and compressionFamiliarity with LLM evaluation frameworks (HELM, lm-eval)About APPIT Software SolutionsAPPIT Software Solutions is a leading technology company building AI-powered enterprise products. Join 150+ professionals working on cutting-edge solutions in AI/ML, cloud computing, and digital transformation. We offer competitive salaries, flexible work arrangements, and opportunities for career growth across our global offices. .
