Key Responsibilities
AI Solution Delivery
* Lead end-to-end delivery of GenAI and LLM-powered projects
* Design and implement enterprise chatbot solutions
* Translate business needs into AI-driven digital solutions
* Define project roadmaps aligned with internal stakeholders
* Manage solution rollout, adoption, and continuous enhancement
Business Analysis & Functional Design
* Gather, analyze, and document business requirements
* Convert requirements into functional specifications
* Create actionable user stories, backlog items, and acceptance criteria
* Understand operational workflows and design solutions for real-world usage
LLM & Prompt Engineering
* Design, refine, and optimize prompts for LLM workflows
* Build and improve RAG (Retrieval-Augmented Generation) pipelines
* Develop evaluation frameworks for response quality and groundedness
* Improve model performance through iterative testing and tuning
Testing, Monitoring & Quality Assurance
* Define and execute testing strategies for LLM solutions
* Build golden datasets, regression tests, and adversarial prompt tests
* Monitor latency, response quality, costs, and safety risks
* Establish evaluation metrics such as:
* Accuracy proxies
* Groundedness
* Response quality rubrics
* Safety compliance
Stakeholder Collaboration
* Work closely with:
* Internal AI Center of Expertise
* Data & ML teams
* Security & architecture teams
* IT colleagues
* Business stakeholders
* Present technical concepts clearly to non-technical teams
* Create awareness and AI adoption within the Life department
Documentation & Knowledge Transfer
* Prepare:
* Playbooks
* Training materials
* Operational runbooks
* Technical documentation
* Ensure effective knowledge transfer to internal teams
Professional Experience
* 5–8 years of relevant experience
* Minimum 2+ years of hands-on experience with GenAI / LLM solutions
* Proven experience in:
* Business Analysis
* Solution Engineering
* Digital Product Delivery
* Experience delivering conversational AI / chatbot solutions end-to-end
* Strong Agile delivery experience
* Experience in regulated environments is highly preferred
Technical Skills
* Python
* SQL
* LLM & Generative AI solutions
* Microsoft Office 365
* Microsoft Copilot M365
* Power BI
* Azure DataBricks
* Azure Data Lake
* Data reporting and analytics tools
* AI testing frameworks and evaluation methods