Data Scientist with LLM & RAG

Role - Data Scientist with LLM & RAG
Location - Sunnyvale, CA
Contract - 6-12 Months
Responsibilities
• Develop & Optimize LLM Applications: Design and implement LLM-powered applications using state-of-the-art models, ensuring efficiency and scalability.
• RAG System Development: Build and fine-tune Retrieval-Augmented Generation (RAG) pipelines for enhanced contextual accuracy and retrieval efficiency.
• Red Team Testing & Security Assessments: Conduct adversarial testing to uncover vulnerabilities such as prompt injection, jailbreaks, data leakage, and bias exploitation.
• Testing with Security Tools: Utilize Garak, PyRIT, Giskard, and other adversarial testing frameworks to evaluate LLM security and model robustness.
• Threat Analysis & Risk Mitigation: Identify LLM security risks, propose mitigation strategies, and work closely with engineering teams to implement secure AI solutions.
• Model Fine-tuning & Guardrails: Implement guardrails, prompt filtering, and defensive techniques to enhance the security posture of deployed LLM applications.
• Collaboration with AI & Security Teams: Work alongside ML Engineers and Data Scientists to integrate security best practices into AI pipelines.
• Performance & Compliance Monitoring: Ensure LLM applications meet security, compliance, and ethical AI standards (e.g., GDPR, AI Act).Required Skills & Experience:
• Strong experience in LLM application development and RAG architecture.
• Hands-on experience in Red Team testing for LLM security vulnerabilities.
• Proficiency with adversarial testing tools like Garak, PyRIT, and Giskard.
• Deep understanding of LLM security risks, including prompt injection, data exfiltration, and model manipulation.
• Solid programming skills in Python, with experience in Hugging Face, LangChain, LlamaIndex, or similar frameworks.
• Knowledge of cybersecurity principles, AI security guidelines, and risk assessment methodologies.
• Experience in ML model evaluation, monitoring, and compliance.
• Strong problem-solving skills with an analytical mindset.Preferred Qualifications:
• Previous experience in LLM security research or penetration testing of AI models.
• Background in NLP, information retrieval, and AI ethics.
• Familiarity with secure model deployment in cloud environments.
Diverse Lynx LLC is an Equal Employment Opportunity employer. All qualified applicants will receive due consideration for employment without any discrimination. All applicants will be evaluated solely on the basis of their ability, competence and their proven capability to perform the functions outlined in the corresponding role. We promote and support a diverse workforce across all levels in the company.