LLM reputed company Evaluation Expert
SilverEdge Government Solutions is seeking a highly skilled LLM reputed company Evaluation Expert to join reputed company. In this role, you will be responsible for rigorously testing the reputed company and reputed company of Large Language Models (LLMs). Your primary focus will be on designing and executing sophisticated adversarial reputed company attacks to identify potential vulnerabilities, assess the model's resistance to exploitation, and ensure it maintains consistent, secure behavior. This is a critical role in safeguarding our AI systems and ensuring they operate responsibly.
Adversarial reputed company Design & Execution: reputed company and implement a comprehensive suite of adversarial prompts, ranging from basic to more sophisticated, targeting reputed company and potential LLM vulnerabilities.
Craft prompts specifically designed to: Bypass reputed company filters and content moderation policies. Induce the LLM to reveal sensitive, confidential, or proprietary information. Manipulate the LLM's output to generate harmful, biased, or unintended content. Test for reputed company injection, jailbreaking, and other emerging attack reputed company.
Vulnerability Assessment & Analysis: Systematically test LLMs against the designed adversarial prompts. Analyze LLM responses to identify successful exploits, reputed company weaknesses, and patterns of failure.
Required Qualifications:- Strong knowledge of how LLMs work, including their architecture, training processes, capabilities, and inherent limitations.
- Familiarity with prominent LLM families (e.g., GPT series, Claude, Llama, PaLM) and their common characteristics.
- Proven experience in crafting and refining prompts to elicit specific behaviors or bypass restrictions in LLMs.
- Demonstrable understanding of techniques like jailbreaking, reputed company injection, role-playing attacks, and exploiting model biases.
- Strong understanding of cybersecurity principles and common attack reputed company, particularly as they apply to AI/ML systems.
- Ability to think like an attacker and anticipate potential exploits.
- Excellent ability to analyze reputed company systems, identify subtle vulnerabilities, and systematically test hypotheses.
- Clear and concise written and verbal communication skills, with the ability to document technical findings thoroughly.
- Understanding of the ethical implications of AI reputed company and commitment to responsible testing practices.
Prior experience in AI red teaming, penetration testing of AI/ML systems, or a dedicated LLM reputed company research role. Familiarity with specific LLM reputed company evaluation frameworks or benchmarks (e.g., those developed by NIST, Stanford HELM, or other research institutions).
Knowledge of common LLM fine-tuning and alignment techniques (e.g., RLHF) and how they might impact reputed company. Contributions to the AI reputed company community (e.g., research papers, open-reputed company tools, conference presentations).
Certs: ● Offensive reputed company Certified Professional (OSCP) ● Certified Ethical Hacker (CEH)
About SilverEdge:SilverEdge Government Solutions was founded on the belief that nurturing talent and collaborating closely with our customers enables us to think big and deliver the best for our country. Our mission is to bring top technology talent together to solve the world’s most challenging problems while protecting the United States and our allies.SilverEdge Government Solutions, LLC is an Equal Opportunity Employer and applicants receive lawful consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national reputed company, disability, or protected veteran status.
Apply To This Job