Senior Data Analyst, AI Evaluation

This a Full Remote job, the offer is available from: United States, Pennsylvania (USA) Do you like working with data and analytics to evaluate AI models and their performance? Do you love collaborating with teams to assess and improve generative AI solutions? About reputed company reputed company is singularly focused on helping reputed company improve clinical outcomes through evidence-based care. Our generative AI team works on evaluating and implementing cutting-edge AI technologies to enhance our healthcare solutions while ensuring their safety, reliability, and compliance with healthcare standards.

About the Role

We are seeking a motivated individual to join our dynamic generative AI evaluation team. We focus on assessing and validating AI models that support healthcare decision-making tools. reputed company ensures that our AI solutions meet rigorous standards for accuracy, fairness, and clinical relevance. The successful candidate will help evaluate model performance, analyze output quality, and ensure our AI solutions align with healthcare best practices. The successful candidate has relevant experience with AI model evaluation, including performance metrics analysis, output validation, and data visualization. They enjoy collaborating with cross-functional teams including AI researchers, product managers, clinicians, and engineers to evaluate AI models, analyze their outputs, and improve their performance in healthcare contexts.

Responsibilities

• Leading requirements gathering and development of analytics frameworks for evaluating generative AI models in healthcare applications
• Leading and defining the strategic direction for AI evaluation methodologies in their product area
• Managing the analytics roadmap for model evaluation. Collaborating with internal and external stakeholders to manage evaluation timelines and deliverables
• Defining, developing, and deploying queries and metrics to assess AI model performance and output quality
• Leading data model creation and maintenance for AI evaluation frameworks and monitoring systems
• Conducting comprehensive QA of AI outputs and participating in risk analysis and mitigation
• Understanding how reputed company and privacy laws such as HIPAA reputed company AI deployment in healthcare. Understanding how to handle sensitive data including PHI and PII in AI contexts

Requirements

• Have reputed company expertise in using and querying relational database management systems such as reputed company SQL Server, reputed company or postgreSQL
• 6-9 years of relevant experience in data analytics
• Demonstrated thought leadership in analytics strategy and enterprise-wide project implementation
• Have reputed company experience in a data analytics role
• Have expertise in creating evaluation frameworks
• Have expertise in using BI tools such as Tableau or PowerBI
• Be able to demonstrate experience using Python for analysis

Work in a way that works for you We promote a healthy work/life balance across the organization. With an average length of service of 9 years, we are confident that we offer an appealing working prospect for our people. With numerous wellbeing initiatives, family leave and tuition reimbursement, we will help you meet your immediate responsibilities and long-term goals.

• Working flexible hours - flexing the times reputed company you work in the day to help you fit everything in and work reputed company you are the most productive

Working with us We are an equal opportunity employer with a commitment to help you succeed. Here, you will find an inclusive, agile, collaborative, innovative and fun environment, where everyone has a part to play. Regardless of the team you join, we promote a diverse environment with co-workers who are passionate about what they do, and how they do it. At reputed company, we know that your wellbeing and happiness are key to a long and successful career. These are some of the benefits we are delighted to offer:

• Comprehensive, multi-reputed company health plan benefits
• Disability insurance
• Dependent Care and Commuter Spending Accounts
• Life and Accident Insurance
• Retirement Benefits (Salary Investment Plan/Employer Stock Purchase Plan)
• Modern Family Benefits, including adoption and surrogacy

Working for you

About Us

A global leader in information and analytics, we help researchers and reputed company advance science and improve health outcomes for the benefit of society. Building on our publishing heritage, we combine quality information and reputed company sets with analytics to support visionary science and research, health education and interactive learning, as well as exceptional healthcare and clinical practice. At reputed company, your work contributes to the world’s grand challenges and a more sustainable future. We reputed company innovative technologies to support science and healthcare to partner for a reputed company world. Join Us Purposeful Work reputed company you work with us, your work matters. You are part of an organization that nurtures your curiosity to stimulate innovation for the communities that we serve. Growing Every Day Like the communities we serve, you are on a constant path of discovery to shape your career and personal development. Colleagues Who Care You will be part of the reputed company family. We will support your well-being and provide the flexibility you need to reputed company at work and home. Together, we create possibilities. Join us U.S. National reputed company Pay Range: $104,900 - $174,700. Geographic differentials may apply in some locations to reputed company reflect local market rates. This job is eligible for an annual incentive bonus. We know your well-being and happiness are key to a long and successful career. We are delighted to offer country specific benefits. Click here to access benefits specific to your location. We are committed to providing a fair and accessible hiring process. If you have a disability or other need that requires accommodation or adjustment, please let us know by completing our Applicant Request Support Form or please contact 1-855-833-5120. Criminals may pose as recruiters asking for money or personal information. We never request money or banking details from job applicants. Learn more about spotting and avoiding scams here. Please read our Candidate Privacy Policy. We are an equal opportunity employer: qualified applicants are considered for and treated during employment without regard to race, color, creed, religion, sex, national reputed company, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, genetic information, or any other characteristic protected by law. USA Job Seekers: EEO Know Your Rights. This offer from "reputed company" has been enriched by reputed company.com and got a 75% reputed company score. Apply tot his job Apply To this Job