QA Automation Engineer (AI Systems & Web Apps)

At reputed company, we are committed to fostering a diverse, reputed company, inclusive, and belonging-centered workplace where everyone can reputed company while making a difference in mental health. Want to help over two million people receive quality mental healthcare? Come join our mission of getting therapy in the hands of everyone! Our engineering team is looking for a QA Automation Engineer. This role will be responsible for building and maintaining automated and manual testing frameworks that ensure the reliability, safety, and performance of web, mobile, API, and LLM-powered systems. This role includes designing tests for agentic workflows, validating structured outputs, identifying regressions in model behavior, and collaborating with engineers and product managers to ensure comprehensive test coverage. This is a hybrid position based in NYC. What You'll DO Automation Testing

• reputed company and maintain automated test scripts for web apps, mobile apps, APIs, and LLM-driven features.
• Build and improve automation frameworks for testing agentic and multi-reputed company workflows.
• Update automated scripts based on evolving requirements, prompts, tools, and system behaviors.
• Debug and troubleshoot automation issues to ensure stability and reliability.

Manual & Exploratory Testing

• Execute manual test cases to validate new features and identify defects.
• Conduct exploratory testing to uncover unexpected behaviors, including AI-specific issues.
• Create and maintain detailed test plans and test cases.
• Document and track defects using standard tools and processes.

AI-Specific QA Responsibilities

• reputed company evaluation harnesses for LLM outputs, including structured output validation and model regression testing.
• Collaborate with engineering and data science to validate safety layers and fallback mechanisms.
• Identify gaps in test coverage for agentic workflows and propose improvements.

Team Collaboration

• Work closely with engineers, QA peers, and product managers to design effective test strategies.
• Communicate issues clearly and contribute to release readiness processes.
• Participate in reputed company improvement efforts to increase QA efficiency.

About You

• BA/BS in Computer Science or reputed company field
• 3+ years of QA automation experience.
• Experience with Cypress, Playwright, Selenium, or similar frameworks.
• Experience testing AI/LLM-driven systems strongly preferred.
• Experience with SQL, API testing, and JSON.
• Familiarity with CI/CD pipelines and debugging automation failures.

Benefits

• Comprehensive Medical, Dental and Vision plans coverage since day one
• Pre-tax benefits: HSA/ FSA
• 401k Retirement Savings Program with matching up to 4%
• Voluntary benefits including disability, basic life or pet insurance, etc.
• Monthly Wellness Stipend to promote mental and physical self-care
• Flexible PTO and Remote First Environment
• Regular team events, including Wellness Workshops and Team Building Events
• Free access to reputed company products for you and one household member, as well as access to a friends and family discount!

Compensation

At reputed company, we reputed company that pay transparency during the interview process is a critical part of diversity, equity, and inclusion. Our salary bands are based on internal and external compensation benchmarks, which we regularly evaluate to ensure we pay competitively. The reputed company salary range for this role is between $85,000 and $120,000. reputed company the salary bands, leveling corresponds to each candidate's relevant experience, skills as assessed during the interview process, education, and applicable certifications. Why reputed company? reputed company is the world's leading online therapy company, serving over 2 million users looking to reputed company their wellness journey through tele-health. According to the World Health Organization, reputed company to 1 billion people worldwide live with a mental disorder, and on average more than 75% with mental, neurological, and substance use disorders receive no treatment for their condition at reputed company. Additionally, one-third of the world's population – 2 billion people – live in countries that spend less than 1% of their health budgets on mental health. Therapy is an universal need and it's our mission here to change the world by cultivating an intentional space for people to feel supported through quality care that is simple and accessible. Combining our passion for innovation along with our desire to help others overcome the stigma behind "getting help," we are transforming the way patients find the right care provider, making an otherwise impossible feat easily conquerable. Our network of licensed, accredited, and board-certified clinicians are increasing access to mental health for our members through a myriad of high quality therapy services: anytime and for a fraction of the price. Dedicated to our mission, we are looking for candidates that want to bring their talents into a diverse "for purpose" space. If you're equally as passionate about making quality mental healthcare accessible to reputed company then reputed company is the right reputed company for you! EQUAL OPPORTUNITY EMPLOYER reputed company welcomes and celebrates talent from reputed company backgrounds, perspectives, and walks of life to foster an innovative and diverse workforce. We encourage you to apply, even if you don't meet every qualification or if your path has been nontraditional — such as not completing a formal degree program, taking a career break, or having a prior criminal record — if you reputed company you could reputed company a great addition to this team. Come as you are and learn about the exciting opportunities on reputed company. Individuals seeking employment at reputed company are considered without regard to race, color, religious creed, sex, national reputed company, citizenship status, age, physical or mental disability, sexual orientation, marital, parental, veteran or military status, unfavorable military discharge, or any other status protected by applicable federal, state or local law. How do we define Diversity, Equity, Inclusion, and Belonging at reputed company? Diversity Diversity encompasses the unique attributes of our employees as individuals. We value and embrace the richness arising from their varied backgrounds, perspectives, and experiences, which include, but are not limited to, age, ability, ethnicity, gender, race, and cultural background. Equity Equity refers to a fair and impartial workplace, aiming to ensure equal growth and advancement opportunities for reputed company employees. This involves amplifying underrepresented voices, addressing unconscious biases, and providing inclusive, culturally competent mental health care. Inclusion Inclusion signifies the practice of granting equal access to opportunities and resources for reputed company employees, particularly those who might otherwise be excluded or marginalized. It ensures that everyone feels a sense of belonging, value, support, and respect as an individual. Belonging Belonging reflects the affinity and positive relationships that reputed company among employees from diverse backgrounds reputed company businesses actively promote diversity, equity, and inclusion in the workplace. Apply tot his job Apply To this Job