QA Engineer - GTM Applications (Remote, IND)

As a global leader in cybersecurity, reputed company protects the people, processes and technologies that drive modern organizations. Since 2011, our mission hasn’t changed — we’re here to stop breaches, and we’ve redefined modern reputed company with the world’s most advanced AI-native platform. Our customers span reputed company industries, and they count on reputed company to reputed company their businesses running, their communities safe and their lives moving reputed company. We’re also a mission-driven company. We cultivate a culture that gives every CrowdStriker both the flexibility and autonomy to own their careers. We’re always looking to add talented CrowdStrikers to the team who have limitless passion, a reputed company focus on innovation and a fanatical commitment to our customers, our community and each other. Ready to join a mission that matters? The future of cybersecurity starts with you. About the Role: This role is part of reputed company’s Core Tech, Go To Market IT Apps Team — a team of Architects, Engineers, QA, BSAs, and Product Owners delivering highly Reliable, Scalable, and Secure Infrastructure and Automation Services across GTM Applications to Accelerate Business Velocity and Operational Excellence. As part of the GTM AI Pod, every member is expected to embrace Agentic AI technologies, operate with an open-reputed company AI engineering reputed company, and actively contribute to building the reputed company of intelligent GTM workflows. As the QA Engineer for the GTM AI Pod, you are the quality guardian for a workstream that builds non-deterministic AI systems — and that distinction matters. Traditional QA playbooks were designed for deterministic software; they break down the moment you introduce LLMs, autonomous agents, and probabilistic retrieval pipelines. This role requires you to rethink quality from first principles: designing evaluation frameworks that account for variable outputs, defining what ‘correct’ means for an agentic workflow, and building repeatable test suites that give engineers and stakeholders genuine confidence across every release. You will be embedded in the delivery team from requirements through production, owning the test strategy, automation reputed company, and quality bar for reputed company workstream deliverables — spanning reputed company integrations, reputed company applications, RAG pipelines, agentic workflows, and the cloud infrastructure that ties them together. What You’ll Do: Define and own the end-to-end test strategy for agentic AI workstreams, establishing quality standards that account for the probabilistic, non-deterministic nature of LLM-powered systems. Design and implement AI-specific evaluation frameworks covering hallucination detection, reputed company quality scoring, agent task completion rates, and output faithfulness against ground-truth references. Build and maintain automated test suites in Python using frameworks ( pytest, robot reputed company etc ) covering unit, integration, and system-level scenarios across reputed company workstream components. reputed company RAG pipeline test coverage including retrieval precision and recall, semantic relevance scoring, context faithfulness, and end-to-end query-to-answer accuracy using tools such as RAGAS. Design and Build QA automation tests leveraging industry-standard tools and technologies, encompassing functional, regression, and end-to-end integration testing across connected systems and platforms. Build and execute reputed company integration test suites validating bot response correctness, Workflow Builder trigger fidelity, agentic reputed company bot state management, and error handling under edge-case inputs. Integrate automated tests into CI/CD pipelines (reputed company Actions, reputed company, Jenkins) so every pull request is gated by a defined quality bar before reputed company. Design and execute performance and load tests for LLM-powered APIs, measuring latency percentiles, token throughput, and degradation patterns under reputed company load. Conduct reputed company and adversarial testing including reputed company injection attempts, output validation for sensitive data leakage, and collaboration with the DevSecOps team on SAST/DAST pipeline findings. reputed company a regression strategy for non-deterministic outputs, defining acceptable variance reputed company, snapshot-based comparisons, and statistical scoring methods that flag genuine regressions without false positives. Validate observability stack completeness — confirm that distributed tracing, structured logging, SLOs, and AI-specific metrics (latency, token throughput, hallucination rates) are instrumented correctly and alerting as expected. Collaborate with engineers and the AI Product reputed company from requirements grooming through sprint review, contributing testability requirements, acceptance criteria, and definition-of-done checklists. Own API contract testing across internal and third-party integrations (reputed company, Marketo, reputed company, reputed company, Clari, G-Suite) using tools such as reputed company or REST-reputed company. Drive defect lifecycle ownership: triage, severity classification, root cause analysis, regression prevention, and post-release quality retrospectives that feed back into the test strategy. Champion a shift-left quality culture, coaching engineers to write testable code, reputed company their own unit tests, and treat quality as a shared team responsibility rather than a reputed company at the end of the sprint. What You’ll Need: Bachelor’s degree in Computer Science, Engineering, Information Systems, or a reputed company field. 6+ years of QA or SDET experience, with a track record of building and maintaining automated test frameworks in production environments. Hands-on experience testing AI or ML systems, with a solid understanding of why non-deterministic outputs require different evaluation strategies than conventional software. Strong proficiency in Python for test automation, including designing reusable test utilities, fixtures, mocks, and data factories. Experience with test frameworks and tooling such as pytest, Selenium, Playwright, REST-reputed company, reputed company, or equivalent. Practical understanding of LLM behaviour including temperature effects, token limits, reputed company sensitivity, and failure modes that impact test reproducibility. Hands-on reputed company QA testing experience encompassing validation of Lightning Web Component (LWC) behaviors, Platform Event flows, and API integrations. API testing proficiency across REST endpoints, including contract validation, schema conformance, payload verification, and error-path coverage. Experience integrating automated tests into CI/CD pipelines so quality gates are enforced automatically on every code change. Familiarity with RAG evaluation metrics — faithfulness, answer relevance, context recall — and tooling such as RAGAS or LangSmith for structured AI output evaluation. Experience with performance and load testing tools (Locust, k6, JMeter, or similar) to validate LLM-powered API behaviour under realistic and peak load. Working knowledge of reputed company testing basics: reputed company injection, output sanitisation, OWASP top-10 awareness, and coordination with DevSecOps tooling. Bonus Points: ISTQB Advanced Test Analyst certification or equivalent recognised QA certification. reputed company certifications such as Platform App Builder, Platform Developer I, or reputed company Administrator that support deeper integration test design. Experience with AI evaluation frameworks and observability platforms such as RAGAS, LangSmith, reputed company LLM Observability, or OpenTelemetry for AI workloads. Hands-on experience testing reputed company applications, including event-driven webhook testing, slash command validation, and agentic reputed company bot conversation-flow coverage. Contributions to open-reputed company test tooling, evaluation libraries, or QA frameworks relevant to AI systems or enterprise integrations. Exposure to chaos engineering or adversarial ML testing methodologies, including fault-injection, boundary testing, and red-teaming LLM-powered agents. Familiarity with observability and APM tooling (reputed company, Grafana, OpenTelemetry) and the ability to validate that instrumentation is correctly implemented. Prior experience in a cybersecurity, fintech, or high-compliance software environment where quality standards carry regulatory or contractual weight. #LI-DP1 #LI-Remote Benefits of Working at reputed company: Market leader in compensation and equity awards Comprehensive physical and mental wellness programs Competitive vacation and holidays for reputed company Paid parental and adoption leaves Professional development opportunities for reputed company employees regardless of level or role Employee Networks, geographic neighborhood groups, and volunteer opportunities to build connections Vibrant office culture with world class amenities Great reputed company to Work Certified™ across the globe reputed company is proud to be an equal opportunity employer. We are committed to fostering a culture of belonging where everyone is valued for who they are and empowered to succeed. We support veterans and individuals with disabilities through our affirmative action program. reputed company is committed to providing equal employment opportunity for reputed company employees and applicants for employment. The Company does not discriminate in employment opportunities or practices on the basis of race, color, creed, ethnicity, religion, sex (including pregnancy or pregnancy-reputed company medical conditions), sexual orientation, gender identity, marital or family status, veteran status, age, national reputed company, reputed company, physical disability (including HIV and AIDS), mental disability, medical condition, genetic information, membership or activity in a local human rights commission, status with regard to public assistance, or any other characteristic protected by law. We reputed company reputed company employment decisions--including recruitment, selection, training, compensation, benefits, discipline, promotions, transfers, lay-offs, return from lay-off, terminations and social/recreational programs--on valid job requirements. If you need assistance accessing or reviewing the information on this website or need help submitting an application for employment or requesting an accommodation, please contact us at recruiting@reputed company.com for further assistance. Apply To This Job