QA Engineer, AI – Platform Infrastructure
Job Description:
- Subject Matter Expert for the design, maintenance, and implementation of automated and manual test frameworks covering backend APIs, frontend components, containerized services, and AI/LLM-powered workflows.
- Design, implement, and maintain CI/CD-integrated QA pipelines using Docker Compose and Kubernetes environments.
- Conduct performance and load testing for containerized and GPU-enabled applications, identifying bottlenecks and reliability risks.
- Validate AI workflow correctness, including LangChain pipelines, CrewAI task orchestration, and LlamaIndex document processing flows.
- Develop internal testing tools and frameworks in TypeScript, Python, or Bun to improve platform reliability and developer velocity.
- Reproduce, isolate, and report defects with high-quality context; work closely with developers to drive rapid resolution.
- Consult and collaborate with SMEs across Engineering, Product, DevOps, and AI/ML teams to define quality standards and establish test plans for new services and UI components.
- Lead the creation, modification, and maintenance of QA documentation, including test plans, test case libraries, defect reports, and quality metrics dashboards.
- Influence cross-functional groups regarding testability, technical feasibility, and quality requirements during design and development phases.
- Assist with the planning and implementation of QA-driven process improvements and tooling upgrades in collaboration with cross-functional teams.
- Lead integration, regression, and acceptance testing activities for new features and infrastructure changes.
- Provide technical mentoring and oversight to less experienced engineers on testing best practices, tooling, and defect management.
- Create, edit and adhere to Standard Operating Procedures (SOPs), process improvements, and standardization of templates.
- Performs ad-hoc and cross-functional duties and/or projects assigned to support business needs and provide developmental opportunities.
Requirements:
- Bachelor’s degree in computer science, Software Engineering, or a related field is required.
- 3+ years of experience in software QA or test automation is required.
- Experience with containerized environments (Docker, Docker Compose, Kubernetes) is required.
- Experience with Python and TypeScript for writing tests and automation scripts is required.
- Experience with modern web frameworks (React, Next.js, Svelte) and E2E/UI testing tools such as Playwright or Cypress is required.
- Experience with CI/CD workflows (GitHub Actions, Jenkins, or similar) is required.
- Experience with AI systems testing, particularly LangChain, CrewAI, or LlamaIndex, is preferred.
- Experience with performance testing or benchmarking AI-driven applications is preferred.
Benefits:
- Medical, Dental and Vision Plan Options
- Health and Financial Wellness Programs
- Employer Assistance Program (EAP)
- Company Paid and Voluntary Life/AD&D, Short-Term and Long-Term Disability
- Healthcare and Dependent Care Flexible Spending Accounts
- 401(k) Retirement Plan with Company Match
- 529 Education Savings Program
- Voluntary Legal Services, Identity Theft Protection, Pet Insurance and Employee Discounts, Rewards and Perks
- Paid Time Off (PTO) includes: 11 Holidays
- Exempt Employees are eligible for Unlimited PTO
- Non-Exempt Employees are eligible for 10 Vacation Days, 56 Hours of Health Pay, 2 Personal Days and 1 Cultural Day