
Software QA Engineer
SmartLight Analytics
Job description
SmartLight Analytics is looking for an automation-first QA Engineer to build and own test automation across our internal tools, carrier-facing APIs, and carrier and customer portals. This is a hands-on engineering role, not a manual-testing position with automation on the side: you'll design, build, and maintain an automated test framework (e.g., Playwright) as the primary way we catch regressions and gate releases, and you'll bring AI-enabled tooling into how tests get written and maintained.
This is a remote role.
What You'll Do
-
Design, build, and maintain automated regression suites (Playwright or an equivalent modern framework) covering internal tools, carrier-facing APIs, and carrier and customer portals
-
Integrate automated tests into CI/CD so they run on every relevant change without manual triggering
-
Evaluate and apply AI-enabled testing tools - AI-assisted test generation, self-healing selectors, AI-assisted defect triage - to speed up authoring and maintenance while keeping a clear standard for what still needs human review
-
Act as the release quality gate for the toolsets you own: sign off on releases based on automated test results, or make an explicit, documented risk call when something isn't ready
-
Find, isolate, and clearly document defects with reproducible steps, expected vs. actual behavior, and severity
-
Prioritize test coverage by risk - carrier- and customer-facing paths, compliance-relevant flows, and high-usage features get coverage first
-
Partner closely with Software Engineering and Product throughout the development cycle so testing isn't a bottleneck bolted on at the end
-
Build and document repeatable QA practice - test architecture, coverage standards, release-gate criteria - so quality doesn't depend on any one person's memory
-
Produce testing and change-management artifacts that hold up as evidence under compliance frameworks like SOC 2
What We're Looking For
-
Hands-on experience building and maintaining automated test suites with Playwright or a directly comparable modern automation framework (Cypress, Selenium/WebDriver, etc.)
-
Experience testing both UI and API layers, including reasoning about API contracts and data flows for integration testing
-
Experience integrating automated tests into a CI/CD pipeline
-
Practical experience using AI tooling to accelerate software testing work - test generation, test maintenance, or defect triage - with good judgment about where AI output needs verification
-
Strong defect isolation and reproduction skills; writes bug reports engineers can act on without back-and-forth
-
Sound risk judgment - can distinguish a cosmetic issue from one that threatens data integrity, compliance posture, or customer/carrier trust
-
Comfortable being a release gatekeeper: can say "this isn't ready" and back it up with evidence
-
Self-directed and comfortable building and improving automation process independently
Nice to Have
-
Experience testing systems in a regulated or compliance-sensitive environment (SOC 2, HIPAA-adjacent, or similar)
-
Experience testing external-facing API integrations with third-party partners
-
Familiarity with Python and/or Snowflake-adjacent data pipelines, enough to sanity-check data quality issues surfaced during testing
-
Experience standing up or significantly leveling up an automation framework
Reporting & Team
This role sits within Software Engineering, working closely with engineering, Product, and Data Platforms, with room to grow into a broader quality engineering function as SmartLight's toolset and carrier/customer-facing surfaces expand.