HealthRecon Connect provides technology-enabled Revenue Cycle Management solutions to US healthcare providers. The company leverages over 30 years of deep domain expertise, machine learning, AI, cutting-edge analytics, and automated workflows that help improve cash flow, patient outcomes and enable peace of mind for their clients. At HealthRecon Connect, day after day, we not only hold ourselves accountable for setting and maintaining high standards, but we also passionately strive for the highest achievement, customer delight and thrive on the challenge of high expectations and commitment to excel.
HealthRecon was certified a Great Workplace by Great Place to Work® Sri Lanka since 2018 and was adjudged one of the 40 Best Workplaces in Sri Lanka by Great Place to Work® Sri Lanka in 2021. We are also a participant of the United Nations Global Compact.
HRC Labs was established to lead the technological transformation of HealthRecon Connect (HRC). Propelled by the deep domain expertise and industry leading service capability of HRC, HRC Labs focus on enhancing the efficiency of healthcare delivery through intelligent automation solutions for healthcare providers. Our tools sustainably improve clients’ operating margins and cash flows by compressing their working capital cycle and reducing their administrative burden.
We are currently looking for a QA Engineer – AI Testing & Automation to join HRC focused on Revenue Cycle Management (RCM) technology automations and solutions.
Due to the large volume of applications we receive, all applications will be reviewed in the order in which they were received and only the candidates short-listed for the first round of interviews will be contacted. Thank you for your understanding.
Job Vacancy:
QA Engineer – AI Testing & Automation
Work Week:
Monday to Friday
Shift Window:
03:00 PM – 12:00 AM SLST (Straddle Shift)
Important: HealthRecon Connect currently operates under a hybrid work arrangement, with the number of remote workdays varying by team. However, depending on client deliverables and business needs, employees may be required to work on-site for all five weekdays.
By applying, you acknowledge and agree to be available for in-person work five days a week if required.
Other Features:
Full-time
US calendar applicable
Responsibilities:
- Test AI-driven products including LLMs, RAG systems, AI assistants, chatbots, and ML prediction features.
- Validate AI outputs for accuracy, relevance, consistency, hallucination, bias, safety, and business correctness.
- Test prompt behavior, system instructions, guardrails, model responses, and AI workflow quality.
- Work with local LLM tools such as Ollama, LM Studio, LocalAI, or similar platforms.
- Create AI test datasets, prompt regression suites, golden test sets, and evaluation rubrics.
- Perform functional, regression, integration, API, UI, database, and end-to-end testing.
- Build and maintain automation scripts using Selenium, Playwright, Cypress, REST Assured, PyTest, or similar tools.
- Use Java, Python, or JavaScript to support automation and technical validation.
- Validate APIs, databases, logs, and backend workflows.
- Use AI-powered QA tools to improve test case creation, automation support, defect analysis, and QA productivity.
- Identify risks, requirement gaps, and quality issues early.
- Work independently with minimum guidance and take ownership of assigned deliverables.
- Collaborate with developers, business analysts, product owners, and QA team members.
Qualifications/Criteria:
- Bachelor’s degree in computer science, Information Technology, or a related field
- Minimum of 3+ years of hands-on experience in manual and automation testing.
- 1+ year of experience testing AI, ML, LLM, chatbot, automation, or data-driven products is preferred.
- Good understanding of AI/ML/LLM concepts.
- Knowledge of RAG systems, embeddings, vector search, prompts, tokens, and hallucination risks.
- Hands-on experience with API testing and SQL.
- Automation experience using Selenium, Playwright, Cypress, REST Assured, PyTest, or similar tools.
- Programming knowledge in Java, Python, or JavaScript.
- Ability to analyze logs, troubleshoot issues, and validate backend data.
- Strong written and verbal communication skills.
- Ability to work independently and responsibly.
- Experience with vector databases.
2-3 years’ work experience