Remote_QA tester-AI Agentic Job at Themesoft Inc, Denver, CO

UFNhZmNKQmN5R1pGaW5qS1ZRNlJGaE8zc2c9PQ==
  • Themesoft Inc
  • Denver, CO

Job Description

Hello,

Our client is seeking an experienced professional with the skill set outlined below. If you are interested in this opportunity, please review the job description and share your updated resume along with your contact details.

Role: AI Agentic Tester

Location: Denver, CO

Skills: QA/Test Engineering experience

Must have- Experience testing Generative AI, LLM, or AI-based applications.

Keyword:

Skills: Modern Functional Quality Engineering Experience Required: 2-4 Years

PFB the responsibilities and skills needed:

Functional Testing

• Validate AI agent workflows against business requirements.

• Test end-to-end AI use cases, including multi-agent interactions.

• Verify task completion accuracy and output quality.

• Test agent orchestration, tool calling, and workflow execution.

• AI Model Validation

• Evaluate LLM responses for accuracy, relevance, and consistency.

• Test prompt engineering effectiveness and response quality.

• Validate Retrieval-Augmented Generation (RAG) outputs.

• Measure hallucination rates and response reliability.

Required Skills

• 3-8 years of QA/Test Engineering experience.

• Experience testing Generative AI, LLM, or AI-based applications.

• Knowledge of AI Agents, Agentic AI, RAG, and prompt engineering.

• Hands-on experience with API testing (Postman, Swagger, REST APIs).

• Experience with automation frameworks (Selenium, Playwright, PyTest).

• Proficiency in Python.

• Understanding of AI evaluation metrics and testing methodologies Knowledge of Azure OpenAI, AWS Bedrock, Gemini, or similar AI platforms

Email me for prompt response.

Thanks & Regards,

__________________

Rupesh Mourya

rupesh@themesoft.com

Job Tags

Remote work

Similar Jobs

Johns Hopkins Medicine

Community Social Worker Job at Johns Hopkins Medicine

 ...competitive and affordable benefits program that supports your health, financial security, and overall well-being. ~$5,000 sign-on bonus...  ...working with individuals with multiple comorbidities and mental health/substance use conditions preferred LICENSES & CERTIFICATIONS... 

Merck & Co.

Associate Specialist, Cybersecurity Operations Job at Merck & Co.

Job DescriptionJob DescriptionAs part of the Cyber Fusion Center (CFC), the Operational Technology (OT) Cyber Security Analyst supports efforts to identify, analyze, and remediate cyber security risks across manufacturing and OT environments.This role works closely with...

Confidential

Travel Laboratory Technologist Medical Technologist Job Job at Confidential

 ...Job Description Are you a skilled Laboratory Technologist seeking an exciting opportunity as a Medical Technologist in beautiful Helena, Montana? TLC Nursing has the perfect travel healthcare assignment for you!In this 13-week assignment, you will play a crucial role... 

The Carpenter Health Network

Hospice Aide (CNA) Job at The Carpenter Health Network

 ...Now hiring PRN Hospice Aide CNA in Baton Rouge, LA ! Why Join Us? At The Carpenter House , we invest in our people through an Employee Stock Ownership Plan (ESOP) - a unique benefit that makes you a true employee-owner. As part of our team, you'll receive... 

Professional Alternatives

CFO Job at Professional Alternatives

 ...Job ID#: 39201 Chief Financial Officer (CFO) Location: Houston, TX Industry: Industrial / Manufacturing Compensation: $225,000 $250,000 Base Salary + Management Incentive Plan (MIP) Company Overview We are a well-established, privately held industrial...