QA Analyst

QA Analyst

Location: Lindenwold, NJ 08021

Job Type: Full-time

Work Schedule: Monday–Friday. On-site for the first 90 days, then hybrid (in office Tuesday, Wednesday, and Thursday).

About the Role

CobbleStone Software is hiring a QA Analyst to join the QA & Release Team. The QA Analyst will test new features, enhancements, and bug fixes in CobbleStone Contract Insight®, the contract lifecycle management (CLM) software used by legal, procurement, and contract professionals in government and commercial organizations.

The role is roughly half manual testing and half test automation. The QA Analyst will write and run test cases, log clear bugs in Azure DevOps, verify fixes, run regression testing before each release, and build and maintain automated tests in Playwright (or a similar tool) to grow the team’s automated regression suite.

The ideal candidate is early in their QA career, already has hands-on test automation experience (from work, an internship, or a substantial project), pays close attention to detail, and wants to learn how an established enterprise software product is built, tested, and released.

What the QA Analyst Will Do

Testing

• Review requirements and user stories to work out what needs to be tested and why.
• Write, maintain, and run test cases in Azure DevOps Test Plans for new features, enhancements, and bug fixes.
• Perform manual functional and exploratory testing across Contract Insight®, including contract records, workflows, approvals, search, reporting, and document management.
• Test with realistic data and user permission setups that reflect how clients use the product.

Test Automation

• Configure, write, and maintain automated tests in Playwright (or a similar framework) for core user flows and regression scenarios.
• Maintain test configuration, including environments, browsers, test data, login state, and reusable page objects or helpers.
• Run automated tests locally and in the CI pipeline, review results, and determine whether each failure is a product bug, a test issue, a data issue, or an environment issue.
• Link automated tests to Azure DevOps test cases so coverage can be tracked in one place.
• Identify manual regression tests that should be automated and turn them into stable automated tests.

Bugs and Fix Verification

• Log, document, and track bugs in Azure DevOps through to resolution.
• Write bug reports that developers can act on without follow-up questions, including steps to reproduce, expected and actual results, version, and screenshots or logs.
• Retest fixes and check related functionality for side effects before closing.

Regression and Release Support

• Run manual and automated regression testing before each release.
• Prepare and maintain test environments for upcoming release cycles.
• Report testing status, risks, and open issues to QA leadership and Release Management.

Collaboration

• Work with Developers, Product, Release Management, Sales, Marketing, and Training to clarify expected behavior and share product knowledge.
• Stay current on Contract Insight® features and how clients use them.
• Complete required CobbleStone University product certifications each year.

How Success Is Measured

• Assigned test cases and regression runs are completed and recorded before each release.
• Bug reports are clear enough that developers rarely need to ask follow-up questions.
• Fixes are typically retested within two business days of reaching QA.
• New automated tests are added each quarter, kept passing, and failures are looked into within one business day.
• Few production issues come from areas the QA Analyst tested, and any that do lead to a new test.

Required Qualifications

• Bachelor’s degree in Information Technology, Computer Science, Business, or a related field, or equivalent experience.
• 1–2 years of software QA or testing experience. Internships, co-ops, or substantial academic or personal projects count if they included hands-on testing.
• Hands-on experience configuring and maintaining automated tests using Playwright or a similar tool (such as Selenium or Cypress).
• Working knowledge of JavaScript or TypeScript (or another test automation language), enough to read, write, and debug test code.
• Experience testing web-based applications.
• Understanding of software testing concepts (test cases, regression testing, functional and exploratory testing, bug lifecycle) and the Software Development Lifecycle (SDLC).
• Ability to clearly document test results and explain issues to technical and non-technical people.
• Proficiency with Microsoft Office (Word, Excel, Outlook, PowerPoint).
• Excellent written and verbal English communication skills.
• Authorization to work in the United States. Background check and drug screening required.

Preferred Qualifications

• Experience with Azure DevOps (Boards, Test Plans, Pipelines) or similar bug tracking and test management tools.
• Experience running automated tests in a CI/CD pipeline and using Git.
• Exposure to API testing (such as Postman or Playwright API testing).
• Basic SQL for checking or setting up test data.
• Experience working in an Agile or Scrum environment.
• Knowledge of business, procurement, legal, or enterprise software.

Our Hiring Process

1. Phone screen (20–30 minutes)

2. Take-home practical assessment (about 3 hours of work, returned within 24 hours)

3. Interview with the Hiring Manager and Team Lead

Why Join CobbleStone?

• Competitive pay and benefits.
• Stable, growing B2B software company founded in 1995.
• Collaborative, supportive QA and development culture.
• Exposure to the full release lifecycle and cross-functional teams.
• A real hand in building out the team’s Playwright test automation, with room to grow into senior QA, automation, business analysis, or release roles.

How to Apply

Apply through Indeed or email your resume to [email protected].

About CobbleStone Software

Founded in 1995, CobbleStone Software provides contract lifecycle management (CLM) software trusted by organizations worldwide. As a U.S. government contractor and enterprise software provider, CobbleStone delivers solutions across legal, procurement, and risk management. Learn more at www.cobblestonesoftware.com.

Equal Opportunity

Employer

CobbleStone Software is an Equal Opportunity Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability, or protected veteran status.

Pay: $60,000.00 - $70,000.00 per year

Benefits:

• 401(k)
• 401(k) matching
• Dental insurance
• Health insurance
• Paid time off
• Referral program
• Vision insurance

Work Location: Hybrid remote in Lindenwold, NJ 08021