AUTOMATION TEST ANALYST JOB DESCRIPTION

Automation test coverage is a number that either earns trust or erodes it. When that number is unreliable, releases slip, defects reach production, and regression cycles consume engineering capacity that should be building product. The Automation Test Analyst owns the design, development, and maintenance of automated test frameworks that keep software delivery honest - validating functional correctness, API contracts, and regression suites against agreed acceptance criteria before code reaches users. This role sits within the software delivery team, working alongside developers, business analysts, and QA leads across Agile and Waterfall programs.

As the Automation Test Analyst, you are responsible for building and sustaining automated test coverage across web, API, and application layers, ensuring each release meets defined acceptance criteria before it reaches production. You work within cross-functional delivery teams, reporting to a QA lead or test manager, and your scope spans unit, integration, system, and user acceptance testing phases on both greenfield builds and BAU programs.

Career Impact: Hands-on ownership of BDD-driven frameworks and CI/CD-integrated test pipelines builds the kind of engineering credibility that opens doors to senior QA, test architecture, and DevOps-adjacent roles.

Business Impact: The automated suites you maintain are the last checkpoint before software reaches end users - your coverage rate directly determines how many defects reach production versus how many are caught in sprint.

Growth Opportunity: Exposure to performance, security, and API testing within a single role accelerates the path toward Senior Automation Test Analyst or Test Architect faster than specialised tracks typically allow.

• Design and develop automated test frameworks covering UI, API, and regression layers to support repeatable release validation.
• Plan and execute test strategies across functional, integration, system, and user acceptance testing phases.
• Implement performance and load test scripts based on system requirements and user stories to identify bottlenecks before release.
• Review product requirements and functional specifications to determine test coverage, scope, and automation viability.
• Investigate defects identified during automated and manual testing, document root causes, and track resolution to closure.
• Monitor and maintain CI/CD-integrated test pipelines, resolving script failures and updating suites as application builds change.
• Collaborate with developers, business analysts, and delivery managers to align test coverage with acceptance criteria and release schedules.
• Mentor junior testers on automation standards, script quality, and testing methodology within the team.

• Bachelor's degree in Computer Science, Information Technology, Engineering, or equivalent work experience.
• 3 or more years of automation testing experience, with demonstrated ability to build and maintain automated test frameworks.
• Proven competency in designing and executing test plans, test cases, defect reports, and status reports across multiple testing phases.
• Working knowledge of Agile and Waterfall development methodologies and how testing fits within each delivery model.
• Experience in API testing including RESTful and SOAP service validation and contract-based testing approaches.
• Ability to perform root cause analysis on defects, communicate findings clearly to technical and non-technical stakeholders, and escalate issues appropriately.
• Understanding of CI/CD pipeline integration for automated test execution and version control workflows.

• ISTQB Foundation Certificate or equivalent nationally recognised testing qualification.
• Experience with performance, load, or security testing disciplines as a complement to functional automation work.
• Familiarity with BDD methodologies including Gherkin-style test authoring and behavior-driven framework maintenance.
• Exposure to cloud platform environments and automated testing within distributed or microservices-based architectures.

• Automation coverage rate as a percentage of regression suite, tracked per sprint and release cycle.
• Defect escape rate, measuring the proportion of production incidents traceable to test gaps in the managed suite.
• Mean time to detect, reflecting how quickly automated runs surface failures after a new build is triggered.
• Script maintenance ratio, tracking the number of broken scripts resolved per sprint relative to new scripts added.
• Test execution cycle time, measuring how long the automated suite takes to complete against the agreed pipeline SLA.
• Typical tools: test automation frameworks (commonly Selenium, Cypress); CI/CD and test management platforms (commonly Azure DevOps, JIRA).

• Base Salary Range: $75,000 to $105,000 per year depending on experience and location.
• Bonus: Annual performance bonus of 5% to 10% of base salary.
• Equity: Stock options or RSUs offered at mid-to-senior levels; varies by employer.
• Health Benefits: Medical, dental, and vision coverage; employer contribution varies by company size.
• PTO: 15 to 20 days annually plus public holidays; some employers offer unlimited PTO.
• Common Perks: Remote or hybrid work options, professional development budget, certification reimbursement.

Figures are estimates based on general US market benchmarks and may be outdated. Adjust based on location, company size, and seniority level.

Background check completion is a condition of employment for this role, including verification of prior employment and applicable criminal history review. All applicants are considered without regard to race, color, religion, sex, national origin, age, disability, veteran status, or any other characteristic protected under applicable federal, state, or local law. Reasonable accommodations for qualified individuals with disabilities are available throughout the hiring process upon request. Candidates must hold current authorization to work in the United States without sponsorship.

The Automation Test Analyst owns hands-on testing of a Greenfield financial transaction platform designed to optimise working capital and cash flow, building test approaches across the platform and its associated website. Working alongside cross-functional teams, the analyst delivers validated systems that meet business requirements, reporting status against schedule to ensure software is fit-for-purpose within planned timescales.

Key Responsibilities

• Work with teams to shape products and systems, then plan and execute tests using the most appropriate approach.
• Ensure software delivered is fit-for-purpose within planned timescales.
• Automate tests for front-end APIs.
• Ensure high value is achieved from test automation relative to investment made.
• Evaluate existing solutions and build new tools to support delivery.
• Find solutions when issues arise or when change is required.
• Work with other disciplines to integrate components into systems.
• Validate the system as a whole to ensure it delivers business requirements and benefits, reporting status against schedule.

Required Qualifications

• Have an ability and willingness to determine when to automate tests.
• Experience in testing with a focus on delivering quality.
• Experience with Cucumber framework using Rest Assured and/or Retrofit.
• Good understanding of building and testing web and mobile applications.
• Experience in Agile working environments, pairing and collaborating within a team.
• Competence in translating product requirements into technical solutions.
• Experience in building and improving automated test frameworks.
• Performance or security testing experience is an advantage.
• Acts with honesty, integrity, curiosity, and resilience; flexible, adaptable, and collaborative.

Reporting to workstream leadership, the Automation Test Analyst shapes test automation strategies and governance processes across a multifaceted government software delivery program. Partnering with QA team members, client stakeholders, and automation developers, the analyst contributes to high-quality software products for end users by establishing standards, creating training materials, and ensuring performance testing results are accurately documented.

Primary Duties

• Participate in discussions with client stakeholders to determine requirements for testing needs within a product feature or across the platform.
• Implement end-to-end test automation and tools strategies and roadmaps, including performance and load testing.
• Support test automation solution planning and estimation.
• Analyze current architecture and test platforms to formulate a vision for growth and expansion.
• Establish detailed standards for test automation tools and the creation and storage of test artifacts in repositories.
• Create training materials and train QA team members on automation tools and DevOps workflow integration.
• Define governance processes to ensure consistent, scalable, and efficient use of automation tools across the program.
• Create and maintain automation testing artifacts to support the team and stakeholders.
• Collaborate daily with peers and provide status to workstream leadership.
• Investigate issues identified during automation testing and document root causes.
• Develop test scripts and load models for performance testing based on system requirements and user stories.
• Ensure performance testing results are accurately reported and documented, collaborating to troubleshoot bottlenecks.
• Work closely with the team and other automation developers to build and support the automation framework.

Skills & Qualifications

• Bachelor's degree in Computer Science, Computer Engineering, Management Information Systems, or related field.
• Minimum 5 years of experience in test automation including planning, assessments, and script development, preferably in cloud environments.
• 3+ years of experience as a performance test engineer with tools such as HP LoadRunner and/or JMeter.
• 2+ years of experience with commercial or open-source testing tools such as Selenium or Micro Focus UFT.
• 2+ years of experience with Agile methodologies and tools such as JIRA and Micro Focus Quality Center.
• 1+ years of experience across unit, functional, integration, system, and UAT testing phases.
• Experience developing automation functions and programs, and integrating automation testing with DevOps.
• Knowledge of TDD and BDD; strong understanding of performance benchmarks and metrics.
• Excellent verbal and written communication skills; ability to work independently on complex projects.
• Must be a US Citizen and able to obtain and maintain a government security clearance.

Sitting at the intersection of software quality assurance and business systems support, the Automation Test Analyst leads test planning, stress testing, and defect investigation across web-based applications and integration points. Operating across engineering teams and business units, the analyst drives regression and release testing cycles while communicating findings professionally at all levels of the organisation.

Duties

• Write and review testing plans, perform stress tests, and investigate causes of defects.
• Create test plan automation procedures where possible and suggest improvements to prevent future failures.
• Provide systems support and first-line triage of support tickets raised by the business.
• Perform systems release and regression testing periodically.
• Report discovered defects to all relevant departments, record Jiras, and document solutions on Confluence.
• Execute test cases under varying circumstances, document and evaluate results, and detect, log, and report bugs.
• Track defects, troubleshoot errors, review test procedures, and develop test scripts.
• Partner with engineers to drive QA efforts while communicating professionally at all levels.

Requirements

• At least 6 years of quality assurance experience in Agile development environments with automated testing tools.
• Minimum 6 years of experience in web-based application testing and integration testing between applications.
• Familiarity with Agile software development methodologies and the software testing life cycle.
• Defines problems, collects data, draws valid conclusions, and provides solutions; identifies and escalates issues as required.
• Team player and self-starter able to multi-task, prioritize, and adjust rapidly; technical knowledge of systems and energy is advantageous.
• Excellent communication skills; thorough working knowledge of software testing methodologies.

A key member of the quality assurance function, the Senior Automation Test Analyst leads the development and execution of automated test strategies across business applications, ensuring software delivery is introduced in a controlled manner aligned with Standards Australia's QA standards. Collaborating across Business Analysts, Project Managers, and Development Managers, this role shapes test frameworks, coaches junior testers, and oversees UAT to keep projects on schedule and within agreed requirements.

Functions

• Design and develop test frameworks for UI and API automation using Selenium WebDriver and Java; develop and maintain the automated regression pack for projects and BAU deliveries.
• Lead or assist in developing test strategies, test plans, and quality assurance across the project lifecycle.
• Manage CI/CD pipelines and software releases following the release management process.
• Provide second-level support to troubleshoot production issues and coach junior testers on functional and automation test standards.
• Identify test data requirements, develop test data, and review automation scripts developed by peers and junior analysts.
• Develop, promote, and maintain high coding standards and ensure high automation test coverage in sprints.
• Collaborate with infrastructure teams to test system availability, upgrades, and disaster recovery; work on data migration projects to test data validity and integrity.
• Collaborate with PMs, BAs, and developers on Java and .NET platforms; conduct end-to-end, functional, SIT, regression, post-production, cross-browser, cross-platform, mobile, and non-functional testing.
• Manage and conduct UAT with various business units; maintain test tools and provide test and defect status reports in JIRA.
• Work across both Agile and Waterfall methodologies.

Experience & Qualifications

• 7+ years of automation testing experience; Bachelor's degree or equivalent in Information Technology.
• Experience in testing Java and .NET web applications, SOAP web services, RESTful APIs, and Windows, iOS, and Android applications.
• Experience in performance testing with open-source tools such as JMeter and load.io, and security and vulnerability testing.
• Knowledge of developing automation frameworks with Selenium using BDD Cucumber; experience with CI/CD and DevOps.
• Experience managing UAT; familiarity with version control systems, TFS, and cloud platforms; solid working knowledge of SQL.
• Working knowledge of Agile methodologies and industry best practices for QA processes and tooling.
• Excellent verbal, written, and visual communication skills; proactive, self-starting, and able to work both autonomously and collaboratively

Embedded within a client-facing delivery team, the Automation Test Analyst shapes test plans, test scenarios, and automated test execution from initial consultation through to status reporting. Working closely with internal and external clients, the analyst delivers testing outcomes that ensure software quality is validated and communicated within agreed timescales.

Core Functions

• Participate in initial consultation with internal or external clients to understand scope of work.
• Review software requirements.
• Prepare and/or review test plans, test scenarios, and test cases.
• Perform test data preparation activities.
• Install and maintain automated testing tools.
• Execute and create automated tests.
• Report, re-script, record, and track testing progress and outcomes.
• Prepare and communicate testing status.

Qualifications & Experience

• Up to 3 years of experience in automation testing.
• Experience in automation frameworks with hands-on experience creating test plans, test scenarios, test cases, defect reports, and status reports.
• Ability to work under pressure and meet tight deadlines with astute attention to detail.
• Good analytical skills and good client interaction skills.
• Excellent written and oral communication skills.

Strong test coverage across a client portfolio depends on the Senior Automation Test Analyst, who builds automation frameworks from scratch, leads test projects, and interfaces directly with developers and delivery managers to improve the overall testing cycle. Based within a technically demanding QA function, the analyst shapes framework architecture, manages defect processes, and produces audit-ready testing documentation across BAU and project work.

Accountabilities

• Build automation frameworks from scratch and extend existing frameworks with Selenium, C#, Cypress, and JavaScript.
• Shape, lead, and manage automation test projects, contributing across all phases of the development lifecycle.
• Take on leadership responsibilities and influence the direction, schedule, and prioritization of the automation effort.
• Review product requirements and functional and design specifications to determine and prepare automated test cases.
• Ensure testing is carried out to quality standards and evidenced for audit; manage all test reporting within BAU and projects.
• Provide input to continuous improvement within the testing function and wider IT function.
• Produce testing documentation for new and existing applications; conduct peer reviews of colleagues' test output.
• Manage defects and work closely with project, analysis, architecture, development, and support teams.

Technical Qualifications

• Strong understanding of testing within the SDLC, including Agile, V-Model, and Waterfall development models.
• Experience building and maintaining BDD-driven Selenium automation frameworks with cross-browser and platform support.
• Proficient in C#, Selenium, Cypress/JavaScript, XPath, CSS Selectors, XML, HTML, and web technologies.
• Familiarity with BDD language Gherkin and Specflow desirable; experience with BDD-driven API automation frameworks.
• Experience implementing automation frameworks with parallel execution and CI/CD integration.
• Familiar with Git workflow and branching strategies; strong test planning, leadership, coaching, and mentoring skills.
• Ability to analyse manual tests and features to determine automation ROI.

As the Automation Test Analyst, this role leads automation planning, script production, and offshore partner coordination to ensure test assets remain auditable and all defects are traced to requirements. The wider delivery team relies on this work to maintain test standards, mentor less experienced automation engineers, and provide management with feedback that drives process improvements.

Activities

• Plan automation for projects according to test strategy and create high-level test scenarios against the agreed test plan.
• Produce and maintain complex automation test scripts utilising the standard automation framework.
• Work with offshore partners to ensure they follow all standards and procedures; actively contribute to the automation framework.
• Execute automation scripts in pipeline, investigate failures, and perform manual exploratory testing.
• Provide detailed analysis of all testing, ensuring all defects are logged and managed correctly and tests are traced to requirements.
• Report progress to manager, raise issues in project meetings, and ensure test assets are auditable per company guidelines.
• Specify requirements for environment data resources and tools; mentor less experienced automation engineers.
• Actively provide feedback to management on new working practices and general improvements.

Position Requirements

• University degree preferably in Computer Science, Engineering, or Mathematics.
• ISTQB Foundation qualification or recognised country-specific qualification desirable.
• Minimum 6 years of experience in automation software development or testing, including functional, integration, and UAT testing.
• Experience with Python, Selenium, and automation frameworks such as Robot (Python) and TestNG (Selenium).
• Solid experience testing RESTful and SOAP APIs; working knowledge of Microfocus ALM Octane beneficial.
• Working experience with CI tools such as Azure DevOps; understanding of cloud technologies.
• Must be a fluent native Arabic speaker able to read, understand, and communicate in Arabic with internal and external stakeholders.

Automation Test Analyst owns mobile application testing across iOS and Android for enterprise mobility apps, delivering functional test automation, regression coverage, and UAT within a cadence-based release ecosystem. The work directly supports app owners, vendors, and business stakeholders by ensuring platform upgrades, system integration testing, and BVT are completed to standard before each release.

Operational Focus

• Test mobile applications on iOS and Android for enterprise mobility apps using tools such as Appium, Cucumber, SeeTest, and XCTest.
• Perform platform upgrades testing, regression testing, smoke testing, system testing, SIT, UAT, and BVT.
• Create and automate functional test cases for mobile applications and platforms.
• Manage defects, vendors, and stakeholders across various app owners.
• Create master and phase test plans; provide test summary and status reports.
• Design test scenarios and scripts for enterprise mobility apps.
• Work towards continuous improvement, automation, and cadence-based delivery across the app ecosystem.

Knowledge Skills & Abilities

• Bachelor's degree in Computer Science, Information Systems, or related field, or equivalent work experience.
• 4–7 years of overall software testing experience including mobile automation; 2+ years of relevant mobile automation experience.
• Experience with AWS cloud-based technologies and mobile automation using device farms such as Perfecto.
• Expert in Java, JavaScript, Node.js, React, RestAssured, API, JSON, Cucumber, Selenium, Appium, XCUITest, and Espresso.
• Expert in tools such as Jira, Confluence, Perfecto, SOAP UI, CA Lisa, SQL, JMeter, REST, GitHub, and Jenkins.
• Experience testing microservices, backend for frontend, and contract-based testing.
• Excellent customer interfacing skills with strong attention to detail and outstanding analytical and problem-solving abilities.

The Automation Test Analyst produces scalable data pipeline validation and API integration testing to ensure production data remains accurate and available for business intelligence tools and data-driven decision making. Reporting to engineering and product leadership, the analyst develops data quality frameworks, writes unit and integration tests, and partners with frontend engineers, backend engineers, and analysts to resolve data issues and define long-term data platform architecture.

Key Deliverables

• Develop and maintain scalable data pipelines and build new API integrations to support increases in data volume and complexity.
• Collaborate with analytics and business teams to improve data models that feed BI tools and foster data-driven decision making.
• Implement processes and systems to monitor data quality, ensuring production data is always accurate and available.
• Write unit and integration tests, contribute to the engineering wiki, and document work.
• Perform data analysis to troubleshoot and assist in resolving data-related issues.
• Work closely with frontend and backend engineers, product managers, and analysts.
• Define company data assets and design data integrations and a data quality framework using Spark, SparkSQL, and HiveSQL.
• Design and evaluate open-source and vendor tools for data lineage; develop long-term data platform architecture strategy with all business units.

Professional Experience

• Proven experience as an automation QA engineer.
• Experience with Agile frameworks and tracking of test cases and defects using Jira, Xray, Zephyr, and Gherkin.
• Experience integrating and providing ongoing measurement of test suites via CI/CD pipelines.
• Experience selecting and developing automated test cases using tools such as Cucumber and source control tools such as GitHub.
• Experience with AWS platform services and other MPP systems such as Google Cloud, Azure, and Snowflake.
• Experience with exploratory data analysis tools such as PySpark or Great Expectations is highly regarded.

Reporting to a line manager, the Automation Test Analyst develops and maintains automated tests for bespoke in-house applications and APIs, ensuring governance standards are upheld across all production deployments. Working closely with developers, the Crawford Service Desk, and end users, the analyst oversees regression suite maintenance, third-line application support, and UAT coordination to keep software releases stable and well-documented.

Areas of Ownership

• Identify test scenarios, create test cases, and document test results.
• Write and maintain automated tests; estimate testing required and report status and issues to line manager.
• Deliver detailed test reports from automated test suite execution.
• Document software faults and liaise with developers until software is ready for release.
• Ensure systems meet agreed acceptance criteria and governance standards are upheld for production deployments.
• Perform detailed manual testing of in-house applications and APIs; arrange User Acceptance Testing where required.
• Enhance and update the regression test script library and user documentation for all applications.
• Liaise with the Crawford Service Desk around software releases; provide third-line support for bespoke in-house applications.

Education & Experience

• STEM degree.
• Microsoft Qualifications; ISEB Foundation desirable.
• At least 1–2 years of proven recent experience as an IT tester.
• Understanding of software design principles; ability to investigate, think logically, and reason out problems.
• Proficient in SQL Server and API testing.
• Experience with TFS/VSTS/Azure DevOps/Jira and Agile methodologies including Scrum and Kanban.
• Proficient in Microsoft applications including Excel and Word.
• Excellent written and interpersonal communication skills.
• Strong organisational ability, work ethic, collaborative approach, and inclination to learn new skills.

Reporting to a test team leader, the Senior Automation Test Analyst advances functional automation coverage and supports the development team by building test scenarios, estimating project timeframes, and identifying automation improvement areas. Partnering with developers and the broader testing team, the analyst contributes to delivery timelines by implementing coding standards, maintaining CI/CD pipelines, and raising project risks before they affect release schedules.

Role Responsibilities

• Perform functional automation and manual testing; support and enhance existing automation frameworks.
• Implement and maintain automation, coding, and testing standards.
• Identify technical and automation areas for improvement.
• Support the testing team during project testing phases to meet delivery timelines.
• Work closely with the development team to build test scenarios and test plans.
• Perform application testing for development team projects across automation and manual methods.
• Assist in providing estimates for project timeframes.
• Provide regular status updates to the test team leader and identify and raise project risks and issues.

Background & Experience

• Hands-on experience with programming languages including C# and C++.
• Experience in API testing, SIP stack testing, and load testing.
• Skilled in identifying and creating test cases and scripts.
• Demonstrated ability to work within Agile and Scrum team structures.
• Experience in the Unix/Linux command-line environment.
• Experience with centralised repositories such as Git and building and maintaining CI/CD pipelines.