Release testing checklist
- Edward Griffiths
- Matt Lynch
Version being tested: v.xx.x.x
New features and bug fixes
All tickets for new version to be re-tested on Staging environment
Currently tracked using the following spreadsheet: Test Allocations - Google Sheets
Jira search (fix version to be updated as necessary): https://legi-project.teratext.leidos.com.au/jira/issues/?jql=project in (LDAPP%2C SPT) AND fixVersion %3D v.16.0.0
Load tests
Load tests to be performed on the Staging environment
See Load and stress testing - LDAPP - Confluence (leidos.com.au)
End-to-end path tests
Test | Link to test script or description | Assigned to | Status/Outcome | Comments |
|---|---|---|---|---|
UK Bills |
|
|
| |
Scottish Bills |
|
|
| |
UK amendments |
|
|
| |
Scottish amendments |
|
|
| |
SIs and SSIs |
|
|
| |
Ping Pong |
|
|
| |
Finance Bill resolutions [work in progress] |
|
|
|
|
UK Private Members Bill [work in progress] |
|
|
|
|
|
|
|
|
|
Dashboard and creating projects
Test | Link to test script or description | Assigned to | Status/Outcome | Comments |
|---|---|---|---|---|
Creating a new project from the dashboard | Test for all document Types and Sub-types |
|
|
|
Filtering Finding projects on the Dashboard | How to filter the projects shown on the Dashboard | Filter by project title Filter by session Filter by project type |
|
|
|
Favourites |
|
|
|
|
Sorting (in Table view) Finding projects on the Dashboard | Sorting the projects displayed on the Dashboard |
|
|
|
|
Open a project |
|
|
|
|
Create a new project |
|
|
|
|
Delete a project |
|
|
|
|
Project tab and document management
Test | Link to test script or description | User manual | Assigned to | Status/Outcome | Comments |
|---|---|---|---|---|---|
Restricting permissions on a working version to the current user only | Test across a range of user organisations in different doc types |
|
|
|
|
Comparing two working versions and generating a PDF of the comparison output
|
|
|
|
| |
Import from http://legislation.gov.uk
|
|
|
|
| |
Reopening an auto-save version |
|
|
|
|
|
Duplicate a version
| Test in all doc types |
|
|
|
|
Move a version between folders
| Test in all doc types |
|
|
| |
Delete a working version
| Test in all doc types | https://lawmaker.atlassian.net/wiki/spaces/USERMANUAL/pages/688725 |
|
|
|
Editor features
PDFs
Test | Link to test script or description | User manual | Assigned to | Status/Outcome | Comments |
|---|---|---|---|---|---|
Generate a PDF for all doctypes
| Test tracked changes visible (test all options, including changes applied and side-lining) Test large print Test the footer option Test Draft watermark Test J-refs visible Test Dnums visible (for Lists of Draft Amendments) | https://lawmaker.atlassian.net/wiki/spaces/USERMANUAL/pages/688197 |
|
|
|
Generate a PDF containing tables, formulae, and images |
|
|
|
|
|
Amendment drafting and management
Test | Link to test script or description | User manual | Assigned to | Status/Outcome | Comments |
|---|---|---|---|---|---|
Test functionality of CCA for all elements in a UK LoDA |
|
|
|
|
|
Test functionality of CCA for all elements in a Scottish Parliament LoDA |
|
|
|
|
|
Check that amendments drafted in a LoDA get the correct XML attributes |
|
|
|
|
|
Submission of amendments from a LoDA |
|
|
|
|
|
Submission of amendments from the Amendment Manager tab |
|
|
|
|
|
Managing a large number of amendments (100+) in a temporary list
| Test Tabling, Rejecting, Bulk updating statuses, bulk updating proposer/supporter info | https://lawmaker.atlassian.net/wiki/spaces/USERMANUAL/pages/115277837https://lawmaker.atlassian.net/wiki/spaces/USERMANUAL/pages/25526674 |
|
|
|
Save a version of a temporary list
|
| https://lawmaker.atlassian.net/wiki/spaces/USERMANUAL/pages/25526637 |
|
|
|
Test the Filters on the Amendment Manager tab |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
Amendment list generation
Test | Link to test script or description | Assigned to | Status/Outcome | Comments |
|---|---|---|---|---|
Test ordering, filtering, and PDF output of Scottish Parliamentary Amendment lists | Generate a Scottish Parliament Daily List containing 20+ amendments Generate a Scottish Parliament Marshalled List containing 20+ amendments Generate a Scottish Parliament Groupings List containing 20+ amendments Generate a Scottish Parliament Manuscript List |
|
|
|
Test ordering, filtering, and PDF output of Commons Amendment lists | Generate a Commons Marshalled List containing 20+ amendments Generate a Commons Proceedings containing 20+ amendments Test for each amending stage |
|
|
|
Test ordering, filtering, and PDF output of Lords Amendment lists | Generate a Lords Daily Sheet containing 20+ amendments Generate a Lords Running List containing 20+ amendments Generate a Lords Marshalled List containing 20+ amendments Generate a Lords Manuscript List Test for each amending stage |
|
|
|
Generate a Consolidated List of Amendments containing all Lords amendments to a Bill; include 100+ amendments on the list | Check ordering and filtering, and check formatting in PDF; check performance with the list open in the Editor |
|
|
|
Generate a Consolidated List of Amendments containing all Commons amendments to a Bill; include 100+ amendments on the list | Generate a Consolidated List of Amendments containing all Lords amendments to a Bill; include 100+ amendments on the list |
|
|
|
Inline amending and auto-application of amendments
Test | Link to test script or description | Assigned to | Status/Outcome | Comments |
|---|---|---|---|---|
Test the production of traditional amendment wording from inline LoDAs | Test ‘leave out’ action in different provisions of different bill types Test ‘insert’ action in different provisions of different bill types Test ‘substitute’ action in different provisions of different bill types Test complex (hybrid) insert amendments that insert text at the end of a sub-section and a new sub-section Test complex (hybrid) substitution amendments that substitute text at the end of a sub-section and a new sub-section Test complex (hybrid) leave out amendments that span sub-sections Test leave out action on 8 words or fewer Test insert action on 8 words or fewer Test substitute action on 8 words or fewer |
|
|
|
Apply a large number of amendments (100+) to a bill version to create the ‘as amended’ version | check that the majority of amendments apply; check that those which fail are all visible in the ‘Review’ pane in the editor; check that the successful amendments are all visible in the Inline Amendments panel |
|
|
|
Test different amendment types | Test application of a ‘leave out’ amendment in different provisions of different bill types Test application of an ‘insert’ amendment in different provisions of different bill types Test application of a ‘substitute’ amendment in different provisions of different bill types Test application of complex (hybrid) insert amendments that insert text at the end of a sub-section and a new sub-section Test application of complex (hybrid) substitution amendments that substitute text at the end of a sub-section and a new sub-section Test application of complex (hybrid) leave out amendments that span sub-sections Test application of a leave out amendment on 8 words or fewer Test application of an insert amendment on 8 words or fewer Test application of a substitute amendment on 8 words or fewer |
|
|
|
API
Test | Link to test script or description | Assigned to | Status/Outcome | Comments |
|---|---|---|---|---|
Check availability of published UK bill version through PDR API | test at each stage in both houses; check the house and stage information reported through the API are correct |
|
|
|
Check availability of published UK amendment information through PDR API | test at each stage in both houses; check the house and stage information reported through the API are correct |
|
|
|
Check availability of published SP bill version through PDR API | test at each stage |
|
|
|
Check availability of published SP amendment information through PDR API | test at each stage |
|
|
|
Accessibility
Test Case | Link to test script or description | Assigned to | Status/Outcome | Comments |
|---|---|---|---|---|
Login page | Use the keyboard to navigate between elements on the login page Test screen reader behaviour Use the keyboard to enter MFA code and login |
|
|
|
Navigating the Dashboard
| Use the keyboard to navigate the Dashboard Test screen reader behaviour Create a new project; test focus behaviour in the ‘Create new project’ modal Open a project |
|
|
|
Navigating the Project tab | Use the keyboard to navigate the Dashboard Test screen reader behaviour Create a new working version |
|
|
|
Using the Editor | Test screen reader behaviour within the Editor Select menu options using the keyboard |
|
|
|