v18-0 Editor Test Matrix
The matrix below is to record testing against various document types. Not all tests need to be carried out against all document types or sub-types. The script suggests, where testing against some or multiple document type is advisable, this will also be dependent on the new/updated features in the release.
Out of Scope of this test
Creating Documents and inserting standard provisions
Inserting Document Rubrics, including Toc, Front/Back covers
PDF Generation and formatting
Dashboard or Project tab functionality
Document Compare
In Scope
All editor functionality, across one or more document types or subtypes:
UK/Scottish Bills
Public
Private
Private Members
Finance Resolutions
SI/SSIs
Orders
Regulations
LoDA - UK and/or Scottish
Amendment - UK and/or Official Lists
Church Measures
Within Quoted structures of any of the above document types
Other document types/sub-type are available, but not a priority for testing. This assumes no changes have specifically been made to these document types.
NB:
try and establish which functions are document type specific, as these could be broken off and incorporated into different document specific scripts.
Function | Recommended Tests
| Documents Tested | Result | Test Notes |
---|---|---|---|---|
Upload or import a recent Document from http://Legislation.gov.uk | Various Doc types
| UK SI UK Pub | Pass Pass |
|
One Document type
| UK SI UK Pub | Pass Pass |
| |
One Document type
| UK Pub UK SI | Pass |
| |
One Document type
| UK Pub UK SI | Pass (but see note) | For both types of document, inserting large numbers of special characters and certain specific characters creates problems, (e.g., inadequate spacing) | |
One Document type
| UK Pub UK SI | pass |
| |
One Document type
| Uk Pub UK SI | Pass |
| |
One Document type
| UK Pub UK SI | Pass (but see test note) | NB that if a provision (e.g. a subsection) is moved to a different parent, then the parent //ref element in a reference to that subsection doesn’t get updated after alt+u. Not a result of v18 though. | |
External Cross References | tbc |
|
|
|
UK or Scottish Bills
| UK Pub | Pass |
| |
SI/SSIs
| UK SI | Pass |
| |
Citations (link tbc) | SI/SSIs | UK SI | pass |
|
UK Bill
| UK Pub | pass |
| |
One or more Doc types
| UK Pub UK SI | pass |
| |
One Document type + Quoted Structure
| UK pub UK SI | pass |
| |
One Doc type, amendment list and Quoted Structure
| UK pub | pass |
| |
At least two Doc types, including Quoted Structure
| UK bill UK SI | pass |
| |
One Document type, including quoted structure
| UK bill UK SI | pass |
| |
Any Document type, also in a QS. To test legal numbering use SI / Rule.
| UK Bill UK SI | pass |
| |
Fragment locking, releasing locks and refreshing documents Locking document fragments/multi-user editing (legislation.gov.uk) | One document type. Needs a mini script (possible rewrite of manual) |
| ? |
|
One document type
| UK Bill UK SI | pass |
| |
One document type and Quoted Structure
| UK bill UK SI | pass |
| |
One document type
| UK bill UK SI | pass |
| |
One document type
| UK bill UK SI | pass |
| |
Copying Provisions between documents (Push/Pull) | One document type (unable to suggest test steps, as feature is not working consistently). | UK bill UK SI | pass | Noted that this apparently is known to have issues. Worked for me in simple cases (i.e. copying single provisions) |
Copying provision between multiple documents (Push/Pull) | One document type (unable to suggest test steps, as feature is not working consistently). | UK bill UK SI | pass | Worked for me in simple cases (i.e. copying low number of provisions from two docs) |
One document type - Test in
| UK pub UK SI | pass |
| |
One document type?
| UK pub UK SI | pass |
| |
Managing Comments (Not in user manual?) | One document type
| UK pub UK SI | pass |
|
One document type
| UK pub UK SI | pass |
| |
Progress Bars (tbc) (Not in user manual?) | Changing in v17 |
| ? |
|
Removing leading/trailing white spaces (Not in user manual?) | One Document type
| UK bill UK SI | pass |
|
|
|
|
|
|