The Water Mark 2023: Methodology
Customer perception data (Water Matters)
Five metrics were considered as a whole dataset with 95 data points (19 x 5) for Water and Sewerage companies (WaSC’s) and Water only Companies (WoC’s) colour code ranking. These are ‘net satisfaction with overall service’, ‘net satisfaction with value for money’, ‘charges (bills) are fair’, ‘affordability’ and ‘awareness of additional services’.
The five-year rolling average data for these metrics was then used to calculate quartile boundaries as below:
- Minimum value: 39.01%
- First quartile boundary: 61.56%
- Second quartile boundary: 74.67%
- Third quartile boundary: 79.42%
- Maximum value: 91.61%
These calculations gave an indication of good and poor performance across all of the metrics and helped us to determine the long term ambitions that we want to see within the water sector. To simplify this, we have then used the 85%, 70%, 50% percentile boundaries to colour code performance as shown below. These percentages fall close to the quartile boundaries which we calculated above.
Perceptions data range | Colour ranking |
---|---|
Above 85% | Good |
Above 70% to 85% | Above average |
Above 50% to 70% | Below Average |
50% and below | Poor |
Notes:
- Net satisfaction with value for money, is based on merged Q9 and 10 data for WaSC’s and Q9 only for WoC’s
- Hafren Dyfrdwy data is based on four-year rolling average rather than a five-year rolling average as for other companies.
Total complaints
For the purpose of colour coding the written complaints per 10,000 connections data, this included 11 data points for WaSC’s and 8 data points for WoC’s. These have been used to calculate quartile boundaries for WaSC’s and WoC’s separately and these were then used to colour code the written complaints data as below.
Total complaints per 10,000 connections | Colour ranking |
---|---|
Below Q1 value | Good |
Q1 value and below Q2 value | Above average |
Q2 value and below Q3 value | Below Average |
Q3 value and above | Poor |
Complaints handling measure
The complaints handling measure is a composite of the percentage of escalated Stage 2 Total complaints (compared to total complaints) received by companies and complaints made about companies to CCW per 10,000 connections. Both components are based on the quartile performance within WaSC and WOC bandings where Quartile 1 is the best performing quartile. Each quartile is then scored as follows.
- Quartile 1: 1
- Quartile 2: 2
- Quartile 3: 3
- Quartile 4: 4
The respective scores for Stage 2 total complaints and Complaints made about companies to CCW each company are then added together to determine their respective complaint handling score. Each company is then assigned an overall complaint handling ranking in accordance with the following criteria:
Complaints handling measure – score | Colour ranking |
---|---|
2 | Good |
3 – 4 | Above average |
5 – 6 | Below Average |
7 – 8 | Poor |
For both total complaints and the complaint handling measure, Where we compare the performance of individual companies we do so within their respective segments as either Water and Sewerage Companies (WaSCs) or Water Only Companies (WOCs).
Operational data
For the purpose of colour coding operational data, each of the metrics included 19 companies data points (only 11 WaSC companies for flooding data). These have been used to calculate quartile boundaries for each metric and these were then used to colour code operational performance as below. (For the metrics used, lower values would indicate better performance).
Operational Data range |
Colour ranking |
---|---|
Below Q1 value | Good |
Q1 value and below Q2 value | Above average |
Q2 value and below Q3 value | Below Average |
Q3 value and above | Poor |
To allow us to compare companies of different sizes and make comparisons customer friendly, we have taken the following steps:
- Flooding data – The total number of incidents has been normalised based on ‘Flooding incidents per 10,000 sewerage connections.’
- Supply interruptions data: this is already in a normalised per property basis.
- Leakage data[2]: The total company leakage in Ml/d has been normalised based on ‘Leakage per property served’. The total number of water connections has been used for this. Leakage data can be normalised by ‘cubic meters per km main per day’ or ‘per property per day’, the latter has been used as this is more relatable for water customers.
- Average Annual PCC: this is already normalised on litres per person, per day basis.
Notes:
There may be slight variation with normalised data with what has been submitted to Ofwat as CCW have used year end connections data rather than an average count.
[2] Leakage comparisons for Actual versus target and cubic meters per km main per day can be found at https://discoverwater.co.uk/leaking-pipes
Environment Performance Assessment (EPA) data
The table shows how EPA star ratings have been ranked for the Water Mark. This data has been taken from the Environment agency and Natural Resources Wales.
EPA score | Colour ranking |
---|---|
Four stars | Good |
Three stars | Above average |
Two stars | Below Average |
One star | Poor |