Supplier performance Supplier Performance
The objective of the Contract Evaluation process is to monitor and evaluate the performance of supplier engagements with Auckland Transport.
The process of evaluation ensures that risks are managed, value for money is achieved, and poorly performing suppliers are avoided in the future.
The approach taken by Auckland Transport is a co-ordinated one, meaning the supplier is also involved, rather than a one-sided assessment in isolation. This approach is referred to as Auckland Transport Performance Assessment by Coordinated Evaluation (ATPACE).
ATPACE is a joint initiative between Procurement and Business Units.
The purpose of ATPACE is to:
- enable continuous dialogue with Suppliers
- provide a means of systematically monitoring performance of AT’s Suppliers
- provide a historical database to assist in Track Record assessment in future Tender Evaluations
- give suppliers a better understanding of where their focus should be to enable the successful delivery of their contract.
About ATPACE
ATPACE System
The ATPACE System is a ServiceNow based database that allows Contact Owners to carry out supplier performance evaluations based on their contract requirements.
It provides a platform for:
- Contract Owners to generate evaluations within the system and send to the Supplier Representative
- Supplier Representatives to review and ‘Accept or Reject’ the evaluation
- The Supplier Representative may download evaluation reports (PDF format) to be used as supporting documentation for the Track Record attribute in competitive tender submissions
- AT Staff members to see evaluations of all suppliers.
Access and help
Access to the ATPACE is role based and restricted according to the role performed under the contract. Full access to the ATPACE System is limited to Auckland Transport (AT) employees.
Supplier access is restricted to viewing their own contracts and evaluations only.
For login issues, please contact askPMO@at.govt.nz.
When you log an issue, include:
- contract name
- case number / evaluation period
- what you expected vs what happened
- screenshot (if possible).
Evaluations
Frequency of evaluating contracts
Contracts longer than 90 days and valued at $250k or more are subject to monthly evaluations (Interim Evaluation). No evaluation would be expected in the first month, as work is only just commencing.
The final evaluation should be completed shortly after contract completion. Where applicable, a Supplier may enter their final evaluation score in future AT Tender documents under Track Record non-price attribute.
Performance criteria
The five ATPACE performance criteria are:
- Value for money: Providing value for money project outcomes by delivering within agreed scope, time, cost and quality parameters.
- Health, safety and wellbeing: Commitment to positive health, safety and wellbeing outcomes for workers and others on site by focusing on hazard identification and risk assessment, implementation of appropriate control measures.
- Collaborative behaviour: Demonstrating and reinforcing a collaborative working culture between suppliers, subcontractors and the client.
- Community in mind: Proactive consideration of impacts on neighbours, the travelling public, other stakeholders and Mana Whenua throughout the course of the project.
- Sustainability: Making a lasting contribution to lifting sustainable performance.
Details of each performance criteria topic relevant to the contract being assessed will be explained at the first interim ATPACE evaluation. If not relevant the score will be ‘not applicable’.
View KRAs, KPIs and performance rating criteria (PDF, 267KB).
Applying rating numbers
Refer to the rating table below for description of evaluation grading.
The AT Contract Owner completes the evaluation by selecting an appropriate performance rating for each performance criteria:
- by choosing one of the numbers alongside each of the performance measures that matches that grading, an overall grading will be calculated
- where 'not applicable' has been selected the overall grading is averaged out
- brief comments are required for each rating to clarify the bases for the rating given.
KRA/KPI Grading
This table explains what each individual KRA/KPI rating means in plain language.
| Rating | Grade | Description |
|---|---|---|
| 0 | Met no requirements | Unacceptable Significant issues requiring immediate attention. |
| 1 | Met few requirements | Serious reservations Some deficiencies where improvement is needed. |
| 2 | Met most requirements | Minor reservations Satisfies the criterion with minor reservations. |
| 3 | Met requirements | Good Good is considered as 'Business as Usual'. Supplier meets all requirements. |
| 4 | Exceeded requirements | Very good Supplier exceeds requirements that offers added value. |
| N/A | Not applicable | KRA/KPI does not apply during the reporting period. |
Once all KRAs/KPIs are rated, AT PACE calculates the overall score shown below in the Overall Score Grading table.
Overall Score Grading
This table translates the calculated overall percentage score into an overall performance grade. The overall score is the system’s rolled-up result from the individual KRA/KPI ratings (and their weightings), giving a single grading that reflects overall contract performance for the period.
| Score | Grade | Description |
|---|---|---|
| 0-20 | Unacceptable | Inability to deliver contract requirements. |
| 21-40 | Serious reservations | Contract requirements are only met through the intervention of AT. |
| 41-60 | Minor reservations | Contract requirements met with minor reservations which may or may not require AT intervention. |
| 61-80 | Good (BAU) | Contract requirements fully met without the need of AT intervention. |
| 81-100 | Very good | Contract requirements are consistently exceeded with significant added value features identified and delivered. |
| N/A | Not applicable | KRA/KPI does not apply during the reporting period. |
Supplier meeting
Auckland Transport may arrange a meeting with the Supplier to discuss performance outcomes as part of normal contract management practices.
These discussions provide an opportunity to clarify ratings, recognise good performance, and address any concerns. Outcomes from these discussions will be reflected in the ATPACE evaluation where relevant.
Suppliers have three working days to accept or raise concerns on an ATPACE evaluation through the system.
If no response is recorded within this period, the system will automatically record the evaluation as accepted.
Escalation process
The Supplier has the right to challenge any evaluation, and the right to escalate the issue if it cannot be resolved at the initial level such as through the face-to-face meeting.
Despite this, completion of the interim evaluation form without the ‘Acceptance’ of the Supplier, does not invalidate the evaluation. The resulting evaluation form shall still be considered a bona fide performance evaluation.
In the event that an ATPACE evaluation requires a rating to be moderated, the ATPACE evaluation form will be re-assessed by the applicable AT Project Manager, Supplier’s Representative, the AT General Manager of the applicable Department and the relevant AT Procurement Manager.
In the event of any disagreement, the rating assessed by the GM and the Procurement Manager will be the final grading.
Use of ATPACE information in tender evaluation
In tender evaluations, a Supplier’s previous performance is evaluated under the Track Record non-price attribute. Track Record is an assessment of the Supplier’s record of delivering works or services to the quality standards required, on time and within budget. Suppliers that wish to participate in AT Tenders will be required to include Final ATPACE ratings for contracts nominated under Track Record, as a part of their non-price attribute tender submission.
For Suppliers with no previous ATPACE scores, the Tender Evaluation Team will apply ATPACE criteria with the referee nominated for the nominated contract example under Capability attribute. The evaluation will be undertaken using the ATPACE methodology.
For more information or advice