The NZ Transport Agency conducts post-implementation reviews every year on a small sample of completed projects or packages that it has invested in.
The reviews are not drawn from a statistically significant sample of all completed projects, but they do allow the Transport Agency to compare the planned benefits and costs of a project with the actual outcomes achieved.
Post-implementation review policy for evaluating outcomes of Transport Agency investments
The Transport Agency Board approved the post-implementation review policy for evaluating outcomes of agency investments in July 2013. The policy is designed to promote the transparency of the review findings, improve the evaluation of expected benefits and identification of lessons learned.
Post-implementation review scope
The Transport Agency uses an appropriate monitoring and auditing framework across funded activities in the National Land Transport Programme (NLTP). Post-implementation reviews are part of this framework.
Their scope is on reviewing improvement projects and packages from within the following NLTP activity classes:
- New and improved state highway infrastructure
- New and improved local road infrastructure
- Public transport infrastructure
- Walking and cycling.
Purpose of post-implementation reviews
Post-implementation reviews aim to:
- assess and explain how well projects and packages have achieved their main expected transport benefits (such as improved safety, increased capacity to meet traffic volume growth, or improved journey time and reliability) to give an overall assessment of the value for money of completed projects or packages reviewed
- explain any variation between actual results and expected benefits and costs, and
- identify lessons learned that can be used to make business improvements.
Selection of activities for review
In order to ensure outcomes are clear, approved organisations are required to nominate performance measures and targets for all projects and packages with an approved cost of $10 million or more as a condition of funding. The Transport Agency may also require performance measures on some lower value activities (for example, where there is a strategic link or innovation identified).
A sample of completed projects is selected for post-implementation reviews each year using a stratified sampling approach. The range of factors considered in selecting completed activities to review include:
- the value of funding
- activity type
- regional spread
- giving preference to reviewing a package of interrelated projects rather than the individual projects in isolation.
Promoting lessons learned
The following processes are used to promote lessons learned from post-implementation reviews:
- The relevant approved organisations (plus the Transport Agency’s Service Delivery and Design group) of reviewed projects are consulted to give them opportunity to formally comment on review findings. This includes stating how they plan to address any significant issues or improvement opportunities identified.
- Approved organisations are encouraged to undertake post implementation reviews themselves, consistent with this policy.
- We follow up with approved organisations on review recommendations.
- Post-implementation review findings are used to help inform the Transport Agency's risk assessment of approved organisations.
- Review findings are reported quarterly, along with recommendations for any actions required to be implemented or monitored. Key findings or themes from the reviews are reported quarterly to the Transport Agency Board, but there is a provision to escalate significant review findings more frequently if required.
- Review findings are published on the Transport Agency website as the reports are finalised.
Post-implementation reviews by year
- Auckland HNO – Manukau Harbour Crossing [PDF, 1.1 MB]
- Auckland HNO – Mt Roskill Extension [PDF, 647 KB]
- Wellington HNO – SH2 Dowse to Petone Upgrade [PDF, 1.2 MB]
- Auckland Transport – Lake Road widening [PDF, 1.4 MB]
- Bay of Plenty HNO – Bethlehem township improvements [PDF, 508 KB]
- Bay of Plenty HNO – Pyes Pā Bypass [PDF, 744 KB]
- Dunedin City Council – Portobello Road at Vauxhall [PDF, 1.8 MB]
- Hamilton City Council – Mill Street intersection upgrades [PDF, 1016 KB]
- Tasman HNO – Ruby Bay Bypass State Highway 60 [PDF, 1.2 MB]
- Tauranga City Council – Cameron Road cycle lanes [PDF, 633 KB]
- Western Bay of Plenty District Council – Welcome Bay Road Improvements [PDF, 2.7 MB]
- Post-implementation reviews completed in 2011/12 [PDF, 849 KB]
- Northern Busway Review summary, May 2012 [PDF, 447 KB]
- Northern Busway Review report, May 2012 [PDF, 797 KB]
- Northern Busway Review annexes, May 2012 [PDF, 1.9 MB]
- Victoria Park Tunnel report [PDF, 1.3 MB]
- The implications of road investment, November 2012 [PDF, 3.2 MB]