<aside> <img src="https://s3-us-west-2.amazonaws.com/secure.notion-static.com/715ec40d-63e8-44bc-9101-03a6cff1b380/Icons_Grey3.png" alt="https://s3-us-west-2.amazonaws.com/secure.notion-static.com/715ec40d-63e8-44bc-9101-03a6cff1b380/Icons_Grey3.png" width="40px" /> When implementing Open SPP, using standardised indicators across public authorities, and procurement categories, can help to ensure that results can be compared and consolidated over time.
This measuring and evaluation (M&E) framework provides guidance metrics to facilitate the process of setting goals, measuring progress, and sharing results when implementing Open SPP.
You can find an editable version of the framework in the downloadable tools section, which you can duplicate and edit to fit your specific context.
</aside>
The M&E framework includes the following section:
You will notice that each of the sustainability goals introduced in this M&E framework corresponds to one of the worked examples presented in section three of this toolkit. We recommend accessing these for a deeper dive into the role that Open SPP can play in driving these sustainability goals forward.
← Scroll to see more Scroll to see more →
| GOALS | OUTCOMES | INDICATORS | INFORMATION NEEDS | CALCULATION METHOD | OPTIONS FOR RECORDING THE DATA YOU NEED |
|---|---|---|---|---|---|
| Promoting SPP uptake | Increasing SPP implementation | Share of contracts which are classified as SPP | - Number of contracts classified as SPP |
Total number of contracts | Contracts classified as SPP / Total number contracts | See Option 1: Assign tags to procurements | | Promoting SPP uptake | Increasing SPP implementation | Value share of contracts which are classified as SPP | - Value of contracts classified as SPP
Value of total contracts | Value of contracts classified as SPP / Total value of contracts | See Option 1: Assign tags to procurements | | Promoting SPP uptake | Increasing SPP implementation | Share of public buyers which award contracts classified as SPP | - Number of public procurement authorities which award contracts classified as SPP
Total number of public procurement authorities | Public procurement authorities which award contracts classified as SPP / Total number of public procurement authorities | See Option 1: Assign tags to procurements
See Option 2: Boost performance to policy through alerts | | Promoting SPP uptake | Increasing SPP implementation | Share of SPP contracts where sustainability outcomes have been recorded | - Number of contracts where sustainability outcomes have been recorded
See Option 7: Monitor contract performance | | Promoting SPP uptake | Embedding sustainability into the procurement process | Share of tenders which reference SPP criteria within specifications | - Number of tenders which reference SPP criteria within specifications
Total number of contracts | Contracts which include environmental requirements as tender specifications / Total number of contracts | See Option 1: Assign tags to procurements | | Promoting SPP uptake | Embedding sustainability into the procurement process | Share of tenders which reference SPP criteria within scoring (award criteria) | - Number of tenders which reference SPP criteria within scoring (award criteria)
Total number of tenders | Tenders which reference SPP criteria within scoring (award criteria) / Total number of tenders | See Option 1: Assign tags to procurements | | Promoting SPP uptake | Embedding sustainability into the procurement process | Value share of tenders which reference SPP criteria within specifications | - Value of tenders which reference SPP criteria within specifications
Total value of tenders | Value of tenders which reference SPP criteria within specifications / Total value of tenders | See Option 1: Assign tags to procurements | | Promoting SPP uptake | Embedding sustainability into the procurement process | Value share of contracts which reference SPP criteria within scoring (award criteria) | - Value of tenders which reference SPP criteria within scoring (award criteria)
Total value of tenders
| Value of tenders which reference SPP criteria within scoring (award criteria) / Total value of tenders | See Option 1: Assign tags to procurements | | Reducing carbon emissions | Promoting low carbon practices in public contracts | Share of tenders which comply with low carbon SPP policies | - Number of tenders that company with low carbon policy
Total number of tenders | Compliant tenders / Total number of tenders | See Option 5: Request sustainability suggestions | | Reducing carbon emissions | Promoting low carbon practices in public contracts | Share of tenders which include a carbon budget | - Number of tenders which include a carbon budget within specifications
Total number of tenders | Contracts which include a carbon budget / Total number of tenders | See Option 4: Forecast contract impact | | Reducing carbon emissions | Promoting low carbon practices in public contracts | Share of tenders which reference CO2 emissions within scoring of tender (award criteria) | - Number of tenders which reference CO2 emissions within the award criteria
Total number of tenders | Tenders which reference to CO2 emissions / Total number of tenders | See Option 5: Request sustainability suggestions | | Reducing carbon emissions | Reducing carbon value associated with public contracts | Tonnes of Co2 associated with public contracts | - CO2 estimate of goods purchased
Amount of units purchased | CO2 estimates X Amount of units | See Option 4: Forecast contract impact | | Reducing carbon emissions | Reducing carbon value associated with public contracts | Tonnes of Co2 saved through SPP implementation | - Projected CO2 before including SPP specifications
Actual emissions after including SPP specifications and monitoring results | Projected emissions - Actual emissions | See Option 5: Request sustainability suggestions
See Option 7: Monitor contract performance | | Reducing carbon emissions | Reducing carbon value associated with public contracts | Contribution to National Targets through SPP | - Alignment with National Targets (e.g. how reduction of emissions in public procurement is contributing to national net zero targets)
See Option 7: Monitor contract performance | | Reducing carbon emissions | Reducing carbon value associated with public contracts | Number of contracts prioritized for SPP implementation for being high-emitting contracts | - Prioritized contracts
Total number of contracts | Prioritized contracts / Total number of contracts | See Option 4: Forecast contract impact | | Reducing carbon emissions | Promoting low carbon suppliers | Share of tenders which reference environmental certifications within specifications | - Number of tenders which reference environmental certifications within specifications
Total number of tenders | Tenders with reference to environmental certifications within specifications / Total number of tenders | See Option 1: Assign tags to procurements
See Option 5: Request sustainability suggestions
See Option 6: Measure use of certifications | | Reducing carbon emissions | Promoting low carbon suppliers | Share of tenders which reference environmental certifications within scoring (award criteria) | - Number of tenders which reference environmental certifications within scoring of tender
See Option 5: Request sustainability suggestions
See Option 6: Measure use of certifications | | Reducing carbon emissions | Promoting low carbon suppliers | Number of suppliers which meet low carbon (e.g. environmental certifications) criteria set in tender documents | - Number of suppliers which meet low carbon criteria
Total number of suppliers | Number of suppliers which meet low carbon criteria / Total number of suppliers. | See Option 6: Measure use of certifications | | Reducing carbon emissions | Reducing the purchase of carbon intensive products | Tonnes of CO2 associated with concrete used in public procurement projects | - CO2 estimate of concrete
Tonnes of concrete purchased | CO2 estimates X Tonnes of concrete | See Option 4: Forecast contract impact | | Reducing carbon emissions | Reducing the purchase of carbon intensive products | Tonnes of CO2 associated with the use of steel in public procurement projects | - CO2 estimate of steel
Tonnes of concrete purchased | CO2 estimates X Tonnes of steel | See Option 4: Forecast contract impact | | Promoting gender inclusion | Increasing access for women to public procurement | Share of bids received by businesses which are women-led | - Number of bids received by businesses which are women-led
Total number of bids received | Bids by women-led businesses / Total number of bids | See Option 8: Record supplier data at tender submission | | Promoting gender inclusion | Increasing access for women to public procurement | Share of contracts awarded to women-led businesses | - Number of contracts awarded to women-led businesses
Total number of public contracts
| Contracts awarded to women-led businesses / Total number of contracts | See Option 8: Record supplier data at tender submission | | Promoting gender inclusion | Increasing access for women to public procurement | Value share of contracts awarded to women-led businesses | - Value of contracts awarded to women-led businesses
| Value of contracts awarded to women-led businesses / Total number of contracts | See Option 8: Record supplier data at tender submission | | Promoting gender inclusion | Increasing access for women to public procurement | Share of contracts awarded to women-led businesses by sector | - Number of contracts awarded to women-led businesses in specific sectors (using product categories)
| Contracts awarded to women-led businesses by sector / Total number of contracts by sector | See Option 8: Record supplier data at tender submission | | Promoting gender inclusion | Increasing access for women to public procurement | Proportion of registered women-led businesses who submitted bids | - Number of registered women-led businesses who submitted bids
Total number of registered women-led businesses | Number of registered women-led businesses who submitted bids / Total number of registered women-led businesses | See Option 8: Record supplier data at tender submission | | Promoting gender inclusion | Promoting gender pay equality through public procurement | Average gender pay gap amongst public sector suppliers | - Sum of pay gap data submitted by suppliers (percentage difference in earnings between equivalent job roles across an entire organisation)
Total number of suppliers | Sum of pay gap data submitted by suppliers / Total number of suppliers | See Option 8: Record supplier data at tender submission
See Option 10: Use national or statewide data | | Promoting gender inclusion | Promoting gender pay equality through public procurement | Average gender pay gap amongst public sector suppliers by procurement category (e.g. IT, construction, etc.) | - Sum of pay gap data submitted by suppliers (percentage difference in earnings between equivalent job roles across an entire organisation) by procurement category
See Option 10: Use national or statewide data | | Promoting gender inclusion | Promoting gender pay equality through public procurement | Deviation from the average gender pay gap for winning suppliers | - Average pay gap for the given category of supply
See Option 10: Use national or statewide data | | Promoting gender inclusion | Promoting gender pay equality through public procurement | Share of contracts awarded to suppliers which present pay parity within their organisation | - Number of contracts awarded to suppliers which present pay parity
See Option 10: Use national or statewide data | | Promoting gender inclusion | Promoting gender equality in public tenders | Share of tenders which reference gender disparity within scoring (award criteria) | - Number of tenders which reference gender disparity within scoring of tenders
See Option 5: Request sustainability suggestions | | Promoting gender inclusion | Promoting gender equality in public tenders | Value share of tenders which reference gender disparity within scoring (award criteria) | - Total value of tenders which reference gender disparity within scoring of tenders
See Option 5: Request sustainability suggestions | | Promoting gender inclusion | Promoting gender equality in public tenders | Share of public buyers who publish tenders which reference gender disparity within scoring (award criteria) | - Number of buyers who publish tenders which reference gender disparity within scoring
See Option 5: Request sustainability suggestions | | Driving socio-economic development | Increasing contracting spend on socio-economically strong suppliers | Value share of contracts awarded to SMEs | - Total value of contracts awarded to SMEs
See Option 3: Measure contracts awarded | | Driving socio-economic development | Increasing contracting spend on socio-economically strong suppliers | Value share of contracts awarded to local businesses | - Total value of contracts awarded to local businesses
See Option 1: Assign tags to procurements | | Driving socio-economic development | Increasing contracting spend on socio-economically strong suppliers | Value share of contracts awarded to Voluntary, Community and Social Enterprise (VCSEs) | - Total value of contracts awarded to VCSEs
Total value of contracts | Value of contracts awarded to VCSEs / Total value of contracts | See Option 3: Measure contracts awarded | | Driving socio-economic development | Promoting socio-economic development in public tenders | Share of tenders which reference socio-economic factors within scoring (award criteria) | - Number of tenders which reference socio-economic factors within scoring
Total number of tenders | Number of tenders which reference socio-economic factors within scoring / Total number of tenders | See Option 3: Measure contracts awarded | | Driving socio-economic development | Promoting socio-economic development in public tenders | Value share of tenders which reference socio-economic factors within scoring (award criteria) | - Total value of tenders which reference socio-economic factors within scoring
Total value of tenders | Value of tenders which reference socio-economic factors within scoring / Total value of tenders | See Option 3: Measure contracts awarded | | Driving socio-economic development | Promoting socio-economic development in public tenders | Share of public buyers who publish tenders which reference socio-economic factors within scoring | - Number of public buyers who reference socio-economic factors within scoring
Total number of public buyers | Number of public buyers who reference socio-economic factors within scoring / Total number of public buyers | See Option 3: Measure contracts awarded
See Option 9: Create SPP supplier registries
| | Driving socio-economic development | Promoting socio-economic development in public tenders | Number of contracts awarded to high growth industries | - Number of contracts awarded to high growth industries
See Option 9: Create SPP supplier registries **** | | Driving socio-economic development | Increasing employment through public contracting | Apprenticeships secured during a contract | - Total value of contracts awarded
See Option 9: Create SPP supplier registries **** | | Promoting life cycle costing approaches | Introducing life cycle costing into the procurement process | Share of re-tenders where the value is based on life cycle costing calculations of previous contract | - Number of re-tenders where the value is based on life cycle costing calculations of previous contract
Total number of re-tenders | Re-tenders where the value is based on life cycle costing calculations of previous contract / Total number of re-tenders | See Option 4: Forecast contract impact | | Promoting life cycle costing approaches | Introducing life-cycle costing into the procurement process | Value share of re-tenders where the value is based on life cycle costing calculations of previous contract | - Value of re-tenders where the value is based on life cycle costing calculations
Total value of re-tenders | Value of re-tenders where the value is based on life cycle costing calculations / Total number of tenders | See Option 4: Forecast contract impact | | Promoting life cycle costing approaches | Introducing life-cycle costing into the procurement process | Share of tenders which base the cost score for each bid ******on life cycle costing calculations | - Number of tenders which base the cost score for each bid ******on life cycle costing calculations
Total number of tenders | Number of tenders which base the cost score for each bid ******on life cycle costing calculations / Total number of tenders | See Option 4: Forecast contract impact | | Promoting life cycle costing approaches | Introducing life-cycle costing into the procurement process | Value share of tenders which base the cost score for each bid ******on life cycle costing calculations | - Value of tenders which base the cost score for each bid ******on life cycle costing calculations
Total value of tenders | Value of tenders which base the cost score for each bid ******on life cycle costing calculations / Total number of tenders | See Option 4: Forecast contract impact | | Promoting life cycle costing approaches | Driving SPP through life cycle costing approaches | Share of tenders which include a carbon budget based on estimated life cycle carbon emissions | - Number of tenders which include a carbon budget based on estimated life cycle carbon emissions
Total number of tenders | Number of tenders which include a carbon budget based on estimated life cycle carbon emissions / Total number of tenders | See Option 4: Forecast contract impact | | Promoting Life-cycle costing approaches | Driving SPP through life cycle costing approaches | Value share of tenders which include a carbon budget based on estimated life cycle emissions | - Value of tenders which include a carbon budget based on estimated life cycle carbon emissions
Total value of tenders | Value of tenders which include a carbon budget based on estimated life cycle carbon emissions / Total number of tenders | See Option 4: Forecast contract impact | | Promoting Life-cycle costing approaches | Driving SPP through life cycle costing approaches | Number of contracts classified as SPP which base the cost score for each bid on life cycle costing calculations | - Number of contracts classified as SPP which base the cost score for each bid on life cycle costing calculations
Total number of contracts | Number of contracts classified as SPP which base the cost score for each bid on life cycle costing calculations / Total number of contracts | See Option 1: Assign tags to procurements
See Option 4: Forecast contract impact | | Promoting Life-cycle costing approaches | Driving SPP through life cycle costing approaches | Value share of contracts classified as SPP which base the cost score for each bid on life cycle costing calculations | - Value of contracts classified as SPP which base the cost score for each bid on life cycle costing calculations
See Option 4: Forecast contract impact | | Promoting Life-cycle costing approaches | Increasing cost savings through life cycle costing calculations | Value saved by using life cycle calculations to set contract value | - Cheapest bid for a particular tender (based on acquisition price)
Projected life cycle cost of cheapest bid
Projected life cycle cost of selected bid | Projected life cycle cost of cheapest bid - Projected life cycle cost of selected bid | See Option 4: Forecast contract impact |
