07-M-0548: Energy Efficiency Portfolio Standard - Evaluation


EEPS Evaluation: An Overview

On June 23, 2008, acting in Case 07-M-0548, the New York State Public Service Commission (the Commission) established an electric and natural gas Energy Efficiency Portfolio Standard (EEPS). As a result of Commission actions, the New York State Energy Research and Development Authority (NYSERDA), as well as the major investor-owned utilities in New York, will provide direct incentives to homeowners and businesses to make energy efficiency improvements. The overall goal of the program is to reduce New Yorkers' electricity usage by 15% from the forecasted 2015 level with comparable results in natural gas conservation. In addition to helping lower monthly energy bills, the ratepayer-funded initiative is expected to save enough energy to electrically power about 600,000 average-sized homes annually and enough natural gas to heat about 60,000 average sized homes annually by 2015. In approving the EEPS, the Commission made clear that rigorous program evaluation must be a central focus and specifically required “transparent and technically sound methods for measurement and verification of net energy savings, benefits and costs, as well as assessment of customer satisfaction and program efficacy.” To achieve these objectives, the Commission increased evaluation funding, established evaluation guidelines and ordered the creation of the Evaluation Advisory Group (EAG).

The Evaluation Advisory Group (EAG)

The primary mission of the EAG is to advise the Commission and DPS staff on statewide evaluation and reporting standards and protocols that are comprehensive, consistent, transparent, and reliable. The Commission envisioned that the EAG would serve as a key advisor to DPS staff and play a critical role in encouraging communication and cooperation by creating a forum where members can discuss concerns, share ideas, and solve problems. With its membership of approximately 20 key stakeholders, each with extensive energy program experience, the EAG ensures that many points of view are considered in the evaluation process. The EAG holds regular meetings as does its various subcommittees. To see a list of the EAG members click here (81kb PDF).

Technical Advisor to the EAG:

Through an open competitive bidding process the department engaged Tec Market Works to support the work of the EAG and staff. The firm comprises nationally recognized evaluation experts specializing in the gas, electric, and telecommunications industries. Headed by Nick Hall, key members of the TecMarket Works team are Pete Jacobs, Rick Ridge, Ralph Prahl, Paul Horowitz, and H. Gil Peach. In addition to its extensive technical expertise, the team provides valuable insights gained from its experience other jurisdictions.

Program-Specific Evaluation Plans

Evaluation Plans:

Developing evaluation plans and program plans at the same time allows evaluators to work with program planners to identify data collection needs, establish budget estimates, and to synchronize evaluation goals with the program’s performance goals. The Evaluation Guidelines, which were developed by the EAG and DPS Staff, are an important step in providing program administrators with the elements of an acceptable evaluation plan and the evaluation standards to strengthen the accountability, accuracy, and usefulness of the results. To further enhance process evaluation, detailed Process Evaluation Protocols were adopted to supplement our Evaluation Guidelines. The Commission requires that all program proposals include an evaluation plan, subject to the review and approval of DPS Staff. Staff has approved the following evaluation plans:

Consolidated Edison/Orange & Rockland:


National Grid (Niagara Mohawk/KEDNY/KEDLI):


NYSERDA:


NYSEG/RG&E:


EEPS Statewide Research Studies/Joint Evaluation Plan


Some evaluation efforts have the potential to be conducted more effectively on a statewide or regional basis. On October 25, 2011 (Case 07-M-0548 and Case 07-G-0141), the PSC formally embraced the concept of statewide studies and joint evaluation, recognizing the potential of this approach to both enhance evaluation rigor and reduce costs. The Commission endorsed the commitment of up to 33% of the EEPS evaluation funds to these studies assigning DPS Staff and the EAG the responsibility for preparing a plan for executing statewide/joint evaluations that identifies priority projects, defines budgets, and provides an overall implementation strategy. The plan was completed in February 2012 and will be updated periodically.


Estimating and Reporting Program Impacts


Estimating Energy Savings:

The Commission has, over the course of the EEPS proceeding, approved a series of technical manuals to provide a uniform, measure-specific approach to estimate the energy and demand savings achieved by EEPS programs and avoid conflicting energy saving estimates for the same measures within different programs. 

During 2008 and 2009, the Commission approved a series of five sector-specific technical manuals, and, in an order issued on October 15, 2010, the Commission approved a revised technical manual that updates and consolidates the five sector-specific manuals. This new manual is effective January 1, 2011, meaning that, for all measures approved on or after January 1, 2011, the EEPS program administrators are required to use the new, updated and consolidated manual to estimate and report energy savings.

Technical Manual, effective January 1, 2011:

Technical Manuals, effective through December 31, 2010:
  • December 16, 2009 - New York Standard Approach for Estimating Energy Savings from Energy Efficiency Programs Single Family Residential Measures
  • September 1, 2009 - New York Standard Approach for Estimating Energy Savings from Energy Efficiency Measures in Commercial and Industrial Programs
  • July 9, 2009 - New York Standard Approach for Estimating Energy Savings from Energy Efficiency Measures in Multifamily Programs
  • March 25, 2009 - New York Standard Approach for Estimating Energy Savings from Energy Efficiency Programs(Gas)
  • December 28, 2008 - New York Standard Approach for Estimating Energy Savings from Energy Efficiency Programs(Electric)

Evaluation Reports

NYSERDA

New York Energy $martSM is a portfolio of programs funded through the Systems Benefit Charge (SBC) and administered by NYSERDA. The SBC programs, some gaining approval as early as 1998, have been subject to numerous reporting and evaluation cycles. As the goals of the SBC and of the EEPS overlap in their effort to improve energy efficiency in New York, certain of the SBC programs have been expanded under the EEPS. For NYSERDA’s library of New York Energy $martSM evaluation reports and quarterly and annual progress reports on the SBC and EEPS programs, click here.

Consolidated Edison

The Targeted Demand Side Management Program (Targeted DSM) offered by Consolidated Edison relies on energy efficiency measures to reduce demand and, therefore, defer the near-term need for additional transmission and distribution (T&D) capacity. The program focuses on the specific geographic areas in Con Edison’s service territory that can avoid proposed T&D upgrades through reducing peak load. An independent study of the targeted DSM program, which was required by the Commission’s Order Establishing Rates for Electric Service, was completed by Navigant Consulting and filed with the Commission on May 8, 2009. Navigant Consulting performed a process evaluation, an impact evaluation and market research in order to assess the strengths and weaknesses of the program and make recommendations for its improvement. To access the Con Edison Targeted DSM Program study, click here.

The Energy Efficiency Potential Study comprises the potential savings for four forms of energy in the Consolidated Edison Service Territory: electricity, natural gas, steam, and fuel oil. To access the multi-volume report, which details the results of the study, click here.
The EAG Evaluation Workshops


The workshops are designed as a forum to discuss evaluation issues and results.

January 20, 2012— Agenda and presentations (zip file)
October 4, 2012— Agenda and presentations (zip) file
June 4, 2013— Agenda and presentations (zip) file



Northeast Evaluation, Measurement and Verification Forum


On March 13, 2009 the Commission issued an order which allowed New York State to join and provide funding for the Northeast Evaluation, Measurement and Verification Forum. The EM&V forum is part of the Northeast Energy Efficiency Partnership (NEEP), a regional non-profit organization that brings together stakeholders from across the Northeast. The forum’s objective is to facilitate the development of common EM&V protocols to estimate, track, and report the impacts of energy efficiency and demand-side resources and environmental benefits. Participating in the EM&V Forum’s projects and studies allows New York to leverage its resources, effectively reducing the state’s research costs while increasing the accuracy and overall quality of its information.
New York State Energy Plan 2009


Evaluating energy efficiency programs has become a focus statewide and was highlighted in the New York State Energy Plan 2009. Developed by the Governor’s Energy Planning Board, the State Energy Plan is intended to inform and coordinate the roles and activities of state agencies and authorities in setting, implementing and overseeing New York’s energy policies. The plan provides guidance and recommendations that focus on strategies to increase energy efficiency, support renewable energy production, improve the energy infrastructure, and encourage innovation and a green economy. In its recommendations for improving the state’s energy efficiency efforts, the New York State Energy Plan highlights the need for consistency in measuring and reporting the impacts of energy efficiency programs. The plan also recognizes both Department staff and the EAG as central to developing the standards that would set forth the evaluation, monitoring and verification requirements that would promote the coordination and consistency among the state funded energy efficiency programs. To access the New York State Energy Plan 2009, click here.

Selected Reference Library


Documents:


Website Links:
    Consortium for Energy Efficiency Resource Library is a database of energy efficiency resources, including studies on specific efficiency measures.

    International Energy Program Evaluation Conference (IEPEC) is an excellent source of information about evaluation. It and includes conference papers, job and resume postings, RFPs and RFQs, as well as information about the upcoming IEPEC events.

    National Action Plan for Energy Efficiency (NAPEE) is a collaborative effort among utilities, government agencies, consumers, service providers, and environmental and energy efficiency organizations to promote energy efficiency across the country.

    Northeast Evaluation, Measurement and Verification Forum is part of the Northeast Energy Efficiency Partnership (NEEP), a regional non-profit organization that brings together stakeholders from across the Northeast.

    Northwest Energy Efficiency Alliance (NEEA) is a non-profit organization committed to furthering energy efficiency in the Northwest. An alliance of utilities, trade allies, and government organizations, its activities are directed at shifting the market towards energy efficient products and technologies.

    State of California, Public Utilities Commission has been a leader in energy efficiency. The PUC website describes California’s energy efficiency programs and, the evaluation efforts within the state, and includes links to other resources.

    Wisconsin’s Focus on Energy includes information on Wisconsin’s energy efficiency programs as well as access to numerous evaluation reports.

For more information about New York’s EEPS programs click here.

You may need Adobe Acrobat Reader to view pdf files.