R.11!12!001 Public Roycroft Declaration 1-31-12

Embed Size (px)

Citation preview

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    1/80

    BEFORE

    THE PUBLIC UTILITIES COMMISSION OF THE STATE OF CALIFORNIA

    Order Instituting Rulemaking to Evaluate )Telecommunications Corporations Service )

    Quality Performance and Consider ) R.11-12-001

    Modification to Service Quality Rules )

    Declaration of Trevor R. Roycroft, Ph.D.

    On Behalf of

    The Utility Reform Network (TURN)

    Center for Accessible Technology

    National Consumer Law Center

    January 31, 2012

    NON-CONFIDENTIAL VERSION

    Material Alleged to be Confidential has been Expurgated

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    2/80

    TableofContentsI. Statement of Qualifications ................................................................................................................................... 1

    II. Introduction and Overview ................................................................................................................................... 3

    A. The Objectives of the OIR ........................................................................................................................... 3

    B. Management Choices Regarding Investment and Service Quality .............................................................. 7

    C. Issues Raised by the March 2011 Communications Division Report ........................................................ 11

    D. Summary ........................................................................................................................................................... 14

    III. Response to OIR Questions ............................................................................................................................ 14

    Question 1: Are the adopted GO 133-C service quality standards appropriate and reasonable? If not, should newservice quality standards be adopted or should existing standards be modified or eliminated? ............................. 14

    Service Guarantees ............................................................................................................................................. 16

    Major Service Outages ........................................................................................................................................ 17

    Consistent Reporting ........................................................................................................................................... 18

    Question 2: Should additional Out-of-Service standards be established for Out-of-Service events in excess of 24hours? ...................................................................................................................................................................... 19

    Question 3: Why are many of the URF carriers consistently missing the service quality measurement standardsfor (a) Out-of-Service Repairs, and (b) Answer Times? ......................................................................................... 19

    Management Decisions Favor Advanced Service Platforms .............................................................................. 19

    Verizon ............................................................................................................................................................... 20

    AT&T ................................................................................................................................................................. 23

    SureWest ............................................................................................................................................................. 23

    Summary ............................................................................................................................................................. 24

    Question 4: The current service quality standards and measures focus on retail customers. Should standards beadopted for wholesale service? If so, what should these standards and measures be? ........................................... 24

    Question 5: Is it appropriate to implement a penalty mechanism when standards are not met? If so, what shouldit be? ....................................................................................................................................................................... 25

    Benchmark Annual Penalty ................................................................................................................................ 27

    Penalty Points ..................................................................................................................................................... 28

    Annual Penalty Assessment ................................................................................................................................ 29

    Application of the Penalty Mechanism ............................................................................................................... 30

    Calculating the Penalty ....................................................................................................................................... 30

    Offset Benchmark Penalty by Amount of OOS Service Guarantees .................................................................. 31

    Forgiveness for Brief Periods of Substandard Performance ............................................................................... 31

    Customer Rebates ............................................................................................................................................... 31

    Evaluation of the Penalty Mechanism ................................................................................................................ 31

    Question 6: Should exemptions be allowed for calculating reported service quality results for States ofEmergency, Catastrophic Events and events beyond the control of the utility management? If so, should there belimitations on the geographic area(s) covered and/or the duration of the exemption? ............................................ 32

    Question 7: Should carriers provide the Commission with additional service quality data in the aftermath of acatastrophic event? If so, what additional data is appropriate? .............................................................................. 33

    Question 8: What other reporting requirements or measures are appropriate to evaluate quality of service? ....... 34

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    3/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    1

    Question 9: Should the Commission hire a network consultant to: a) review and evaluate the service qualityresults; b) to evaluate and monitor telecommunications carriers infrastructure, investments and manpower toimprove service quality; and c) to help the Commission determine best practices? If so how should they befunded and who should administer the contract(s)? ................................................................................................ 34

    Question 10: Are competitive market forces sufficient to ensure service quality? What, if any, are the barriers toswitching to other services and service providers if a customer is dissatisfied with the quality of wirelinetelephone service offered by their current provider? .............................................................................................. 36

    Barriers to Switching .......................................................................................................................................... 37

    Additional Barriers to Switching for Consumers with Disabilities ..................................................................... 42

    Question 11: How do carriers prioritize repairs between classes of customers, (e.g., retail vs. wholesale andbusiness vs. residential) types of technologies, and types of services? Should residential service be given toppriority for repair due to public safety and universal service obligations associated with residential service? ...... 43

    Question 12: Is the service quality information posted at the Commissions website sufficient to provideconsumers with the relevant information to make informed communications service purchasing decisions? ....... 47

    Question 13: Should the Commission adopt service quality reporting standards for Wireless carriers? ............... 50

    Question 14. Are there cost-effective engineering and design standards available that would prevent orbetter mitigate the effects of outages due to storms and other disruptions? If so, what are they? ......................... 53

    Question 15. Is the wireline network designed and maintained so as to minimize the duration of outagesdue to catastrophic events? If not, what should be done to rectify that? ................................................................ 53

    Question 16. Is the wireline network being properly maintained to serve Californians and the Californiaeconomy? Is wireline service in California comparable to service in other states that have penalties for failure tomaintain service or incentive regulation for service quality?.................................................................................. 53

    Question 17. Are there any economic, regulatory, physical, or other barriers or disincentives that stifle ordiscourage wireline maintenance? What are the consequences of poor wireline maintenance? What can andshould be done to foster proper and timely wireline maintenance? ........................................................................ 54

    Appendix 1: Generic Calculation of Penalty Mechanism55

    Appendix 2: Appendix 2: AT&T and Cox 3

    rd

    Quarter 2011 Service Quality Reports..56Attachment 1: Dr. Roycrofts Vitae

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    4/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    1

    I. StatementofQualifications

    1. My name is Trevor R. Roycroft. My business address is 51 Sea Meadow Lane, Brewster, MA,

    02631. I am an independent consultant providing economic and policy analysis related to

    telecommunications, public utility, and information technology industries. With regard to my

    educational background, I hold three degrees. I received a Bachelor of Arts degree in Economics

    with a minor in Statistics from California State University, Sacramento. The degree was

    awarded with honors. I also received a Masters and Doctor of Philosophy in Economics from

    the University of California, Davis. My Ph.D. fields of specialization are Economic Theory,

    Industrial Organization, Public Sector Economics, and Economic History.

    2. I have twenty years of experience in the public utility field. My experience began with my

    employment at the Indiana Office of Utility Consumer Counselor (OUCC) during the years 1991

    to 1994. For most of my tenure at the OUCC, I was Chief Economist. My primary areas of

    analytical responsibility at the OUCC related to telecommunications regulation and policy.

    3. I have been involved in higher education related to the telecommunications field. From 1994 to

    2004, I was a professor in the J. Warren McClure School of Communication Systems

    Management at Ohio University. At Ohio University I was granted tenure and promoted to

    Associate Professor in the spring of 2000. My primary areas of teaching responsibility were

    graduate and undergraduate courses covering regulatory policy, the economics of the

    telecommunications industry, consumer issues with telecommunications markets, and

    telecommunications technology. I left Ohio University to pursue consulting on a full-time basis

    at the end of 2004.

    4. I have published research in refereed journals including The Journal of Regulatory Economics,

    Contemporary Economic Policy, and Telecommunications Policy. I have contributed chapters

    that have been published in book volumes related to the telecommunications field. I have

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    5/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    2

    provided referee service to various academic journals including: The Journal of Regulatory

    Economics, Telecommunications Policy, Social Science Computer Review, Utilities Policy,

    Journal of Economic Studies, and Communications of the Association for Information Systems.

    5. I have provided analysis and testimony as an independent consultant since 1994. In my role as a

    consultant, I have addressed a wide variety of issues including: incentive regulation plans, cost-

    of-service studies, cost modeling, service quality, merger review, and competition. I have filed

    testimony, reports, and affidavits before state regulatory commissions, before the Federal

    Communications Commission (FCC), and before the Canadian Radio-Television and

    Telecommunications Commission. I have also provided expert services in class action lawsuits

    associated with the public utility field.

    6. I have extensive experience with regard to the matters the Commission is considering in this

    Order Instituting Rulemaking (OIR). I have published research on telephone company service

    quality.1

    I have provided expert testimony and/or analysis regarding service quality issues in

    cases involving CenturyLink, Frontier, Verizon, Embarq, Windstream, D&E Systems, SBC, and

    Ameritech. With regard to SBC and Ameritech, I presented testimony before the Indiana Utility

    Regulatory Commission regarding the service quality crisis experienced by Ameritech Indiana

    following SBCs acquisition of that company. Ultimately that case was settled, with one of the

    provisions being that SBC would pay for a management audit of its Indiana operations. On

    behalf of some of the settling parities, I worked with the management consulting firm that

    performed a management audit of SBC Indiana, and provided extensive review of the

    consultants work product on behalf of my clients.2

    With regard to other matters raised in the

    OIR, I have prepared competition analysis in numerous proceedings. I have provided expert

    services in class action lawsuits related to the wireless industry. Working with AARP, I have

    1 Trouble Reports as an Indicator of Service Quality: The Influence of Competition, Technology, and Regulation.Telecommunications Policy, Volume 24, No. 10, November, 2000.2 My clients were AARP, Citizens Action Coalition of Indiana, and United Senior Action of Indiana.

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    6/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    3

    drafted model consumer-protection legislation directed at wireless markets. A copy of my

    curriculum vitae is provided as Attachment 1 to this Affidavit.

    7. I was asked by TURN, Center for Accessible Technology and National Consumer Law Center3

    (Consumer Group) to evaluate service quality issues raised in the OIR, focusing on the URF

    carriersAT&T, Verizon, Frontier, and SureWest. To prepare this Declaration I reviewed the

    Commissions GO 133-C service quality rules, and the previous GO 133-B rules. In addition, I

    reviewed the service quality data available on the Commissions web site. I also reviewed

    service quality rules in other jurisdictions.

    8. I prepared discovery, which was served by TURN on each of the URF carriers on January 3,

    2012. As of the date of filing this Declaration, TURN has received only partial responses from

    AT&T, Verizon, and Frontier, with the bulk of Frontiers partial response, and much of

    Verizons response, arriving on January 30, 2012. SureWest has responded to all TURN data

    requests on a timely basis.

    9. With regard to discovery issues, TURN has also been informed by AT&T that it will not respond

    to any data requests regarding AT&Ts U-Verse deployment, indicating that U-Verse is

    irrelevant and has no bearing on this proceeding.4 As will be discussed below in detail,

    information regarding AT&Ts U-Verse (and Verizons FiOS) is central to the issues before this

    Commission.

    II. Introduction and Overview

    A. The Objectives of the OIR10.The OIR raises a number of important issues relating to the quality of telecommunications

    services in California. The OIR begins by addressing the key responsibilities of the

    Commission:

    3 The National Consumer Law Center has not signed the Non-Disclosure Agreements. NCLC has not reviewed theconfidential portions of this Declaration.4 E-mail message from Ramiz Rafeedie to Bill Nusbaum, January 27, 2012.

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    7/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    4

    The Commission has a statutory duty to ensure that telephone corporations provide customerservice that includes reasonable statewide service quality standards including, but not limitedto, standards regarding network technical quality, customer service, installation, repair andbilling.5

    With regard to the extent of its responsibilities, the Commission also makes clear that it

    considers wireless service quality to fall within the scope of this rulemaking.6 The OIR offers

    the following statement of purpose:

    This OIR is opened to review the performance of telecommunications corporations inmeeting GO 133-C service quality performance standards in 2010-2011, and to assesswhether service quality measures adopted in D. 09-07-019/GO 133-C:

    Meet the goals of the service quality measures (i.e., ensure that telecommunicationscarriers provide the level of service required by P.U. Code 451);

    Provide consumers with relevant information to make informed communicationsservice purchase decisions;

    Are relevant to todays regulatory environment and market;

    Need additional measures and/or penalty mechanisms added; and

    Should be revised to cover wholesale interconnection services as well as retail. If so,what revisions should be made?

    7

    The OIR also poses seventeen additional questions. This Declaration will address those

    questions in detail. Before turning to that discussion, a brief response to the OIRs statement of

    purpose is provided:

    The current service quality regime is not meeting the goals required by P.U. Code 451.

    The GO 133-C standards are not sufficient given the level of competition facing carriers,

    and this is borne out by data indicating that Californias two largest ILECs, AT&T and

    Verizon, are generally non-compliant with service quality metrics associated with GO

    133-C. As will be discussed below, AT&T and Verizon have implemented a two-tier

    service performance and network investment regime, where customers served on their

    5 OIR, p. 2.6 OIR, p. 14.7 OIR, pp. 12-13.

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    8/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    5

    advanced service platforms are given superior attention than those who do not purchase

    advanced services.

    With regard to the issue of information provided to consumers that might enable

    informed choices, the current approach is insufficient. With regard to wireline carriers,

    the information gathered through the GO 133-C reporting process is posted on the CPUC

    web site in a format that generally reflects the carriers data submission worksheets. The

    format of this information is not user friendly, limiting its usefulness to consumers. With

    regard to wireless carriers, the current GO 133-C standards require that carriers make

    coverage maps available, however, there are no standards regarding the accuracy of these

    maps, and consumers ability to make accurate side-by-side comparisons of carrier

    coverage is limited. Furthermore, on other important issues that affect wireless service

    qualitysuch as dropped calls, voice quality, and data throughputno reliable

    information is available to the public. The Commission should work with consumer

    groups and an information design specialist to develop an informative representation of

    service quality information for both wireline and wireless carriers. Distilling service

    quality information into a graphical presentation formatusing side-by-side comparisons

    with graphics and color that convey carrier performance provides a superior approach to

    the current presentation method.

    The OIR poses the question of whether service quality standards are relevant in todays

    environment. The risks and hardships suffered by California consumers during the

    extensive outages in late 2010 and early 2011 provide ample evidence that enforceable

    service quality standards continue to be relevant in todays market and regulatory

    environment. If competition were effective, consumers would simply switch providers

    when their carrier cannot deliver reliable service. The customer loyalty exhibited by

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    9/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    6

    consumers who stood by their carrier during an extended outage is a strong indicator of

    the lack of customer choice.

    o Furthermore, while it is certainly true that alternative telecommunication

    platforms exist, consumers of wireless, over-the-top VoIP, and cable-based VoIP

    services are also harmed when ILEC customers experience outages. Voice

    telephone service is subject to network effects, i.e., the value of the service is

    greater with a larger number of consumers connected to the network. ILEC

    service outages decrease the network effects, and harm consumers on all

    communication platforms.

    o This Commission has an obligation to ensure that the vital telecommunication

    services provided over the PSTN perform at a high level of reliability. The health

    and safety of the public, as well as economic opportunities, depend on high

    quality telecommunications services provided over the PSTN.

    With regard to additional service quality measures and penalty mechanisms, as is

    discussed in more detail below, the Commission should enhance both the preparedness of

    telecommunications service providers during emergency situations, and hold regulated

    telecommunications service providers accountable for their performance during normal

    operating conditions. Penalty mechanisms should be re-imposed for the URF ILECs.

    Yes, wholesale service quality should also be addressed. At a minimum, existing

    wholesale service quality standards should be enforced.

    In addition, in the course of its investigation of the performance of telecommunications

    companies under G.O. 133-C service quality standards, the Commission must also address the

    incentives that ILECs have to maintain and invest in their legacy copper networks. Telephone

    service quality is affected by inadequate maintenance and investment. For example, in

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    10/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    7

    summarizing the problems experienced by ILECs with regard to phantom 911 calls, the

    legislative analysis noted that Telephone corporations and the 911 County Coordinator Task

    Force reports that public service access points sometimes receive 911 calls that are triggered by

    damaged or aging lines, weather, or other causes.8 If lines are aging or damaged to the

    extent that phantom 911 calls are being triggered, this raises issues related to maintenance and

    investment. The Commission must assess these factors to determine whether the root cause of

    the general lack of compliance with service quality standards, as well as the extensive outages

    that occurred during late 2010 and early 2011, lies in a lack of sufficient resources being devoted

    to these carrier networks.

    B. Management Choices Regarding Investment and Service Quality11.Table 1 summarizes the service quality performance of the URF ILECs for the first three

    quarters of 2011 with respect to the out-of-service restoration standard.

    Table 1: Repair tickets restored 24 Hours, URF ILECsCPUC Standard, 90% (Shaded Cell IndicatesCompliance with Commission Standard)

    Jan Feb Mar Apr May Jun Jul Aug Sep

    SureWest 96.4% 86.7% 95.3% 96.9% 95.1% 93.6% 97.0% 91.9% 95.5%

    Frontier 75.6% 78.4% 81.7% 80.0% 85.1% 79.4% 83.1% 85.9% 86.4%

    Verizon 93.9% 62.0% 61.9% 74.1% 77.2% 75.9% 69.2% 74.2% 69.9%

    AT&T 56.3% 57.5% 57.7% 62.3% 70.1% 63.4% 72.7% 71.1% 74.5%

    12.Table 1 shows that other than SureWest, the URF ILECs are missing this service quality measure

    month-after-month, and sometimes by a wide margin. AT&T and Frontiers performance shows

    some improvement over the course of the year, while Verizons show no discernible trend. What

    is clear from Table 1 is that the Commissions standard is achievable; SureWest shows high

    levels of service quality performance. It may be argued that SureWest can achieve its high level

    of service quality due to its relatively small size. However, evidence obtained through

    8 Bill Analysis, SB 1375, June 28, 2010. Assembly Committee on Utilities and Commerce, Steven Bradford, Chair.http://www.leginfo.ca.gov/pub/09-10/bill/sen/sb_1351-1400/sb_1375_cfa_20100625_140146_asm_comm.html

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    11/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    8

    discovery, discussed in detail below, instead points to SureWest maintaining a high degree of

    attention to the delivery of high quality services to all SureWest customers. As will be discussed

    in more detail below, evidence associated with AT&T and Verizons operations points to a

    segmented approach to network investment and service quality performance. AT&T and

    Verizon provide superior service quality to customers who purchase their advanced services.

    AT&T and Verizon have evolved to provide what amounts to two separate customer service

    experiencesone associated with triple-play services using advanced technology, where the

    carriers maintain a keen focus on customer service, and another for services using legacy

    technology, where customer service and plant investment has been allowed to degrade.

    13.The Commission has increasingly relied on market forces to determine outcomes in California

    telecommunications markets,9 including the market for basic local telephone service. With

    regard to service quality issues the Commission has noted:

    One of the goals of increased competition was to ensure high quality service. A concernwas expressed that competition might not be sufficient in all markets to foster highservice quality for all consumers.10

    The concern over whether market forces are sufficient to guarantee high quality service to all

    customers is well placed. Telecommunications markets continue to be highly segmented, and

    this market segmentation makes it more likely that service quality may deteriorate for certain

    customers. Geographic availability of services varies. The largest URF carriers AT&T and

    Verizon have deployed their advanced network services (U-Verse and FiOS) in some areas,

    while in other areas legacy copper plant remains the only ILEC service platform.

    14.There is no question that carriers like AT&T and Verizon are making strategic decisions

    regarding resource allocation within their networks that reflect a new vision for service

    9 The URF Phase I Decision [D.06-08-030], relaxed regulatory oversight of the four largest ILECs with regard tovarious issues, including pricing.10 D.09-07-019, pp. 6-7.

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    12/80

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    13/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    10

    16.Carriers like AT&T and Verizon make their capital investment decisions based on a broad view

    of their operations. AT&Ts Group President and Chief Strategy Officer, John Stankey, recently

    summarized AT&Ts perspective on investment priorities:

    So finally, where are we putting your money? How are we investing our capital? And Iwould tell you that the story for '12 is very much the story that we shared with you in '11.We continue to increase the percentage of our spend and to dedicate it to our Mobility

    business. We think that's prudent and appropriate. It tracks the revenues. It tracks to

    where the opportunities are. We expect that we will continue to do that in 2012. We don'texpect the overall investment percentages as total revenue for AT&T to change. We stillexpect we'll be in the mid-teens as a percentage of revenue, but we do expect that we'll beshifting. And a lot of that shift is created by the benefit of the fact that we've largely

    completed our U-verse build at this pointand monies that we are putting toward buildingthat platform and getting this to robust capability in our consumers markets in the mostattractive market is now complete.14

    Thus AT&T indicates that its overall investment priorities are slanted toward wireless.15

    The U-

    Verse build, which covers about 60% of AT&Ts nationwide footprint16 has been halted, with

    the investment dollars freed up flowing to AT&Ts wireless operations. While it is natural for

    investments to follow revenues, this Commission must ensure that sufficient investment is made

    in facilities that continue to provide critical telecommunications services to large numbers of

    Californians.

    17.Markets are also segmented by consumer preferences and income levels. While carriers promote

    the most comprehensive bundle that their technology is capable of delivering, not all consumers

    want or can afford high-end bundled services. If ILEC triple-play bundles are linked to service

    14 AT&T's CEO Presents at Citi Global Entertainment, Media & Telecommunications Conference (Transcript),January 5, 2012, emphasis added. Seeking Alpha. http://seekingalpha.com/article/317986-at-t-s-ceo-presents-at-citi-global-entertainment-media-telecommunications-conference-transcript15 There is no question that Verizon also considers wireless operations a priority. Goldman Sachs has identified thedivestiture of all Verizon wireline assets outside of the enterprise market as a possible path forward. See VerizonFixed-Line Sale Would Enable Vodafone Combination, Goldman Says,Bloomberg, January 6, 2012.http://www.bloomberg.com/news/2012-01-06/vodafone-lifted-to-buy-at-goldman-sachs-on-verizon-strength.html16 AT&T nears end of its U-verse service buildout, FierceTelecom, May 20, 2011.http://www.fiercetelecom.com/story/att-nears-end-its-u-verse-service-buildout/2011-05-20

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    14/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    11

    platforms (like U-Verse and FiOS), then a consumers decision to decline the triple-play option

    may relegate them to a service platform that receives inferior service quality support.17

    18.This outcome is unacceptable, and is inconsistent with 451 of the Public Utilities Code, which

    the OIR notes requires the provision of an adequate level of service. However, 451 also

    requires that rates be just and reasonable:

    All charges demanded or received by any public utility, or by any two or more publicutilities, for any product or commodity furnished or to be furnished or any servicerendered or to be rendered shall be just and reasonable. Every unjust or unreasonablecharge demanded or received for such product or commodity or service is unlawful.18

    Service quality standards are essential for the satisfaction of this provision of the Public Utilities

    Code. Given that consumers of the URF ILECs have experienced increasing basic rates at a time

    when service quality performance has been consistently substandard, the proposition that these

    rates are just and reasonable is difficult to support.

    C. Issues Raised by the March 2011 Communications Division Report19.The OIR references the March 2011 Communications Division (CD) Report as an indicator of

    service quality problems facing California consumers. The CD Report points to two distinct sets

    of service quality issues(1) problems that occurred during the storms in late 2010 and early

    2011, and (2) URF carriers consistently failing to meet the Commission G.O. 133-C service

    quality standards.

    20.The CD Report addresses the service outages that occurred in Southern California in late 2010

    and early 2011. These service outages affected large numbers of customers, with some

    experiencing out-of-service conditions for extended periods. While the service outages present a

    dramatic example of service quality problems, the ongoing failure of carriers to meet the

    17 AT&T and Verizon do not migrate a customer onto their advanced service platform until the customer chooses totake the advanced services. This leads to some consumers residing in the same general area being served by eitherthe legacy copper facilities or the advanced service platform.18 Public Utilities Code, 451.

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    15/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    12

    Commissions service quality objectives is equally troubling as the problems that emerged

    during the emergency conditions of late 2010 and early 2011.

    21.The general problem is most pronounced among the URF ILECs, with the two largest URF

    carriersAT&T and Verizonleading the pack in poor service quality performance. Where

    data is available, some reporting CLECs show substandard performance. However, as illustrated

    in data presented in Telepacifics reports, customers of CLECs that rely on inputs from ILECs

    are harmed by poor ILEC service quality performance. While the GRC ILECs fail to meet some

    standards, their performance generally tends to be superior to the URF ILECs.

    22.The ongoing failure to restore service in line with the Commissions requirements has been a

    chronic problem for the URF ILECs, even absent the emergency conditions that existed

    following the heavy rains. On an ongoing basis, thousands of California consumers are facing

    extended delays in service restoration. According to data filed with the Commission, during the

    first nine months of 2011, outside of any emergency conditions, over 190,000 customers of the

    URF ILECs, primarily AT&T customers, were out-of-service for a period greater than 24 hours.

    These customers who experienced out-of-service conditions during the first nine months of 2011

    do not include any of the customers who were out-of-service due to the rain events that occurred

    during that period.

    23.The CD Report also identifies several problems with the current service quality reporting

    framework:

    There are different interpretations regarding calculating out of service intervals

    and the treatment of excludable events in the calculation (e.g., count all repairsmade 24 hours, even those made during excluded events, but exclude from thecalculation the service restoration times > 24 hours made during an excludedevent).

    There is a lack of specificity as to when a state of emergency ends, introducingsubjectivity in calculating results.

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    16/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    13

    There are differing interpretations on whether a state of emergency constitutes anexemption for reporting anything for the entire company for one or more months,i.e., should a state of emergency definition be similar to a catastrophic event (e.g.,3% of total company access lines).

    Some carriers like, Verizon, include non-voice grade results (data/video) with

    small business and residential trouble tickets as well as out of service repairtickets that are only supposed to include voice services.

    Not all carriers provided raw data.

    The details in raw data do not contain sufficient specificity for staff to replicatecarrier calculations.

    AT&T did not provide complete raw data that corresponded to the total number ofoutage tickets reported.

    Some carriers did not report data for each service quality measure.19

    These observations point to troubling issues associated with the Commissions service quality

    regime. For example, service quality reporting should be consistently implemented by all

    reporting carriers. The CD report indicates that different carriers report data based on alternative

    interpretations of the requirements. Inconsistency of reporting undermines the effectiveness of

    service quality standards. The CD report also indicates that different carriers interpret states of

    emergency differently, with subjective interpretations of the end of the emergency conditions.

    This ambiguity in carrier reporting, especially when it may be in the carriers self-interest to

    extend the reporting emergency beyond the existence of emergency conditions, is also a

    significant problem with the current service quality regime. Finally, carriers have different

    interpretations of the reporting requirements in 4(b)(i) of GO 133-C, which states:

    In cases where large numbers of customers are impacted or that are otherwise of greatseverity, a telephone report should be made promptly.

    AT&T maintains no records of this communication, while Verizon does.20

    19 CD Report, pp. 12-13.20 AT&T Response to TURN Set 1, request 1-5. Verizon response to TURN Set 1, request 1-5.

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    17/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    14

    24.The CD report also states that carriers are mixing voice and non-voice services in their service

    quality reports. The reporting regime should be corrected so that reports on voice services are

    not mixed with non-voice services. The CD report further points to incomplete filings and the

    failure to provide raw data. Carrier provision of raw data is essential for verification of carrier

    reports and a full assessment of carrier performance. Likewise, if carriers are simply not filing

    the required reports, then there is no possibility of monitoring carrier performance. For service

    quality reporting to serve its purpose, the metrics by which carriers are measured must be

    consistently applied by all firms subject to the requirements. As will be discussed in more detail

    below, the problems illustrated in the CD report require immediate remedy.

    D. Summary

    25.The service quality problems experienced by AT&T and Verizon should be deeply concerning to

    the Commission. The legacy portions of these carriers networks continues to serve a vital

    function in California, providing access to critical health and safety services, and enabling CLEC

    competition that benefits California business users. The Commission must determine the impact

    of discriminatory practices with regard to network investment and service quality provision. The

    provisions of the Public Utility Code require that high quality services be provided to all ILEC

    customers, not only those who have the desire and wherewithal to purchase high-end services.

    III. Response to OIR Questions

    Question 1: Are the adopted GO 133-C service quality standards appropriate and reasonable?

    If not, should new service quality standards be adopted or should existing standards be modified

    or eliminated?

    26.Response to Question 1: In D.09-07-019 the Commission concluded:

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    18/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    15

    Consistent with the general agreement of the parties that competitive environments act toapply a natural pressure for carriers to ensure adequate service quality, it is reasonable tosimplify the existing reporting requirements.

    21

    This assessment resulted in faith in market forces to deliver high quality services to all

    consumers. As discussed above, market forces have led the states two largest carriers to target

    their service quality efforts on customers being served on their advanced platforms, leaving

    customers on their legacy networks to experience substandard performance. While the GO 133-

    C service quality standards for the URF carriers might provide a reasonable set of reporting

    requirements for companies that have a demonstrated commitment to providing good service

    quality, they are not sufficient for companies that are neither committed to providing high quality

    services, nor facing sufficient competitive pressure to do so. As a result, the Commission should

    retain the GO-133 C standards, and impose increased reporting and penalties. The following

    additions should be made to the current GO 133-C service quality standards:

    Trouble reportsService Affecting (SA), Out-of-Service (OOS), and repeat SA and OOStrouble reports should be separately reported. If any wire center exceeds theCommissions existing surveillance standard (which is based on the wire centers size),for more than two months in a twelve-month period, then a report should be filed with theCommission detailing remedial actions taken or planned.

    Answer Timethe current reporting arrangement requires that monthly data be collectedquarterly and reported annually. This reporting structure is unreasonable. Monthlyreporting should be required, with data published at least on a quarterly basis showing theperformance during the months of the quarter.

    Customer complaintsthe number of customer complaints received by the carrier fromcustomers should be reported monthly

    The URF Carriers are currently not required to file information regarding installationintervals and installation commitments met. The Commission should extend the GO 133-C reporting requirements that currently apply to the GRC ILECs for installation intervalsand installation commitments met to the URF ILECs.

    Customer appointments met. Standards should be set for customer appointments. Whenan appointment for a service visit is made with a customer for a specific appointmenttime, and the customers presence is required for establishing new service or repair, the

    21 D.09-07-019, p. 2.

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    19/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    16

    ILEC service representative will arrive at the agreed upon appointment within 30 minutesbefore or after the scheduled time. The ILEC will report data on the number ofappointments met and the number of appointments missed.

    Baseline performance penalties. A point-based penalty structure should be imposed toprovide compliance incentives to the carriers by imposing monetary penalties. This

    penalty structure will be discussed in more detail in response to Question 5.

    Service Guarantees. (1) OOS restoration, for customers that are out of service for morethan 48 hours, the ILEC should credit the customer for one months service, measured atthe basic service rate. (2) For customers who do not have basic service installed withinthe five-day period, a credit of $30 should be applied to the customers first monthly bill.(3) For customers with missed installation or repair appointments, a credit of $30 shouldapply to the customers monthly bill.22

    Carriers should be required to file a California-specific emergency response plan.

    The Commission should issue more detailed instructions regarding overall service qualityreporting, and verify that carriers are complying with the Commissions service qualityreporting rules.

    Additional discussion is provided below regarding service guarantees, the emergency response

    plan, and Commission instructions regarding service quality reporting. Other points are

    addressed in the response to other of the Commissions questions.

    ServiceGuarantees27.With regard to service guarantees, recent testimony from Southern California Edison points to

    the positive impact on company performance provided by service guarantees:

    Meeting our pledge to our customers related to these guarantees has required a great deal ofcommitment from our employees and multiple changes to our existing processes. SG2

    23has

    22 The following, where applicable, are exceptions to the ILECs service guarantees described above.(1) There is a Category 1, 2, or 3 Storm Condition.(2) There is a declared Emergency Event.(3) Access to the customers premise is not available or the customer is not ready for service.(4) The premise is not deemed safe.(5) Causes related to force majeure, which include but are not limited to injunction or any decree or order of anycourt or governmental agency having jurisdiction, strikes or other labor disputes such as lockouts, slowdowns orwork stoppages, sabotage, riot, insurrection, acts of public enemy, fire, flood, explosion, earthquake or other acts ofGod, or accidental destruction of or damage to facilities.23 SG2 is SCE's commitment to customers that they will restore service within 24 hours of when SCE first becomesaware of a power outage. SG3 promises to notify any affected customer of a planned outage at least three days

    before the outage occurs. SCE's Transmission and Distribution Business Unit (TDBU) tracks its performance onthese two measures and pays customers $30 if SCE does not meet the conditions of the guarantee.

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    20/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    17

    required our staff to develop new call-out processes with improved communication methodsand better integration with after-hour contract resources. SG3 placed more focus on our end-to-end scheduling process by requiring that customer outage notification become a muchmore formalized and consistent procedure.

    The service guarantee program encouraged TDBU (Transmission and Distribution Unit) to

    invest the time and resources to implement concrete fundamental process changes to benefitour customers.

    SG2 established a greater sense of urgency to the restoration of power during an unplannedinterruption. This greater sense of urgency forced TDBU to think in new ways and challengelong held assumptions. For example, TDBU has always been committed to restoring poweras quickly as possible, but never fully explored the routine use of contract resources inemergency conditions. It was long believed by many in the organization that during anunplanned outage, using contractors should be minimized as much as possible even if itwould result in longer restoration times because it was believed that contractors notintimately familiar with our system would not perform efficiently under emergency

    conditions. However, we began working with several of our contractors and have been ableto identify and develop several who are able to meet our standards.

    SG3 required full review of our work scheduling process that had been in place for decades.Never before was the impact of a planned outage to the customer so carefully considered andcommunicated to the operating personnel. What was once an informal process where CCMsmade casual contact with customers to discuss power disruptions, became a formal procedurebased activity that is now integrated into our everyday routine.

    24

    This discussion points to the beneficial impact of service guarantees. Service guarantees will be

    discussed in more detail in response to Question 5.

    MajorServiceOutages

    28.Additional measures should be imposed for major service disruptions that could occur in the

    carriers California operating territory. All carriers should be required to develop a California-

    specific emergency response plan that should be submitted to the Commission, and put out for

    comment in a publicly noticed proceeding.25 Emergency response plans should be reviewed

    annually. Elements of the emergency response plan should include:

    24 Before the Public Utilities Commission of the State of California, 2012 General Rate Case Transmission andDistribution Business Unit (TDBU) SCE-03, Vol. 04 Part 05 & 06, Ch. I-II Witnesses: J. Arencibia, E. Martinez, pp.114-116.25 AT&T and SureWest produced documents related to emergency response planning. These documents do not

    provide a satisfactory emergency response plan. Verizon or Frontier did not produce any documents. See AT&T

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    21/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    18

    The development of an outage management system to quickly identify the locationand scope of customer outages and schedule outage restoration based on thatinformation.

    A plan to communicate outage information to the Commission, including protocols asto the appropriate contact individuals, information format, and record-keeping

    requirements (communication logs).

    A plan to communicate information to the Community. The carrier should havechannels available (local media, local emergency response personnel, carrieroutreach/public relations personnel) to provide relevant information before andduring the restoration process to customers. The plan should include information onhow the carrier will communicate with customers who are difficult to reach, includingcustomers with limited-English proficiency and those who have difficulty usingstandard forms of communication due to a disability.

    The plan should detail measures that will be taken to ensure sufficient staffing andmanagement of call centers so that customers receive prompt responses to inquiries.

    The plan should include measures to ensure ongoing and frequent communicationswith state and local officials about the extent of the outage and the plan forrestoration.

    The plan should include procedures for supplementing the workforce in the affectedarea from work force in other areas of the state and/or other states.

    In addition, carriers should not be exempted from collecting and reporting data duringemergency events. The Commission should have ongoing access to data regardingservice quality performance. Data provided to the Commission under exemptedconditions can be reviewed by the Commission, but withheld from use for compilingcompliance statistics.

    ConsistentReporting

    29.As discussed earlier, the CD report indicates that statistics are not being consistently calculated,

    and that Carrier reports are not reproducible. It is imperative that service quality reporting be

    standardized. Action should be taken to ensure that the reporting carriers prepare service quality

    statistics using a uniform methodology that is applied in the same manner by each carrier. For

    example, the New York Department of Public Service, Office of Telecommunications, issues

    response to TURN Set 1, question 1.2; SureWest response to TURN Set 1, question 1.2; and Verizon response toTURN Set 1, question 1.2.

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    22/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    19

    detailed guidelines associated with service quality measurements.26 The GO-133 standards

    should be augmented to ensure uniform reporting occurs.

    Question 2: Should additional Out-of-Service standards be established for Out-of-Service

    events in excess of 24 hours?

    30.Response to Question 2: As discussed above, service guarantees and additional penalties

    should be added. However, consumers experiencing extended outages should also be provided

    with an alternative communication device (cell phone), or should be reimbursed for personal

    cell-phone usage. Communication protocols should be developed that enable reliable

    communication channels be established with the affected community, including those who have

    disabilities, who do not speak English, or are difficult to reach, so that consumers, businesses,

    and public safety personnel are aware of restoration efforts and targets.

    Question 3: Why are many of the URF carriers consistently missing the service quality

    measurement standards for (a) Out-of-Service Repairs, and (b) Answer Times?

    31.Response to Question 3:

    Management Decisions Favor Advanced Service Platforms

    32.To answer this question it is necessary to examine business decisions that have affected the

    operations of the URF carriers. AT&T and Verizon have effectively divided the operations of

    their companies into advanced and legacy service platforms. AT&Ts advanced service

    platform is known as U-Verse. Verizons advanced service platform is known as FiOS. These

    26 Telecommunications Service Quality Uniform Measurement Guidelines, New York Public ServiceCommission, Office of Telecommunications, January 27, 2011.http://www3.dps.ny.gov/W/PSCWeb.nsf/96f0fec0b45a3c6485257688006a701a/7f830c1ff90ab31285257687006f388d/$FILE/Revised%20Uniform%20Measurement%20Guidelines%20-%20January%2027,%202011%20-%20Final%20.pdf

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    23/80

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    24/80

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    25/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    22

    Verizon ultimately settled this case, agreeing to a survey of outside plant conditions, and to make

    timely repairs to plant that was found to be deficient.32

    36.In 2008 Verizon responded to a complaint filed by the Florida Attorney Generals office

    regarding poor service quality by pointing to the benefits that arise due to Verizons fiber to the

    premises (FTTP) deployment. Verizon stated that it had been:

    improving its network reliability through the hundreds of millions of dollars invested inits FTTP network. That network improves maintenance and repair performance in partbecause of the physical properties of fiber, including for example its immunity tomoisture, which make the new network less susceptible to outages than the old coppernetwork. Moreover, when outages and troubles do occur on the fiber network, they areeasier to diagnose and repair, which shortens the time to restore service and cleartroubles. As Verizon continues to extend its FTTP network, and more customers take theFiOS services offered on the network, Verizon's already high network reliability willimprove still further.33

    37.However, the Florida Public Service Commission did not find Verizons argument to be

    persuasive. Writing in 2009, the Florida Commission stated:

    Verizon has indicated that the rate of service line troubles has dropped by almost 95%where the copper network was replaced by fiber. The company also indicated that theFTTP network, in significant part, has contributed to a 34% reduction in out-of-serviceand service-affecting trouble reports from the fourth quarter of 2005 through 2007.Despite the reduction in out-of-service and service-affecting trouble reports due to the

    FTTP network, Verizons overall service quality declined during the same timeframe. It

    is our view that an investment in the FTTP network is not a justifiable reason for

    Verizons failure to maintain and support its copper network, which currently serves the

    vast majority of Verizons customers.34

    The experience in Florida appears to be very similar to conditions in Californiacustomers

    served on the FiOS platform experience OOS service quality improvements, while customers

    served on legacy plant experience a lower level of OOS service quality.

    32 In re Verizon Service Quality in Western Massachusetts, D.T.C 09-1, Settlement Agreement.33 Response and Answer of Verizon Florida to Joint Petition, In re: Joint Petition for show cause proceedings againstVerizon Florida LLC for apparent violation of Rule 24-4.070, FAC., service availability, and impose fines, by theOffice of the Attorney General, Citizens of the State of Florida, and AARP, Docket No. 08027S-TL, filed June 9,2008. http://www.psc.state.fl.us/library/FILINGS/08/04890-08/04890-08.pdf34 In re: Joint petition for show cause proceedings against Verizon Florida LLC for apparent violation of Rule 25-4.070, F.A.C., Customer Trouble Reports, and impose fines, by the Office of the Attorney General, Citizens of theState of Florida, and AARP. Docket No. 080278-TL Order No. PSC-09-0015-SC-TL. Order to Show Cause,January 5, 2009, p. 6, emphasis added.

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    26/80

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    27/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    24

    Summary

    40.In conclusion on the Commissions question regarding the reason why URF carriers are missing

    key service quality standards, the answer boils down to management choices. AT&T and

    Verizon have given priority to customers who purchase their premium services. AT&T and

    Verizon believe that this is appropriate as they have the ability to challenge cable companies in

    the triple-play game in areas where they have upgraded their networks. AT&T and Verizon do

    not believe that they will face market penalties for providing lower quality service to the

    customers of their non-premium services. Absent penalties from market forces, it is the

    responsibility of the Commission to ensure that all voice service consumers, regardless of the

    platform on which they are served, receive high quality service.

    Question 4: The current service quality standards and measures focus on retail customers.

    Should standards be adopted for wholesale service? If so, what should these standards and

    measures be?

    41.Response to Question 4: The Commission established a performance incentive plan (PIP)

    related to wholesale service quality in D.02-09-050. The Commission later modified that

    decision in D.08-12-032. This 2008 modification to the PIP resulted in a streamlining of

    performance standards, and made the application of the PIP an opt in exercise for the CLEC

    i.e., the PIP must be specified as applying to the CLEC in an interconnection agreement.40 The

    amended PIP still includes specific non-performance penalties, capped at $15 millionper month

    for all CLECs combined.41

    I have been advised by counsel that these wholesale service quality

    standards are still in effect.

    40 D.08-12-032, p. 5.41 D.08-12-032, Appendix, p. 6.

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    28/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    25

    42.Service quality standards and reporting requirements for wholesale services continue to be

    important. Wholesale firms and their customers are adversely affected in the same manner as are

    the ILECs retail customers. However, the customers of CLECs have another layer of

    information to confrontis the problem associated with their CLEC provider or with the ILEC's

    network? Reliable information on the performance of ILEC wholesale offerings will assist retail

    customers in assessing the performance of their CLEC provider.

    Question 5: Is it appropriate to implement a penalty mechanism when standards are not met? If

    so, what should it be?

    43.Response to Question 5: A penalty mechanism, including a set of service guarantees, is

    appropriate. Service quality penalties provide a deterrent to service quality deterioration. The

    Commission has found it necessary to impose service quality penalties in the past.42 The

    experience under the GO 133-C regime, discussed above, indicates that the largest URF carriers

    are discriminating in their service quality practices. Penalties will redirect these carriers

    attention to delivering high quality services to all customers.

    44.As discussed in the response to Question 1, one component of the penalty mechanism should be

    the creation of service guaranteesdirect payments made to consumers to compensate them for

    poor performance. With regard to service guarantees, the following should apply: (1) OOS

    restorationfor customers that are out of service for more than 48 hours, the ILEC should credit

    the customer for one months service, measured at the basic service rate plus subscriber line

    charge. (2) Installationfor customers who do not have service installed within the five-day

    period, a credit of $30 should be applied to the customers first monthly bill. (3) Missed

    42 See, for example, Resolution T-17120, November 1, 2007.

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    29/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    26

    installation or repair appointmentsfor customers with missed installation or repair

    appointments, a credit of $30 should apply to the customers monthly bill.43

    45.In addition, a service performance penalty structure is appropriate. The URF carriers, especially

    AT&T and Verizon, have exhibited substandard performance in some categories of the

    Commissions standards for extended periods. The performance penalty mechanism

    recommended uses a service quality index (SQI) that assigns penalty points based on carrier

    deviation from the Commissions service quality standards. The SQI is based on how the carrier

    performs vis--vis the Commissions service quality standards. Monthly penalty points are

    assigned based on the difference between the Commissions standard and the carriers actual

    performance. For example, with regard to the OOS standard of 90% restored in 24 hours or less,

    monthly performance by a carrier of 85% restored would result in five (5) penalty points being

    assigned.

    46.The SQI has the following components(1) a benchmark annual penalty; (2) penalty points that

    are assessed when the carrier is not in compliance with Commission standards; (3) a

    forgiveness provision for brief periods of non-compliance which are quickly remedied; (4) an

    OOS offset based on OOS service guarantee payments made; (5) a rebate to customers of the

    remaining balance of service quality penalties; and (6) an assessment of the impact of the penalty

    mechanism.

    43 The following, where applicable, are exceptions to the utilitys service guarantees described above.(1) There is a Category 1, 2, or 3 Storm Condition.(2) There is a declared Emergency Event.(3) Access to the customers premise is not available or the customer is not ready for service.(4) The premise is not deemed safe.(5) Causes related to force majeure, which include but are not limited to injunction or any decree or order of anycourt or governmental agency having jurisdiction, strikes or other labor disputes such as lockouts, slowdowns orwork stoppages, sabotage, riot, insurrection, acts of public enemy, fire, flood, explosion, earthquake or other acts ofGod, or accidental destruction of or damage to facilities.

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    30/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    27

    Benchmark Annual Penalty

    47.The service quality penalty benchmark for each URF carrier should be established at a level that

    represents a substantial penalty so that the carrier will be provided significant incentives to

    comply. As noted by the CPUC regarding the performance incentive plan associated with

    AT&T Californias (then Pacific Bells) performance incentive plan (PIP), service quality

    penalties should include a potential liability that provides a meaningful and significant incentive

    to comply with the designated performance standards.44

    48.Because the URF carriers have different sizes, the benchmark penalty should be scaled for each

    carrier, while providing a meaningful and significant incentive to comply with the designated

    performance standards. Given that each carriers basic rates are known, and given that the

    service quality reports require access line reports, I believe that each carriers benchmark penalty

    should be set based on that data, using the following approach:

    Multiply the year-end access line count by the weighted-average annual basic rate ineffect during the year. Then multiply that amount by 4.0% to determine the benchmarkpenalty.

    For example, as of the end of the third quarter of 2011, AT&Ts service quality report listed

    6,249,528 access lines. For ease of illustration, I will assume that this number of access lines

    also represents AT&Ts year-end total, and that all customers are residential flat-rate customers,

    with a monthly rate of $19.95.45

    Given these assumptions the annual benchmark penalty facing

    AT&T for 2011 would be about $60 million.46 While this penalty is substantial, it is

    proportionally smaller than other recent penalty mechanisms that have been imposed on ILECs.

    For example, on January 18, 2012, the Vermont Commission reduced FairPoints benchmark

    44 D.02-09-050.45 G.O. 133 requires reporting for residential and small business customers. The weighted average annual rateshould be based on the relative proportions of residential and small business customers at the end of the reportingyear, and the residential and small business basic rates.46 (Calculated as 4.0 percent of $19.95 x 6,249,528 x 12 = $59.8 million). Of course, in practice the actual year-endtotal access line count and weighted-average rate would be utilized.

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    31/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    28

    annual penalty from $10.5 million to $1.65 million.47 FairPoint Vermont has about 130,000

    access lines, i.e., FairPoint Vermont is about 2.4% the size of AT&T California. Thus

    FairPoints penalty, if scaled by AT&T California line count, would be equivalent to a $438

    million penalty under the old Vermont regime, and $68.75 million under the new Vermont

    regime.

    Penalty Points

    49.To calculate the penalty points the standard for each performance measurement category should

    be compared to the carriers actual performance, and the difference between the standard and the

    carriers actual performance should calculated. This difference will reflect the number of penalty

    points assessed.

    50.Service quality performance points should be assessed on a monthly basis for trouble reports and

    OOS restoration. For answer time, the penalty assessment should be based on the quarterly data

    reported by the companies. Table 3 shows an example of how penalty points would be

    calculated.

    Table 3: Penalty Points and Reporting PeriodEvaluation

    Period

    Service Quality Category and

    Standard

    Carriers Reported

    Performance

    Penalty Points

    Month Trouble Reports (6 Percent forexchanges with 3,000 or more lines)

    2 percent None

    Quarter Answer Time (80 Percent in LessThan 60 Seconds)

    75 percent 5

    Month Out-of-Service Restoration (90Percent in 24 Hours or Less)

    80 percent 10

    47 See, Vermont Public Service Board Docket No. 7724, Petition of Telephone Operating Company of VermontLLC, d/b/a FairPoint Communications ("FairPoint"), for approval of a Successor Incentive Regulation Plan ("IRP"),

    pursuant to 30 V.S.A. 226b, January 18, 2012.http://psb.vermont.gov/sites/psb/files/orders/2012/7724%20OrderApprovingSuccessorIncentiveRegPlan.pdf

    See also, Docket No. 6959, Investigation into a Successor Incentive Regulation Plan for Verizon New England Inc.,d/b/a Verizon Vermont; Docket No. 7142, Investigation into Tariff Filing of Verizon New England Inc., d/b/aVerizon Vermont, in re: Compliance Filing in Docket, 6959, Order Entered April 27, 2006.http://psb.vermont.gov/sites/psb/files/orders/2006/6959_7142fnl.pdf

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    32/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    29

    As shown in example in Table 3, if a carriers monthly trouble reports in exchanges with 3,000

    or more access lines is 2 percent rather than 6 percent, the service level exceeds the standard, and

    no points are assigned for that month. If a carriers quarterly speed of answer was 75% in less

    than 60 seconds rather than the 80% standard, 5 penalty points should be assessed for the quarter.

    If a carriers monthly OOS restoration was 80%, rather than the 90% standard in a given month,

    the difference in percentage points should be tallied as penalty points for the monthten (10) in

    this example.

    Annual Penalty Assessment

    51.The penalty assessment should be conducted on an annual basis, with penalty points calculated

    on either a monthly or quarterly basis totaled at the end of the yearly evaluation period to assess

    penalties. Table 4 shows an example using AT&Ts full-year 2010 service quality performance.

    Table 4: Hypothetical Penalty Points Using AT&Ts 2010 Service Quality Data

    Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec AnnualPenaltyPoints

    OOS Standard

    (Percent Restored)

    90 90 90 90 90 90 90 90 90 90 90 90

    AT&T ActualPerformance

    50.7 40.2 53.4 38.9 34.2 32.7 32 54 75.6 66.7 69.6 51.7

    OOS Monthly PenaltyPoints

    39.3 49.8 36.6 51.1 55.8 57.3 58 36 14.4 23.3 20.5 38.3 480.42

    Trouble Reports

    Standard

    AT&Ts Actual Performance

    6% 2.38 2.17 1.79 1.45 1.33 1.33 1.36 1.43 1.32 1.74 1.68 2.29

    8% 3.93 3.23 2.71 2.13 1.77 1.9 1.91 1.82 1.56 2.45 2.67 3.52

    10% 4.85 3.97 3.27 2.79 2.14 2.25 2.76 2.26 2.1 2.92 3.47 3.83

    6% Penalty Points 0 0 0 0 0 0 0 0 0 0 0 0 0

    8% Penalty Points 0 0 0 0 0 0 0 0 0 0 0 0 0

    10% Penalty Points 0 0 0 0 0 0 0 0 0 0 0 0 0

    Quarterly Answer

    Time

    Standard: 80% in Less than 60 Seconds

    AT&Ts Actual Performance

    Penalty Points 1st Quarter 2nd Quarter 3rd Quarter 4th Quarter

    Percent in 60 Secondsor Less

    72.8 85.4 85.7 67.5

    Penalty Points 7.2 0 0 12.5 19.7

    Total 500.12

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    33/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    30

    Application of the Penalty Mechanism

    52.I believe that it is reasonable to structure the penalty mechanism so that penalties escalate and

    generate proportionally higher penalties as service quality performance deteriorates. Table 5

    shows the escalating penalty structure, using the $60 million benchmark penalty from the AT&T

    example. Table 5 shows that penalties are based on the number of points generated by the

    carrier, and that the dollars per penalty point increase as the carriers service quality deteriorates,

    as reflected by it earning more points. Appendix 1 shows the formula that result in the values

    shown in Table 5.

    Table 5: Example of Penalty Structure Using Data from AT&T to Establish the Benchmark

    PenaltyAnnual Points Accumulated Dollars per Point Benchmark Penalty Maximum

    1 to 25 $60,000 $1,500,000

    26 to 50 $120,000 $4,500,000

    51 to 100 $210,000 $15,000,000

    101 to 150 $240,000 $27,000,000

    151 and Above (to Maximum) $330,000 $60,000,000

    Calculating the Penalty

    53.Continuing with the AT&T example, Table 4 shows that AT&T would have had accrued 500

    penalty points during 2010 if the mechanism had been in place. Using the penalty structure

    shown in Table 5, the first 25 points would be assessed at $60,000 per point, the next 25 would

    be assessed at $120,000 per point, the next 50 at $210,000 per point, and the next one-hundred at

    $330,000 per point, for a total annual penalty of $60 million.48

    On the other hand, if AT&T had

    incurred 50 penalty points during the year, its total penalty would be $4.5 million.49

    48 If a carrier were to have much better performance than AT&T, its penalty points would not reach theprogressively higher point assessments.49 I.e., the first 25 points at $60,000 each, and the next 25 points at $125,000 each.

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    34/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    31

    Offset Benchmark Penalty by Amount of OOS Service Guarantees

    54.For each annual period the Commission may reduce the carriers calculated benchmark penalty

    by the amount of the service guarantee associated with OOS paid during that same period. The

    Commission should collect data on all service guarantee payments.

    Forgiveness for Brief Periods of Substandard Performance

    55.It is also reasonable to include a substandard performance forgiveness provision. For trouble

    reports and out-of-service restoration, if any a carrier drops below the minimum performance

    standard for any single month, and returns to compliance the following month, and remains in

    compliance for the balance of the year, then the single-month substandard performance penalty

    should be forgiven.50

    One exemption per service quality performance classification per year

    should be permitted under the plan. For example, during 2011, up through the third quarter

    reports, SureWest has satisfied the OOS restoration in all months except February, when it

    restored 87%, just shy of the 90% threshold. If SureWests performance for the last three

    months is above the 90% threshold, the February violation would be without penalty.

    Customer Rebates

    56.The penalty dollars should be returned to all customers as an annual rebate, which should appear

    on customers monthly bill sometime in the first quarter of the year following the assessment.

    The Commission should require a line-item on the bill labeled Rebate for Substandard Service

    Quality during the Year 20XX.

    Evaluation of the Penalty Mechanism

    57.If URF carriers do not come into compliance while facing the level of incentive associated with

    the method described, the Commission should revisit the penalty level in the future.

    50 If December was the only month during the year where the carrier fell below the standard, January of thefollowing year should be used to determine whether forgiveness will be allowed. The forgiveness provision doesnot apply to answer time, as answer time penalty points are assessed using quarterly averages, which gives thecarrier a chance to earn forgiveness within the quarterly period.

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    35/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    32

    Question 6: Should exemptions be allowed for calculating reported service quality results for

    States of Emergency, Catastrophic Events and events beyond the control of the utility

    management? If so, should there be limitations on the geographic area(s) covered and/or the

    duration of the exemption?

    58.Response to Question 6: The exemptions should apply to the calculation of service quality

    performance metrics alonethe carriers should not be exempted from reporting service quality

    data for the period during the emergency. Duration should be consistent with the duration of the

    actual emergency conditions.

    59.With regard to emergency situations, the CD report states that there are differing interpretations

    of what constitutes an emergency, and that there are differing interpretations on whether a state

    of emergency constitutes an exemption for reporting anything for the entire company for one or

    more months.51 This lack of consistency is a serious problem that was confirmed by the URF

    carriers in their responses to discovery. While AT&T, Verizon, and SureWest point to

    proclamations from the Governors office or other governmental entities as indicating the start of

    an emergency and its geographic scope, the companies have different interpretations of

    determining when an emergency is over.

    AT&T determines the timeframe associated with a declaration of emergency byutilizing supporting information such as rain data, blocked roads, facilities impacted suchas cables/pairs, poles, manholes, and the number of opening tickets, daily ticket volumes,which exceed the norm.

    52

    Declarations of emergency issued by the State of California specify the start of theemergency situation, but do not specify when an emergency situation has ended. Verizon

    determines the "declarations of emergency" to be ended when repair ticket volumes havereturned to normal volume levels.

    53

    SureWest believes that a declaration of emergency has ended when it has repaired alltrouble related to the emergency and is operating back under normal conditions.

    54

    51 CD Report, p. 12.52 AT&T response to TURN Set 1, question 1.9(c).53 Verizon response to TURN Set 1, question 1.9(c).54 SureWest response to TURN Set 1, Question 1.6(c).

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    36/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    33

    These responses indicate that subjective criteria are being utilized to determine when an

    emergency situation ends. For example, this could be remedied by the Commission defining

    normal trouble ticket volumes to be based on the average monthly trouble ticket volumes

    experienced by the carrier during the previous twelve month period.

    Question 7: Should carriers provide the Commission with additional service quality data in the

    aftermath of a catastrophic event? If so, what additional data is appropriate?

    60.Response to Question 7: Yes. As discussed above, an emergency response plan should be

    required. Following the emergency, carriers should provide the Commission with a report,

    supported by appropriate data, regarding how the emergency response plan was implemented,

    and how the company performed under the emergency response plan. The Commission should

    develop a full understanding of how carriers performed during the emergency, and should

    compare and evaluate carrier performance in subsequent emergency situations in light of past

    emergency performance data.

    61.In addition, the carrier should continue to provide the Commission with unadjusted raw data

    regarding performance vis--vis the standard performance metrics in the affected areas (and

    throughout the carriers service area) during the period of the emergency. It appears that GO 133-

    C requires this type of reporting. (When reporting includes a delay for one or more months, the

    carrier shall provide supporting information as to why the month should be excluded and work

    papers that show the date(s) of the catastrophic event and/or widespread outage and how the

    adjusted figure was calculated.)

    62.The carriers should provide the Commission information regarding the termination of the

    emergency period. This will require that the carriers internal tracking of the repair ticket

    volumes and normal repair ticket volume be shared with the Commission.

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    37/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    34

    Question 8: What other reporting requirements or measures are appropriate to evaluate quality

    of service?

    63.Response to Question 8:

    64.See response to Questions 1 and 2.

    Question 9: Should the Commission hire a network consultant to: a) review and evaluate the

    service quality results; b) to evaluate and monitor telecommunications carriers infrastructure,

    investments and manpower to improve service quality; and c) to help the Commission determine

    best practices? If so how should they be funded and who should administer the contract(s)?

    65.Response to Question 9: Yes, a network consultant should be retained. As discussed elsewhere

    in this Declaration, there is evidence that AT&T and Verizon have made management decisions

    to favor their advanced network services. The Commission must develop an understanding of

    the extent to which the legacy networks of these companies have been affected by the priority

    that has been given to the advanced services. If inadequate maintenance and investment has led

    to degradation of copper plant, the extent of the problem must be documented.55 Legacy copper

    networks continue to provide a vital function. Not only do such networks provide connections to

    the majority of California households, but copper also serves as a platform for CLECs, which has

    provided benefits to the business telecommunications market. Copper continues to provide

    avenues for CLEC broadband innovation, such as Ethernet over copper applications that can

    economically expand copper loop data carrying capacity.56

    66.The network consultant should be charged by the Commission to conduct a thorough evaluation

    of maintenance and service restoration practices and priorities (both in normal and emergency

    55 For example, the Bill Analysis of the Assembly Committee on Utilities and Commerce reported Telephonecorporations and the 911 County Coordinator Task Force reports that public service access points sometimesreceive 911 calls that are triggered by damaged or aging lines, weather, or other causes. As phantom 911 calls have

    been a widespread problem, the extent of plant degradation may also be widespread.http://www.leginfo.ca.gov/pub/09-10/bill/sen/sb_1351-1400/sb_1375_cfa_20100625_140146_asm_comm.html56 See, for example, http://www.telepacific.com/offer/data-network/ethernet-broadband.asp

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    38/80

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    39/80

  • 8/2/2019 R.11!12!001 Public Roycroft Declaration 1-31-12

    40/80

    Declaration of Trevor R. Roycroft, Ph.D.On Behalf of TURNCPUC R.11-12-001

    _________________________________________________________________________________________________________

    37

    discrimination based on customer location, or the type of technology utilized by the ILEC to

    provision service.

    71.This data also reinforces the fact that outside of those areas where the largest URF carriers have

    deployed advanced facilities, that other market alternatives to wireline telephone service are not

    viewed by the URF ILECs as bringing a level of competition that warrants high levels of service

    quality.

    Barriers to Switching

    72.The OIR asks about barriers to switching to other services and service providers if a customer is

    dissatisfied with the quality of wireline telephone service. I analyzed California markets for

    local telephone services in 2