8/7/2019 is self regulated peer review indicate audit quality
1/30
1
Is Self-Regulated Peer Review Effective at Signaling Audit Quality?
Jeffrey R. CasterellaColorado State University
Kevan L. Jensen
University of Oklahoma
W. Robert KnechelUniversity of Florida
September 2006
Helpful comments were received from Clive Lenox, Eddy Vaasen, Barry Lewis, and participants at the2006 International Symposium on Audit Research. Special thanks also to the insurance company thatprovided the data for the study.
8/7/2019 is self regulated peer review indicate audit quality
2/30
2
Is Self-Regulated Peer Review Effective at Signaling Audit Quality?
Abstract
This paper examines whether peer review conducted under the AICPAs self-regulatory regime
has been effective at signaling audit quality. In spite of the long-standing debate about self-
regulated peer review in the auditing profession, there is a surprising lack of research evidence as
to whether such reviews are effective at signaling or improving audit quality. Prior research has
examined whether the information contained in peer-review reports is associated withperceived
audit quality (Hilary and Lennox 2005). We examine whether the information contained in peer-
review reports is associated with actual audit quality. Our results suggest that self-regulated peer
review does appear to provide effective signals regarding audit-firm quality. Specifically, we
find that the number of weaknesses identified in peer-review reports is associated with other
potential indicators of weak quality control or risky practices within accounting firms such as
selling tax shelters, overworking staff, and taking on risky clientseven after controlling for
changes in the peer-review environment over time. We also find that the number of weaknesses
identified in peer-review reports is useful in predicting audit failure (i.e., malpractice claims
alleging auditor negligence), and that certain types of peer-review findings (engagement-
performance weaknesses, personnel-management weaknesses) are particularly useful in this
regard.
8/7/2019 is self regulated peer review indicate audit quality
3/30
3
1. Introduction
This paper examines whether self-regulated peer review is an effective mechanism for
differentiating quality among audit firms. Peer review has long been a part of the AICPAs
program for enhancing audit quality in the accounting profession. Since its beginnings in the
1970s, peer review has sought primarily to improve audit quality by identifying significant audit-
firm weaknesses, and by communicating those weaknesses to the reviewed firms who can then
take corrective actions (White et al. 1988; AICPA 2004). The AICPA has also recognized that
the general public (including regulators) uses peer review reports for their own decision-making
purposes (AICPA Peer Review Board 2004). Assuming audit clients (and regulators) value audit
quality, this provides additional market pressure on audit firms to maintain adequate quality-
control systems. This has also led to a renewed emphasis on peer-review transparency, and to
much debate regarding the information content of peer review reports and the disclosure of audit-
firm weaknesses to the public (e.g., Bunting 2004; Snyder 2004).
In this paper, we focus on the information content of the peer-review report itself. In
order for peer review to have any impact on audit quality, it must effectively identify weaknesses
in lower-quality audit firms and communicate this information in the report. Without this,
corrective action cannot be taken, and related market pressure cannot be brought to bear. Recent
decisions by regulators have implied that self-regulated peer review is no longer viewed as an
effective mechanism in this regard. For example, the Sarbanes-Oxley Act of 2002 now requires
audit firms with public clients to have PCAOB inspections rather than traditional peer reviews
(US House of Representatives, 2002). This change was partly a reaction to the observation that
most audit failures involved audit firms who had received unmodified peer-review reports.
Unfortunately, few empirical studies of peer-review effectiveness were available at the time of
8/7/2019 is self regulated peer review indicate audit quality
4/30
4
the change to shed light on the issue. In fact, little research to date has examined whether peer-
review reports credibly capture audit-firm quality.1
This is unfortunate since many US audit
firms, and most audit firms in other countries, continue to rely on peer review as part of their
quality-control programs (Hilary and Lennox 2005).2
Moreover, understanding the effectiveness
of peer review is imperative to the debate about whether self-regulation is the appropriate
approach for the auditing profession.
Using audit-firm data from an insurance company, we examine directly the link between
peer review reports and audit-firm quality in two ways. We first test whether the information
contained in peer-review reports is calibrated with other potential firm-specific indicators of
lower audit quality across a wide range of audit firms. Our results show that the number of
weaknesses identified in peer review reports is indeed associated with the existence of these
firm-specific attributes--even when controlling for an evolving peer-review environment over
time. We then test whether the detailed information communicated in peer-review reports is
helpful in predicting actual audit quality. Using malpractice claims as evidence of poor audit
quality (on average), we find that the number of weaknesses identified in peer-review reports
appears to be helpful in predicting audit quality. We also find that some types of weaknesses
identified in peer-review reports appear to be helpful in predicting audit quality (e.g., personnel
management, engagement performance) while others do not (e.g., independence, client
acceptance, and monitoring). We interpret our results to be supportive of self-regulated peer
review being an effective mechanism for differentiating audit quality among firms. Moreover,
1 It is too early to determine if the PCAOB inspection process will reduce the number of audit failures of publiccompanies in the US. However, it would be unrealistic to expect the incidence of such failures to ever drop to zero.A difficulty that will arise when it comes time to evaluate the efficacy of the PCAOBs approach is the lack of dataon base rates in the pre-PCAOB regime. This paper provides some basis for benchmarking current efforts atregulation against the self-regulatory regime in existence prior to 2002.2 Peer review continues to be a requirement for membership in the AICPA. Many state regulators also require peerreview for CPA licensure.
8/7/2019 is self regulated peer review indicate audit quality
5/30
5
since every firm in our study received an unmodified peer-review report, the ability to
differentiate audit quality appears to hold even among the vast majority of firms deemed
acceptable under the self-regulatory model.
The remainder of this paper is organized as follows. In the next section we discuss the
background and objectives of peer review, and develop hypotheses regarding peer reviews
ability to signal audit-firm quality. In the third section, we discuss our research method and data.
The fourth section presents the results of our hypothesis tests, followed by a summary and
discussion of our results.
2. Peer review and audit quality
The AICPA has for many years incorporated peer review as one of its primary methods
of controlling quality among CPA firms. Even before mandatory peer review was adopted by
the AICPA, there was a system of voluntary peer review that started in the US in the 1970s.
This was implemented primarily as part of the professions response to a wave of audit failures
that caused the public to question the effectiveness of audits. The voluntary phase of peer review
eventually gave way to a form of mandatory, yet self-regulated, peer review that was instituted
by the AICPAs membership in the late 1980s at the prodding of the SEC (Berton 1987; White
et al. 1988). Self-regulated peer review remained basically intact from that time until the
creation of the PCAOB in 2002. Although the creation of the PCAOB implies that self
regulation failed, the AICPA recently reasserted its faith in and commitment to peer review
albeit a more transparent form of peer reviewfor its membership (AICPA 2004).
The AICPAs peer-review program has always been open to controversy. While
commentators have been enthusiastic in their support of the program (e.g., Mautz 1984; Kaiser
1989; Felix and Prawitt 1993), critics have made reasonable arguments over the years as to why
8/7/2019 is self regulated peer review indicate audit quality
6/30
6
self-regulated peer review cannot work. Some point to the anecdotal evidence that peer-reviews
identify relatively few weaknesses in reviewed firms (e.g., Wallace and Cravens 1994), that
almost all peer-review engagements result in unmodified reports (e.g., Hilary and Lennox 2005),
and that most audit failures involve peer-reviewed firms (e.g., Fogarty 1996). Others argue that
peer review cannot be effective because of the general lack of independence among reviewers
and reviewees (Grumet 2005), and because the formality of the process allows firms to develop
explicit compliance plans based on charts and checklists (Atherton 1989) that have little impact
on the conduct of audits (Austin and Lanston 1981). Fogarty (1996) argues that the AICPAs
peer review program may be nothing more than ceremonial logic because, among other things,
(1) the program was created by a trade organization focused more on maintaining the
professions image than on improving actual audit quality, (2) reviews focus on the quality-
control process rather than actual audit quality, and (3) reviews focus on documentation of the
process rather than the nature or appropriateness of audit decisions.
The key to determining whether peer review is effective is to examine whether it
successfully identifies weaknesses in lower-quality audit firms. In other words, do peer-review
reports credibly reflect audit quality? Empirical studies shed some light on this question, but
most of this evidence is indirect. For example, three studies examining ex-post assessments of
audit quality find that audit firms required to undergo peer review are associated with higher-
quality audits (Deis and Giroux 1992; Giroux et al. 1995; Krishnan and Schauer 2000). On the
other hand, studies using audit fees as a proxy for audit quality are less clear on this question.
Francis et al. (1990) find no evidence that auditors subject to peer review are able to charge
higher fees. However, Giroux et al. (1995) find that such firms may indeed charge higher fees,
but not on a per-hour basis. Similarly, a survey by Schneider and Ramsay (2000) suggests that
8/7/2019 is self regulated peer review indicate audit quality
7/30
8/7/2019 is self regulated peer review indicate audit quality
8/30
8
market participants are correct in their perceptions in this regard, then it seems likely that the
peer-review signal should be associated with other indicators of audit-firm quality as well. In
other words, firms having observable attributes suggestive of weak or risky quality-control
practices at the time of the review should receive reports indicating lower quality, all other things
equal. Given that virtually all firms receive unmodified peer-review reports (Hilary and Lennox
2005), this differentiation can only come from specific comments in the accompanying LOC.
This leads us to our first hypothesis:
Hypothesis 1: Peer-review findings are associated with the presence of audit-firm
attributes indicative of lower audit quality.
Ultimately, whether peer review provides an effective signal of audit quality depends on
whether its results are well calibrated with actual audit quality. While audit quality is generally
unobservable for specific audits (OKeefe et al. 1994), poor quality is observable with hindsight
if an engagement results in litigation or a claim of malpractice against an audit firm (Palmrose
1988). That is, a firm experiencing a legitimate malpractice claim (i.e., audit failure) should
generally have received weaker peer-review reports in the past. A large literature exists
concerning the precedent conditions underlying audit failure (see Latham and Linville 1998) and
the ability of auditors to identify management fraud (see Nieschwietz et al. 2000). However
while research has established an empirical link between the presence of peer review and
perceivedaudit quality, virtually no research exists directly linking detailed peer-review findings
and actual audit quality.3 This leads us to our second hypothesis:
Hypothesis 2: The likelihood of audit failure (i.e., poor audit quality) is associated with
peer-review findings.
3 Hilary and Lennox (2005) provide a sensitivity test showing an association between peer-review findings and theexistence of Accounting and Auditing Enforcement Releases (AAERs). However, only 3.5 percent of the firms theyexamine had clients subject to AAERs. In most of these cases, reviews were conducted after the SEC investigationshad begun, which may have placed unusual pressure on peer reviewers to identify weaknesses in those cases.
8/7/2019 is self regulated peer review indicate audit quality
9/30
9
3. Research design and data collection
The data for this study are drawn from the proprietary files of an insurance company
specializing in professional liability coverage for local and regional accounting firms. The
insurance company is a subsidiary of a broader professional services organization and is not
publicly-owned.4
As part of the underwriting process, accounting firms applying for coverage are
required to have had a peer review and must have received an unmodified report.5 The insurers
underwriting files contain copies of the peer review reportsincluding the accompanying LOCs
(if any)for each audit firm. These LOCs describe weaknesses or deficiencies identified during
the peer-review process. Our peer-review variables are thus extracted directly from the peer
review reports and LOCs.
Since we use audit failure as an indicator of low audit quality, we first identified all the
audit-related claims involving accounting firms covered by the insurer during the period 1987
through 2000. Each observation represents a unique claim for deficient audit services for which
the insurance company made a nontrivial settlement (greater than $5,000). This process yielded
79 separate audit malpractice claims. A control group of 79 non-claim observations was
constructed by matching each claim firm with a similar accounting firm having no audit-related
malpractice claims.6
Each non-claim firm was covered by the insurance company during the
same period as the claim firm, experienced no audit-related claims for the five years preceding
the year of the observed claim, and was similar in size to the claim firm based on total fees. The
resulting sample included 158 observations.
4 The company is subject to state regulation, reporting requirements, and inspection. It has been in existence forover 20 years and sells direct to its clients. Its clients range in size from small local firms with a single office tolarge regional firms with several offices. The largest accounting firms are generally self insured.5 This requirement results in all firms in our sample having unmodified reports. It also suggests that the insurancecompany perceives peer-review reports as being useful in assessing risk.6 Previous studies of audit failure have also employed matched-pair designs (e.g., Stice 1991; Lys and Watts 1994).
8/7/2019 is self regulated peer review indicate audit quality
10/30
10
Underwriting applications are updated once a year. They contain information regarding
the structure of the accounting firms, the services they provide, the nature of their clienteles, the
professional activities of their owners, and some details regarding their recent histories.
However, they contain no information about specific audit clientsincluding those involved in
the audit failures. Our data comes from the underwriting files for the two years prior to the
claim. Data for the nonclaim firms are drawn from the same calendar periods. Most of the data
was hand collected by a research assistant working directly under the supervision of one of the
authors. The entire data set was then reviewed by a different author who had not been directly
involved with initial data collection. Discrepancies were resolved by re-examination of the
documents in the appropriate files.
4. Peer review results and firm-quality attributes
4.1. Model development
Our first hypothesis predicts that peer-review outcomes are associated with observable
audit-firm attributes indicative of low audit quality. We test this hypothesis using a model
wherein we regress the number of peer-review weaknesses identified in the LOC against a series
of firm-specific variables associated with likely audit-firm quality. We extract these variables
from the applications used by the insurer to make risk assessments about each audit firm. This
same information is used specifically to determine insurability, policy limits, premiums, and
deductiblesin other words, to assess the risk of a claim being filed against a client. Since the
likelihood of a claim being filed against a client is essentially the same as the likelihood of
alleged audit failure, these variables appear to be reasonable predictors of audit-firm quality
particularly given the insurance companys care and expertise in the underwriting process.
8/7/2019 is self regulated peer review indicate audit quality
11/30
11
For organizational purposes, we categorize these variables using the five quality-control
elements defined by the AICPA: (1) independence, integrity, and objectivity; (2) personnel
management; (3) client acceptance and continuation; (4) engagement performance; and (5)
monitoring (AICPA 1996). We define our dependent variable (FINDINGS) as the total number
of weaknesses identified in the LOC. We then estimate the following model using an ordered
logit model regression:
FINDINGS = b0 + b1TAXSHLT + b2CPAS + b3WKLOAD + b4CLNTRSK (1)+ b5HISTORY + b6LFEES + [control variables]
with explanatory variables as follows.
TAXSHLT: (Independence) Dummy variable indicating whether a firms owners are activelyinvolved in organizing, managing, receiving compensation from, or otherwisepromoting tax shelters to their clients. Regulators have recognized the detrimentaleffects on independence if tax shelters are marketed by audit firms to their clients(PCAOB 2005). Hence, auditors participating in such activities may have more laxattitudes in general about independence.
CPAS: (Personnel Management) The percentage of professional staff at an audit firm whoare CPAs. Such a measure reflects the fact that some firms are more successfulthan others in hiring high-quality personnel, in providing the necessary training andexperience for certification, or both. Lys and Watts (1994) describe audit structurein similar terms and find evidence of a negative relation between structure andlitigation risk.
WKLOAD: (Personnel Management) The natural log of the ratio of total fees to the number ofprofessional staff in the firm. Personnel management relates not only to hiring andtraining practices, but also to the assignment of staff to engagements. We includethis second measure to address this fact. Its intent is to represent the workloadimposed on professional staff and should reflect how strained they are to fulfill theirprofessional obligations.
CLNTRSK: (Client Acceptance) The percentage of a firms clients who are financial institutionsor are in the entertainment industry. The insurer identifies firms having clients inthese specific industries as their experience suggests that such clients tend to bemore complex and more risky than other types of clients (see Palmrose, 1988).Having such clients may thus indicate less stringent screening of clients in general.
HISTORY: (Engagement Performance) A dummy variable indicating whether a firm has beeninvestigated by state/professional boards for violations of professional regulations
8/7/2019 is self regulated peer review indicate audit quality
12/30
12
or practice standards. A history of regulatory problems is a good indicator of lowerstandards of engagement performance. Hilary and Lennox (2005) use a similarvariable representing pending litigation against reviewed firms and find a negativelink with peer-review outcomes.
LNFEES: (Monitoring) The natural log of the audit firms total fees. Larger firms generallyhave more resources to invest in quality control, including monitoring of theirquality control programs. They also have more to lose by providing poor qualityservices to clients (DeAngelo, 1981).
7
Two variables are included in the model to control for other circumstances that might
affect the outcome of the peer review process. SECPS is a dummy variable indicating whether
the firm was a member of the AICPAs SEC Practice Section at the time of the review. This
variable controls for the possibility that peer reviews for SECPS members may be more rigorous
than other forms of peer review (e.g., PCPS), and for the possibility that results in previous
studies might be peculiar to SECPS reviews.8 Also, DISTANC is a dummy variable indicating
whether the offices of the reviewing and reviewed firms are more than 100 miles apart. This
variable controls for the possibility that reviewing firms that are near the firms they review may
be competitors, influencing the objectivity of the reviewer and giving them an incentive to
understate the quality of the reviewed firm (Hilary and Lennox, 2005).
4.2 Results
Descriptive data for the peer reviews in our sample are presented in Table 1. Reviews are
well-distributed over the period 1986-1999. The mean number of weaknesses identified in the
reports for the 158 firms in our sample is 1.44. The majority of these weaknesses are related to
engagement performance, with 87 firms receiving such findings (mean of .99 per firm), followed
7 We note that the five categories are neither independent nor mutually exclusive. Any observable proxies are likelyto cross over to multiple categories. Nevertheless, we test the validity of our measures by examining the simplecorrelations between them and the number of peer-review weaknesses identified in each respective category. Theonly instance where the predicted correlation is not significant at conventional levels is between LNFEES and thenumber of monitoring weaknesses.8 For example, Hilary and Lennox (2005) examine only SECPS members.
8/7/2019 is self regulated peer review indicate audit quality
13/30
13
by monitoring (29 firms, mean of .23 per firm) and personnel management (17 firms, mean of
.13 per firm). Few firms in our sample have independence or client-acceptance findings. Table
2 presents descriptive results for the firms in our sample. Total fees for firms in the sample
range from $62 thousand to almost $16 million, and there appears to be considerable variation in
most of the variables. Table 3 reveals no evidence of collinearity problems in the data.
----------------------------------------Insert Tables 1-3 here
----------------------------------------
Results of the ordered logistic estimations used to test H1 are presented in Table 4,
column A. The model is significant at p
8/7/2019 is self regulated peer review indicate audit quality
14/30
14
----------------------------------------Insert Table 4 here
----------------------------------------
A comparison of Hilary and Lennox (2005) and Wallace (1991) suggests that the peer
review environment has evolved over time such that fewer modified reports are issued and fewer
weaknesses are identified with each review. This finding is consistent with Bremser and
Gramling (1988) and Colbert and Murray (1998), who find that the number of weaknesses
identified during peer review has decreased over time as firms have had additional reviews.
These studies both assume that peer review has remained consistently effective over time and
thus interpret these results to mean that audit quality is improving. However, these results would
also be expected if peer-reviews effectiveness has deteriorated over time, perhaps for the
reasons described earlier. For this reason, we also estimate Equation 1 after inserting a
continuous variable representing the year the related peer reviews were performed.
Results of this estimation are shown in Table 4, column B. As expected, the coefficient
on the year variable is negative and highly significant (p
8/7/2019 is self regulated peer review indicate audit quality
15/30
15
Our second hypothesis asserts that peer-review findings are useful in predicting actual
audit quality. To test this hypothesis, we estimate two logistical regression models to predict
accounting firms associated with a malpractice claim alleging negligent, or low-quality audit
work. The dependent variable in these models (CLAIM) takes a value of one if the firm is
subject to a malpractice claim; zero otherwise. The test variables in these models reflect the
findings described in the respective LOCs. Since peer-review findings apply to different aspects
of an organizations activities, we examine them both in total (model 2) and separated into the
five quality-control categories (model 3) used by the AICPA (AICPA 1996):
CLAIM = b0 + b1TOTFIND + {control variables} (2)
CLAIM = b0 + b1INDEP + b2ACCEPT + b3PERSNL + b4ENGAGE (3)+ b5MONITOR + {control variables}
where:
TOTFIND: Total number of weaknesses identified in the peer-review report,INDEP: Dummy variable with a value of 1 if the peer-review report identifies at least one
weakness related to independence policies; 0 otherwise,ACCEPT: Dummy variable with a value of 1 if the peer-review report identifies at least one
weakness related to client acceptance and continuation practices; 0 otherwise,PERSNL: Dummy variable with a value of 1 if the peer-review report identifies at least one
weakness related topersonnel management; 0 otherwise,ENGAGE: Dummy variable with a value of 1 if the peer-review report identifies at least one
weakness related to engagement performance; 0 otherwise,MONITOR: Dummy variables with a value of 1 if the peer-review report identifies at least one
weakness related to monitoring of professional practices; 0 otherwise.
Models 2 and 3 include several additional variables to control for factors not related to
audit quality that may be associated with the likelihood of a claim being filed with the insurance
company. For example, while a link has been established between the size of a CPA firm and
audit quality (Stice 1991), larger firms may experience more claims simply because they have
more clients. To control for this possibility, we include the natural log of total fees for the firm
in the year prior to the claim incident (LNFEES), as well as the percentage change in total audit
8/7/2019 is self regulated peer review indicate audit quality
16/30
16
firm staff in the year of the claim incident (GROWTH). We include the percentage of total firm
fees from SEC clients (SECCLNT) to control for the possibility that public audit clients may be
more litigious than nonpublic audit clients. We also include a dummy variable indicating
whether a CPA firm is located in either Arizona or Texas (JURIS) to control for the possibility
that, ceteris paribus, claims are more likely in plaintiff-friendly jurisdictions (Esho et al., 2004).11
Finally, to control for the possibility that CPA firms may be more likely to file insurance claims
if their deductibles are relatively low, we include a variable measuring the policy deductible
divided by the number of firm owners (DEDUCT).
5.2 Results
Descriptive results for the 140 observations used to estimate Equations 2 and 3 are
included in Table 5.12 As expected, claim firms tend to have more total weaknesses (TOTFIND)
than non-claim firms. They also tend to be larger (LNFEES), have more SEC clients
(SECCLNT), and are more likely to be found in plaintiff-friendly jurisdictions (JURIS). Once
again, correlations among the independent variables in the models (see Table 6) do not suggest
collinearity problems in the data.
----------------------------------------Insert Tables 5 and 6 here
----------------------------------------
Equation 2 contains a continuous test variable representing the total number of
weaknesses identified in the LOC (TOTFIND). Results from this estimation are shown in Table
7, column A. The model is reasonably well specified, with a pseudo-R2
of 18.9 percent.
Coefficients on the control variables are all significant as predicted: Claims are more likely for
11 When asked which states were the most plaintiff friendly, the insurance firm identified these two as being, in theirexperience, the most plaintiff friendly states in the US. In these states, legal precedent and court rules make itrelatively easy to bring litigation against accountants.12 Eighteen of the 158 original observations were dropped because of missing data items for either the claim firm orthe matched non-claim firm.
8/7/2019 is self regulated peer review indicate audit quality
17/30
17
larger firms (LNFEES, p
8/7/2019 is self regulated peer review indicate audit quality
18/30
18
6. Summary and Conclusions
The purpose of this paper was to examine the effectiveness of the AICPAs voluntary
peer review regime for accounting firms performing audits. While current PCAOB rules in the
US require all auditors of public registrants to be inspected by the PCAOB, many firms and
many countries still operate in a voluntary or self-regulated system. Furthermore, the rush to
impose mandatory inspections following the accounting scandals in the US may not have
adequately considered the actual effectiveness of self-regulated peer review in the wake of
demands for reform.
We contribute to this debate by examining whether peer reviews in a self-regulatory
regime are informative regarding audit-firm quality. We tested the effectiveness of voluntary
peer review in two ways. First, we examined whether the information in peer-review reports in
the form of reviewer comments are associated with other observable indications of low quality in
an audit firm. We found that there does appear to be a link between the number of weaknesses
identified in the peer review report and firm-quality attributes such as participation in tax
shelters, professional certifications, the riskiness of the firms clientele, historical regulatory
problems, and size. There may be a similar link with staff workload, but these results are not as
strong. Second, we examined the relationship between the information in peer-review reports
and actual audit quality as measured by audit failure. We found that firms having weaknesses
related to personnel-management and engagement-performance are more likely to experience an
audit failure in terms of having a malpractice claim filed against them. We also found that audit
firms having more weaknesses in general identified in their peer-review reports are more likely
to experience audit failure.
8/7/2019 is self regulated peer review indicate audit quality
19/30
19
Taken together, we interpret our findings as supporting the hypothesis that voluntary
peer-review reports provide reliable signals as to the actual quality of an audit firm. These
results complement previous studies showing a link between peer review andperceivedaudit-
firm quality (Hilary and Lennox 2005). These results are also encouraging and supportive of the
effectiveness of the self-regulatory peer-review model. However, we make no assertions as to
whether a voluntary regime is more effective than a mandatory regime. Indeed, there are many
benefits to a mandatory regime such as universal application, greater independence in the
inspection process, and the potential for a more in-depth examination. We also note that a
mandatory regime does involve significant costs to society and markets (Stigler 1971), and that
the benefits of a voluntary regime may be underestimatedespecially in the wake of the
notorious audit failures in recent years. Our results suggest that the benefits of the voluntary
regime were more extensive than recently believed, and that this might be taken into account
when future regulations are adopted or modified. Our results also suggest that additional
research into the effectiveness of the self-regulatory model is needed to cast light upon, and aid
in the continued scrutiny of the auditing profession.
8/7/2019 is self regulated peer review indicate audit quality
20/30
20
References
American Institute of Certified Public Accountants (AICPA), 1996. System of quality controlfor a CPA firm's accounting and auditing practice, New York, NY.
American Institute of Certified Public Accountants (AICPA), 2004. AICPA standards forperforming and reporting on peer reviews, New York, NY.
AICPA Peer Review Board, 2004. White paper on AICPA standards for performing andreporting on peer reviews AICPA, New York, NY.
Atherton, D.R., 1989. Quality and peer review: An update. Ohio CPA Journal (Sept/Oct): 49-51.
Austin, K.R., and D.C. Lanston., 1981. Peer review: Its impact on quality control. Journal ofAccountancy (July): 78-82.
Berton, L., 1987. SEC to rule on peer review for accountants. Wall Street Journal (Jan 8): 1.
Bremser, W.G., and L.J. Gramling., 1988. CPA firm peer reviews: Do they improve auditquality? The CPA Journal (May): 75-77.
Bunting, R.L., 2004. Transparency: The new peer review watchword. The CPA Journal(October): 2-3.
Colbert, G., and M. Murray, 1998. The association between auditor quality and auditor size: Ananalysis of small CPA firms. Journal of Accounting, Auditing, and Finance (Spring):135-150.
DeAngelo, L.E., 1981. Auditor size and audit quality. Journal of Accounting and Economics(December): 183-199.
Deis, D.R. Jr., and G.A. Giroux, 1992. Determinants of audit quality in the public sector. TheAccounting Review (July): 462-479.
Esho, N., A. Kirievsky, D. Ward, and R. Zurbruegg., 2004. Law and the determinants ofproperty-casualty insurance. Journal of Risk and Insurance 71: 265-283.
Felix, W.F., and D.F. Prawitt., 1993. Self-regulation: An assessment by SECPS members.Journal of Accountancy (July): 20-21.
Fogarty, T.J., 1996. The imagery and reality of peer review in the U.S.: Insights frominstitutional theory. Accounting, Organizations and Society (Feb/Apr): 243-267.
Francis, J., "What Do We Know About Audit Quality?" The British Accounting Review(December 2004), Vol. 34, No. 4, pp. 345-368.
8/7/2019 is self regulated peer review indicate audit quality
21/30
21
Francis, J.R., W.T Andrews, Jr., and D.T. Simon, 1990. Voluntary peer reviews, audit qualityand proposals for mandatory peer reviews. Journal of Accounting, Auditing and Finance(Winter): 369-377.
Giroux, G.A., D.R. Deis, Jr., and B. Bryan, 1995. The effect of peer review on audit economies.
Research in Accounting Regulation 9: 63-82.
Grumet, L., 2005. Rethinking the peer in peer review. Accounting Today (September 26): 6.
Hilary, G., and C. Lennox, 2005. The credibility of self-regulation: Evidence from theaccounting professions peer review program. Journal of Accounting and Economics(December): 211-229.
Kaiser, C. Jr., 1989. The mandatory SECPS membership vote. Journal of Accountancy(August): 40-44.
Krishnan, J., and P.C. Schauer, 2000. The differentiation of quality among auditors: Evidencefrom the not-for-profit sector. Auditing: A Journal of Practice & Theory (Fall): 9-25.
Latham, C.K., and M. Linville., 1998. A review of the literature in audit litigation. Journal ofAccounting Literature 17: 175-213.
Lys, T., and R.L. Watts, 1994. Lawsuits against auditors. Journal of Accounting Research(Supplement): 65-93.
Mautz, R., 1984. Self-regulation: Criticism and a response. Journal of Accountancy (April): 56-66.
Nieschwietz, R.J., J.J. Schultz, and M.F. Zimbelman, 2000. Empirical research on externalauditors detection of financial statement fraud. Journal of Accounting Literature 19:190-246.
OKeefe, T.B., D.A. Simunic, and M.T Stein, 1994. The production of audit services: Evidencefrom a major public accounting firm. Journal of Accounting Research 32: 241-261.
Palmrose, Z., 1988. An analysis of auditor litigation and audit service quality. The AccountingReview (January): 55-73.
Public Company Accounting Oversight Board (PCAOB), 2005. Ethics and Independence RulesConcerning Independence, Tax Services, and Contingent Fees, Washington DC.
Schneider, A., and R.J. Ramsay, 2000. Assessing the value added of peer and quality reviews ofCPA firms. Research in Accounting Regulation 14: 23-38.
Snyder, A., 2004. Increasing transparency in peer review: Members speak out. Journal ofAccountancy (December): 22-23
8/7/2019 is self regulated peer review indicate audit quality
22/30
22
Stice, J.D., 1991. Using financial and market information to identify pre-engagement factorsassociated with lawsuits against auditors. The Accounting Review 66: 516-534.
Stigler, G., 1971. The theory of economic regulation. Bell Journal of Economics and
Management Science (Spring): 3-21.
U.S. House of Representatives, 2002. The Sarbanes-Oxley Act of 2002, Washington DC.
Wallace, W.A., 1991. Peer review filings and their implications for evaluating self-regulation.Auditing: A Journal of Practice & Theory (Spring): 53-68.
----------, and K.S. Cravens, 1994. An exploratory content analysis of terminology in publicaccounting firms responses to AICPA peer reviews. Research in Accounting Regulation8: 3-32.
White, G.T., J.C. Wyer, and E.C. Janson, 1988. Peer review: Proposed regulation and currentcompliance. Accounting Horizons (June): 27-30.
8/7/2019 is self regulated peer review indicate audit quality
23/30
23
Table 1Descriptive Peer Review Information (n=158)
Panel A: Observations by Peer-Review Year:
Year Observations a
1986 131987 71988 91989 81990 171991 101992 181993 121994 81995 221996 13
1997 111998 81999 2
Total 158
Panel B: Peer Review Findings:
Type of Finding Mean MedianRange offindings
Observationswith comments
Total number of findings 1.437 1 0-9 100
Independence .051 0 0-2 7Client acceptance/continuance .038 0 0-1 6Personnel management .127 0 0-3 17Engagement performance .987 1 0-5 87Monitoring .234 0 0-3 29
a Observation year represents the year of the peer review. Odd numbers occur because firms are matched on claim year ratherthan the year of their most recent peer review.
8/7/2019 is self regulated peer review indicate audit quality
24/30
24
Table 2Descriptive Data for Independent Variables in Equation 1 (n = 158)
Variable Mean/% MedianStd.
Deviation Min Max
Continuous:
CPAS .50 .50 .125 .125 .833
WKLOAD a $140,582 $130,403 $45,063 $20,970 $300,136
CLNTRSK 1.49 0 3.167 0 28LNFEES (000) a $2,872 $2,007 $2,521 $62 $15,793
Discrete:
TAXSHLT 15.2%
HISTORY 9.5%SECPS 24.1%
DISTANC 31.6%a Dollar amounts are shown here. These are transformed by taking the natural log for analysis purposes.
Variable definitions:
TAXSHLT (+): Dummy variable with a value of 1 if the firm owners are actively involved inorganizing, managing, receiving compensation from, otherwise promoting taxshelter to their clients; 0 otherwise.
CPAS (-): Percentage of professional staff at the firm who are CPAs.WKLOAD (+): Natural log of the ratio of firm fees divided by the number of professional staff
in the firm.CLNTRSK (+): Percentage of firm clients that are financial institutions or entertainment
companies.HISTORY (+): Dummy variable with a value of 1 if the firm has been investigated by a state or
professional board for violations of professional regulations or practicestandards; 0 otherwise.
LNFEES (-): Natural log of total firm fees.SECPS (+): Dummy variable with a value of 1 if the firm audits companies subject to SEC
regulation; 0 otherwise.DISTANC (-): Dummy variable with a value of one if the reviewing firm is more than 100
miles away from the reviewed firm; 0 otherwise.
8/7/2019 is self regulated peer review indicate audit quality
25/30
25
Table 3Correlation Matrix for Independent Variables in Equation 1 (n=158) a
TAXSHLT CPAS WKLOAD CLNTRSK HISTORY LNFEES SECPS
CPAS b -0.010
WKLOAD 0.084 -0.169
CLNTRSK 0.017 -0.014 0.101
HISTORY -0.017 -0.020 0.012 0.013
LNFEES 0.157 -0.112 0.435 0.204 0.070
SECPS 0.133 -0.010 0.136 0.178 0.070 0.229
DISTANC -0.098 -0.029 -0.126 -0.057 -0.081 -0.235 -0.000
a Correlation greater than .15 are significantly different from zero at the .05 level.b See Table 2 for variable definitions
8/7/2019 is self regulated peer review indicate audit quality
26/30
26
Table 4Analysis of the Relation Between Peer-Review Findings and Audit-Firm Attributes Indicative of
Lower Audit Quality Using Ordered Logit (n=158)
Model: FINDINGS b = b1TAXSHLT + b2CPAS + b3WKLOAD + b4CLNTRSK + b5HISTORY+ b6LNFEES + {control variables}
A BPredicted
Sign a Estimate Wald 2 Estimate Wald 2
Test Variables:
TAXSHLT + 0.80 3.86** 0.72 2.95**CPAS - -3.08 6.21*** -2.77 5.04**WKLOAD + 0.69 1.92* 0.26 0.28CLNTRSK + 0.13 8.05*** 0.08 3.02**HISTORY + 0.90 3.36** 0.91 3.38**
LNFEES - -0.40 4.30** -0.25 1.66*
Control Variables:
SECPS + 0.76 4.61** 0.65 3.34**DISTANC - -0.71 4.49** -0.57 2.83**Year - -0.16 12.63***
Model 2 31.34*** 41.01***
aAll p-values are one-tail where signs are predicted.
b
Dependent variable (FINDINGS) equals total number of peer review comments. See Table 2 for additional variabledefinitions.
***, **, * indicates significance at p < .01, .05, and .10 respectively.
8/7/2019 is self regulated peer review indicate audit quality
27/30
27
Table 5Descriptive Data for Claim Firms (CLAIM=1) and Non-Claim Firms (CLAIM=0)
(n=140)
Non-claim firmsn=70
Claim firmsn=70
Variable a MeanSD Min Max
MeanSD Min Max
TOTFIND 1.001.19
0 4 1.47**1.63
0 8
INDEP 0.010.12
0 1 0.040.20
0 1
ACCEPT 0.030.17
0 1 0.060.23
0 1
PERSNL 0.030.17
0 1 0.14**0.35
0 1
ENGAGE 0.430.50
0 1 0.61**0.49
0 1
MONITOR 0.170.38
0 1 0.110.32
0 1
LNFEES 14.180.92
11.05 16.18 14.85***0.80
13.039 16.58
GROWTH 0.060.10
0.00 0.57 0.070.14
0.00 0.67
SECCLNT 0.411.51
0.00 9.00 0.80*1.51
0.00 5.00
JURIS 0.090.28
0 1 0.23**0.42
0 1
DEDUCT 29512025
714 10000 26331655
833 833
a see variable definitions on next page***, **, * indicates mean greater at p < .01, .05, and .10 respectively
8/7/2019 is self regulated peer review indicate audit quality
28/30
28
Table 5 (continued)
Variable Definitions:
TOTFIND (+): Total number of weaknesses identified in the peer review report/LOC.INDEP (+): Dummy variable valued as 1 if the peer review report identified at least one weakness
related to independence; 0 otherwiseACCEPT (+): Dummy variable valued as 1 if the peer review report identified at least one weakness
related to client acceptance and continuance; 0 otherwisePERSNL (+): Dummy variable valued as 1 if the peer review report identified at least one weakness
related to personnel management; 0 otherwiseENGAGE (+): Dummy variable valued as 1 if the peer review report identified at least one weakness
related to engagement performance; 0 otherwiseMONITOR (+): Dummy variable valued as 1 if the peer review report identified at least one weakness
related to monitoring; 0 otherwiseLNFEES (+): Natural log of firm feesGROWTH (+): Percentage change in total audit firm staff in the year of the claim incidentSECCLNT (+): Percentage of total fees from SEC clients
JURIS (+): Dummy variable valued as 1 if the firm practiced in either AZ or TX; 0 otherwiseDEDUCT (-): Deductible included in insurance policy divided by number of firm owners
8/7/2019 is self regulated peer review indicate audit quality
29/30
29
Table 6Correlation Matrix for Independent Variables in Equations 2 and 3 (n=140) a
TOTFIND INDEP ACCEPT PERSNL ENGAGE MONITOR LNFEES GROWTH SECCLNT URIS
INDEP 0.539ACCEPT 0.529 0.387PERSNL 0.405 0.407 0.061ENGAGE 0.833 0.078 0.203 0.038MONITOR 0.524 0.175 0.115 -0.052 0.187LNFEES 0.029 0.089 0.080 0.039 0.028 -0.110GROWTH 0.032 0.154 -0.058 0.162 -0.012 0.047 -0.179SECCLNT 0.058 0.016 0.055 -0.106 0.033 0.120 0.124 -0.040JURIS -0.057 -0.074 -0.091 0.148 -0.058 -0.176 0.014 0.002 -0.105DEDUCT -0.045 0.083 -0.057 -0.064 -0.066 -0.052 -0.038 0.224 0.022 0.079
a Correlations with absolute values greater than or equal to .16 are significantly different from zero at the .05 level.b see Table 5 for variable definitions
8/7/2019 is self regulated peer review indicate audit quality
30/30
Table 7Analysis of the Relation Between Peer Review Findings and the Likelihood
of Audit Failure Using Logistic Models (n=140)
Model A: CLAIM b = b0 + b1TOTFIND + {control variables}Model B: CLAIM = b0 + b1INDEP + b2ACCEPT + b3PERSNL + b4ENGAGE + b5MONITOR +
{control variables}
A BPredicted
Sign a Estimate Wald 2 Estimate Wald 2
Test Variables:
TOTFIND + 0.27 3.12**INDEP + -0.46 0.08ACCEPT + 0.29 0.08PERSNL + 1.82 2.74**ENGAGE + 0.91 4.78**MONITOR + -0.53 0.73
Control Variables:
INTERCEPT -15.37 17.13 -15.94 16.25LNFEES + 1.03 16.63*** 1.05 15.48***GROWTH + 2.81 2.91** 2.62 1.95*SECCLNT + 0.18 1.79* 0.23 2.75**JURIS + 1.55 6.96*** 1.41 5.32**DEDUCT - -0.01 2.26* -0.01 1.71*
Pseudo R2 18.9% 22.3%Log Likelihood 78.69*** 75.45***
a All p-values are one tail where signs are predicted.b Dependent variable (CLAIM) equals 1 if firm had an audit related claim filed against it; zero otherwise. See Table 5 for
additional variable definitions.***, **, * indicated significance at p < .01, .05, and .10 respectively.