Between efficiency and effectiveness
Evaluation in for-profit education organizations

Article Highlights

  • How do we encourage transparency in the evaluation of for-profits while allowing them to do what they do best—innovate?

    Tweet This

  • For-profits use evaluation to identify how they can get better results and/or how they can get the same results w/ fewer resources

    Tweet This

  • Policymakers can help promote for-profit evaluations that retain a focus on both efficiency and effectiveness

    Tweet This

Between efficiency and effectiveness: evaluation in for-profit education organizations

Download PDF
As the education policy landscape shifts toward a system of outcomes-based accountability, evaluation and research have grown increasingly vital. This is especially true for for-profit education firms, which must overcome skepticism, scrutiny, or even outright hostility in a field that has long been suspicious of the profit motive and where the bottom line is directly influenced by public perceptions of effectiveness.

This paper describes how these for-profit organizations view evaluation work, what they choose to focus on and why, the assets and capabilities they bring to the work, and the challenges they face. It also explores the question of how to encourage transparency and rigor in the evaluation practice of private enterprises while allowing them to do what they do best—innovate and attract investment.

How the Profit Motive Shapes Evaluation Practice. Though for-profits and nonprofits approach evaluation similarly, they differ in two important ways. First, whereas many nonprofits and public agencies operate on a fixed revenue model, for-profits do not. Second and related is that for-profits either earn more than they spend or go out of business. For-profits, then, face a unique set of challenges with evaluation. Questions of implementation and fidelity can cause these firms to hesitate to commit to independent evaluation; additionally, many customers of for-profit education services do not rely on third-party research when making purchasing decisions, leaving these firms with little incentive to commission independent evaluations of their effectiveness.

For-Profits, Nonprofits, and the Accountability Landscape. Changes in the education policy environment are raising the profile of evaluation work focused on the private sector. But when it comes to private-sector engagement in education, significant differences exist between types of companies. Supplemental service providers compete with one another and are decidedly not trying to put school districts out of business. By contrast, enterprises that actually seek to operate schools (whether in K–12 or higher education) directly compete with public school districts or state colleges and universities. These providers recognize that, appropriately or not, the public sector does not regard them as benign, and they see increased (and, in some cases, special) scrutiny at least in part as a response to this perception.

Using Evaluation to Promote Efficiency and Effectiveness. While for-profits’ approach to evaluation depends on which sector of the education market they occupy, most companies have two common characteristics. First, for-profits focus on the customer experience and satisfaction, resulting in an evaluation approach that emphasizes ongoing user or customer feedback to drive product improvements or management decisions. Second, they emphasize measures that capture academic performance in relation to operational efficiency; they use evaluation to identify how they can get better results for their students but also consider whether they could get the same results with fewer resources. In an era when schools, districts, state universities, and community colleges face relentless pressure to cut budgets and public disaffection with schools is high, we can learn something from these two areas of emphasis. On the other hand, the lack of rigorous, third-party evaluation of many for-profit operators raises concerns about how prospective consumers should make informed decisions about whether to purchase their products or services.

Policymakers can do four things to help promote evaluation that retains a focus on both efficiency and effectiveness: (1) grant increased flexibility to schools and systems for managing resources; (2) establish policies that more closely align incentives for educational and financial performance; (3) at the K–12 level, reward schools more for performance than enrollment; and (4) develop policies to encourage states and school districts to weigh rigorous evidence more heavily in decisions about resource allocation and contracting. Together, policies such as these would increase the quality and use of evaluation data both inside and outside education’s private sector.

Matthew Riggan ([email protected]) is a senior researcher at University of Pennsylvania's Consortium for Policy Research in Education.

Also Visit
AEIdeas Blog The American Magazine

What's new on AEI

Defeating ISIS: AEI experts weigh-in before the president’s address on Wednesday
image Degrading, defeating, and destroying the Islamic State
image Wealth Building Home Loan: Building wealth through homeownership and retirement savings
image The $3 iPhone
AEI on Facebook
Events Calendar
  • 15
  • 16
  • 17
  • 18
  • 19
Tuesday, September 16, 2014 | 5:00 p.m. – 6:00 p.m.
The Constitution as political theory

Please join us for the third-annual Walter Berns Constitution Day Lecture as James Ceasar, Harry F. Byrd Professor of Politics at the University of Virginia, explores some of the Constitution’s most significant contributions to political theory, focusing on themes that have been largely unexamined in current scholarship.

Wednesday, September 17, 2014 | 8:10 a.m. – Thursday, September 18, 2014 | 1:30 p.m.
Third international conference on housing risk: New risk measures and their applications

We invite you to join us for this year’s international conference on housing risk — cosponsored by the Collateral Risk Network and AEI International Center on Housing Risk — which will focus on new mortgage and collateral risk measures and their applications.

Thursday, September 18, 2014 | 2:15 p.m. – 3:00 p.m.
Speaker of the House John Boehner on resetting America’s economic foundation

Please join us as Speaker John Boehner (R-OH) delivers his five-point policy vision to reset America’s economy.

Friday, September 19, 2014 | 9:15 a.m. – 11:00 a.m.
Reforming Medicare: What does the public think?

Please join us as a panel of distinguished experts explore the implications of the report and the consumer role in shaping the future of Medicare.

No events scheduled this day.
No events scheduled this day.
No events scheduled this day.
No events scheduled this day.