  
 
Insurance Coverage & Costs
Access to Care
Quality & Care Delivery
Health Care Markets
 
Issue Briefs
Data Bulletins
Research Briefs
Policy Analyses
Community Reports
Journal Articles
 
Other Publications
 
Surveys
Site Visits
Design and Methods
Data Files
 
	 | 
	  
	
  
Health Care Quality Transparency: If You Build It, Will Patients Come?
Commentary No. 4 
July 2009 
 Paul B. Ginsburg, Nicole M. Kemper 
 
In recent years, significant energy has been invested in developing health 
  care price and quality information in hopes of engaging consumers to be more 
  active when making health care choices. Although research shows that provider 
  quality can vary greatly, many Americans still rely on friends and family when 
  choosing a physician or hospital. For public and private payers seeking to encourage 
  consumers to use quality information when choosing physicians, hospitals and 
  other providers, a critical first step is to raise consumer awareness of the 
  existence and serious implications of provider quality gaps. Unlike price transparency, 
  where consumer needs vary greatly depending on whether they are insured or not, 
  and if they are insured, how their benefits are structured, theoretically all 
  consumers can benefit from the same information on the quality of care provided 
  by individual physicians, medical groups, hospitals and other providers. Until 
  consumers are motivated to use quality information to choose providers, the 
  main value of public quality reporting will likely be to motivate providers 
  to improve their performance. 
 
 
Raising Consumer Awareness of Quality Gaps 
 urning passive patients into active consumers who factor 
  cost and quality into decisions about which doctors or hospitals to choose or 
  which treatment options to pursue is an elusive goal in the U.S. health care 
  system. Despite well-intentioned efforts in recent years by government, employers, 
  health plans and others to foster health care price and quality transparency, 
  most Americans still choose doctors and hospitals based on recommendations from 
  friends and families and physicians.1  
Despite extensive evidence that the quality of U.S. health care is uneven at 
  best and that Americans pay more for health carewith worse resultsthan 
  citizens in any other industrialized nation,2 health care 
  price and quality transparency in the United States for the most part remains 
  a product in search of a buyer.  
On the price front, insured Americans face few incentives to consider price 
  when choosing providers because they typically pay the same amount as long as 
  they use an in-network provider. On the quality front, few consumers believe 
  that quality differs significantly across providers. For public and private 
  payers seeking to encourage consumers to use quality information when choosing 
  physicians, hospitals and other providers, a critical first step is to raise 
  consumer awareness of the existence and serious implications of provider quality 
  gaps.3  
If consumers believe that ignorance of provider quality can be hazardous to their health, then there will be a much firmer foundation on which to build transparency initiatives that help patients choose providers wisely and inspire physicians, hospitals and other providers to improve their performances.
 
Greater transparency in health care reflects the confluence of two major trends. One is a development throughout society that institutions need to operate in a more open and accountable manner. The other is the health care consumerism movement, which envisions consumers assuming more responsibility for and control over their health and health care. To move from the vision of health care consumerism to reality will require credible and accessible information on a wide range of issues, from evidence on what diagnostic and therapeutic strategies are effective to how providers compare on dimensions of cost and quality. 
 
Unlike price transparency, where consumer needs vary greatly depending on whether they are insured or not, and if they are insured, how their benefits are structured, theoretically all consumers can benefit from the same information on the quality of care provided by individual physicians, medical groups, hospitals and other providers. To that end, the potential audience for credible, understandable and actionable health care quality information is large.
 
 
 
Meeting Consumer Needs
 ffective quality reporting needs to reflect different consumer abilities to understand and use information. Sophisticated consumers may seek and understand more detailed and complex data, while others might be satisfied with less-detailed descriptions of provider quality. 
 
A key aspect of presenting quality information is how much data aggregation 
  to perform. The most aggregated data would be a simple binary score for a hospital 
  or physician, such as preferred or not preferred. The opposite extreme would 
  be specific quality information for each service provided. The virtue of highly 
  aggregated information is the packaging of complex information into understandable 
  and actionable concepts. For consumers with lower levels of health literacy 
  and numeracy,4 visual cues, such as a star rating, or simple 
  designations, such as high performance, may be useful. Research shows that 
  comparative information on hospital quality can be presented in different ways 
  to ease the cognitive burden and highlight the meaning of important information.5 
 
The downside of aggregation is that condensing complex information into simple measures may not meet the information needs of all audiences. For example, a hospital might receive very different quality ratings for different types of patients or services. A hospital could have outstanding quality for cardiovascular surgery but be poor at treating congestive heart failure or performing hip replacements. So aggregating hospital quality into a single measure would mask variation, potentially concealing a great deal of information that could be valuable to consumers and others, such as physicians.
 
In summary, there is no single answer about whether presenting more or less aggregated data is more useful for consumers. In general, higher degrees of aggregation make information more accessible to consumers to assess quality broadly. But in many cases, too much aggregation can make the content less useful for consumers seeking information about specific facets of quality performance. The ideal degree of aggregation is likely to vary for different users, suggesting that layering information may be the best way to meet different users needs. A key implication is that providing information in different forms, with different degrees of analysis, has the potential to derive the most value from collected performance information.
 
 
  
Measuring Hospital Quality
 eaningful outcome measures are often lacking in medical care, shifting the quality focus to measures of processor how often patients receive recommended treatments associated with better resultsprovider credentials and patient satisfaction. 
 
Hospital Compare, a Web site maintained by the Centers for Medicare and Medicaid Services (CMS), reflects the broadest effort to report hospital quality data. Based on Medicare patient data, Hospital Compare includes results of outcome, process and patient satisfaction measures for individual hospitals across the country. Additionally, Hospital Compare provides information about the number of Medicare patients treated, or volume, for particular proceduresresearch has linked higher volumes of procedures to better outcomes in some instances. 
 
At this point, the process and outcome measures in Hospital Compare apply to a limited range of conditions and procedures. Process measures apply to surgical proceduresproper use of antibiotics and prevention of blood clotsand the following conditions: heart attack, heart failure, pneumonia and childhood asthma. Although not attempting to aggregate measures over these conditions into a single measure is probably wise, creation of a composite index for each condition might increase the value of the information to guide patients in choosing a hospital that performs well when treating a specific condition. For example, a single, indexed indicator of care for heart attacks might be more useful for consumers than the seven individual process measures now reported. 
 
Until recently, Hospital Compare reported only one outcome measure30-day 
  risk-adjusted death rates for three conditions: heart attack, heart failure 
  and pneumonia. But at this time, this outcome measure provides little guidance 
  to patients because few hospitals are statistically significantly above or below 
  the national average.6 If 95 percent of all hospitals 
  mortality rates are presented as no different than the U.S. national rate, 
  then patients have gained little insight into most hospitals performance. In 
  July 2009, Hospital Compare added a second outcome measure: 30-day readmission 
  rates for heart attack, heart failure and pneumonia patients.  
Hospital Compare patient satisfaction ratings apply to all patient types. The 10 measures focus on dimensions that are likely to apply throughout a hospital, such as whether the nurses communicated well and whether the patients room was clean. However, some measures, such as whether the patient would recommend the hospital, probably would be more useful if made available for different types of patients, such as medical, surgical and maternity patients. 
 
Unlike Hospital Compare, which uses point estimates for each measure without 
  identifying whether differences among providers are significant, CalHospitalCompare, 
  a Web site that rates California hospitals, uses a five-point scalebased 
  on multiple benchmarksto characterize individual hospitals quality as 
  Poor, Below Average, Average, Above Average or Superior. This approach provides 
  consumers with a more informative scale to compare hospitals for a number of 
  conditions, as well as patient experience with overall care, medical care, surgical 
  care and maternity care.7  
Health plans have focused limited attention on providing hospital quality information 
  to enrollees.8 Plans often contract with outside vendors 
  that analyze publicly available Medicare and state data on a range of conditions 
  and procedures to allow plan enrollees access to hospital comparison tools. 
  For example, WebMDs hospital comparison tool allows enrollees to prioritize 
  various factors, such as a hospitals volume, complication rate and status as 
  a teaching hospital, when comparing hospitals.  
 
  
Measuring Physician Quality
 rguably, the most important choice a consumer faces is choosing a physician because that choice will likely influence other choices, such as what hospital to choose if the need arises. Physicians have long resisted public reporting of comparative quality information. Few professionals in any field like to be judgedexcept those who are confident they will score favorably. So a strong case must be made to convince providers of data validity.
 
Public quality information on individual physician performance is the rare exception rather than the rule in the United States. New York has long publicly reported mortality rates for individual surgeons performing coronary artery bypass graft surgery and related cardiac procedures but not without controversy that public reporting may have prompted surgeons to not operate on riskier patients.
 
The National Committee for Quality Assurance (NCQA) has developed physician recognition programs to designate physicians who meet certain evidence-based quality standards for diabetes care, heart/stroke care and low back pain care. Physicians who meet the NCQA standards are sometimes highlighted in health plan provider directories, and NCQA maintains an online directory of the approximately 10,000 physicians nationally that participate in the recognition programs. 
 
Nascent efforts are underway to report on physician quality at the group or practice level. One of the stated goals of the Robert Wood Johnson Foundations Aligning Forces for Quality (AF4Q) initiative is to foster increased public reporting of physician performance to both help inform consumer choices and motivate physicians to improve their performance. AF4Qs efforts to foster public reporting are guided by four core principles: 
 
- transparency in the measurement process so both doctors and patients can trust the data;
 
- consumer and provider input into the process to help ensure that information is meaningful to consumers and fair to doctors;
 
- independent verification to provide assurances that programs are fair and valid; and
 
- nationwide consistency of measures so that good health care means the same thing across the country.
 
 
Many national health plans have developed physician ranking programs, or some type of narrow, tiered or high-performance provider network. The underlying premise of these initiatives is to measure physician performance based on quality and cost metrics that can be assessed using plans claims data and making the results publicly available to enrollees. Most often, the results are used only to inform consumers; in some cases, consumers have incentives, such as reduced copayments, to use the higher-performing physicians. 
 
In these programs, quality and efficiency improvements are achieved to the 
  extent that patient volume shifts to higher-performing physicians as a result 
  of changes in physician referrals and consumer choices and lower-performing 
  physicians improving the care they provide. These initiatives have been limited 
  by fragmentation in the insurance marketplace. With each health plan developing 
  its own methods for classifying physicians and having only its own claims data 
  to draw on, the effort has not been credible with physicians.9 
  The missteps by health plans highlight the importance of transparent and clear 
  explanations about how quality data are measured, collected and analyzed to 
  ensure both public and provider confidence in the datas integrity.  
 
 
Policy Implications
 ntil consumers are motivated to use quality information to choose providers, the main value of public quality reporting will likely be to motivate providers to improve their performance. For example, CMS provides reporting hospitals with more detailed comparisons of their quality indicators to national norms than are available to the public. This is designed to support hospitals use of quality data to improve quality. 
 
The potential for providers to make use of quality data will expand in the future. For example, if reliable data were available on the quality of care of specialist physicians, primary care physicians would have a stronger basis for making referral recommendations. Health plans have begun to use quality data to support incentives for enrollees to choose among physicians in their network, but they could go much further with more useful quality data.
 
Providers also have the potential to influence consumers. If providers believe quality data or analyses are flawed, their communicating those beliefs to patients will undermine consumers willingness to rely on the information.
 
Government can play an important role in promoting quality transparency because 
  of its ability to induce or require reporting by providers. To date, CMS reporting 
  of hospital quality data has probably had a much larger impact by spurring hospitals 
  to improve quality rather than by fostering better consumer choices of hospitals.10 
  Indeed, we are already at the point where quality reporting is motivating and 
  fostering self-improvement by providers, while likely years away from significant 
  value to consumers. This should reinforce the strategy of having sunshine work 
  to improve provider performance while pursuing the much harder job of motivating 
  consumers and creating data that are meaningful to them.  
 
 
Notes
   
    |  1.  | 
    Tu, Ha T., and Johanna R. Lauer, Word of Mouth and Physician 
      Referrals Still Drive Health Care Provider Choice, Research 
      Brief No. 9, Center for Studying Health System Change, Washington, D.C. 
      (December 2008).  | 
   
   
    |  2.  | 
    McKinsey Global Institute, Accounting for the Cost of U.S. 
      Health Care: A New Look at Why Americans Spend More, New York, N.Y. 
      (December 2008); Anderson, Gerard F., and Bianca K. Frogner, Health 
      Spending in OECD Countries: Obtaining Value Per Dollar, Health 
      Affairs, Vol. 27, No. 6 (November/December 2008). | 
   
   
    |  3.  | 
    Hibbard, Judith H., and L. Gregory Pawlson, Why Not 
      Give Consumers a Framework for Understanding Quality? Joint Commission 
      Journal on Quality and Safety, Vol. 30, No. 6 (June 2004). | 
   
   
    |  4.  | 
    Numeracy refers to a consumers ability to understand 
      numbers and use them. Researchers have found that highly numerate 
      individuals appear to pay more attention to numbers, better comprehend them, 
      translate them into meaningful information, and ultimately use them in decisions. 
      Further, the less numerate are informed less by numbers and more by 
      other non-numeric sources of information. Peters, Ellen, Numeracy 
      and the Perception and Communication of Risk, Annals of the New 
      York Academy of Science, Vol. 1128 (April 2007). For further information 
      on numeracy, see Dieckmann, Nathan, Numeracy: A Review of the Literature, 
      Research Report No. 08-2, Decision Research, Eugene, Ore. (May 2008). | 
   
   
    |  5.  | 
    Peters, Ellen, et al., Less is More in Presenting Quality 
      Information to Consumers, Medical Care Research & Review, 
      Vol. 64, No. 2 (April 2007). | 
   
   
    |  6.  | 
    Hospital Compare uses a stringent two-standard-deviation rule 
      to identify well- and poorly performing providers for its mortality estimates. 
      This means that, typically, 95% of providers will be in the average category, 
      and only 2.5% (or 1 in 40) providers will be in each of the superior and 
      inferior categories.
     | 
   
   
    |  7.  | 
    Tu, Ha T., and Johanna R. Lauer, Designing Effective Health 
      Care Quality Transparency Initiatives, Issue 
      Brief No. 126, Center for Studying Health System Change, Washington, 
      D.C. (July 2009).  | 
   
   
    |  8.  | 
    Tynan, Ann, Allison Liebhaber and Paul B. Ginsburg, A Health 
      Plan Work in Progress: Hospital-Physician Price and Quality Transparency, 
      Research Brief No. 7, 
      Center for Studying Health System Change, Washington, D.C. (August 2008). 
     | 
   
   
    |  9.  | 
    Ibid. | 
   
   
    |  10.  | 
    Pham, Hoangmai H., Jennifer Coughlan and Ann S. OMalley, 
      The Impact of Quality-Reporting Programs on Hospital Operations, 
      Health Affairs, Vol. 25, No. 5 (September/October 2006). | 
   
 
 
 
Funding Acknowledgement
 This work was supported by the Robert Wood Johnson Foundation.  
 
 
ISSUE BRIEFS are published by the
Center for Studying Health System Change. 
 
600 Maryland Avenue, SW, Suite 550 
Washington, DC 20024-2512 
Tel: (202) 484-5261 
Fax: (202) 484-9258 
www.hschange.org 
President: Paul B. Ginsburg 
 
 |