On US News hospital rankings
Matthew Martin
4/08/2014 09:00:00 AM
Tweetable
"The authors used as a variable whether a hospital was among the fifty U.S. News Best Hospitals in cancer, cardiology, gynecology, or orthopedic care. They cited a 2010 study by Ashwini Sehgal to justify their use of that binary variable as a marker of reputation. It is not. Sehgal concluded that reputation contributed to the relative standings of the top fifty hospitals—in other words, which hospital is No. 1 versus No. 2. But he did not find reputation to be a significant factor in determining which hospitals were in the top fifty.I will confess that I like the US News rankins because they happen to put my own division as the best in the country...
"In fact, U.S. News uses objective quality measures (primarily derived from Medicare data) such as mortality, volume, and patient safety indicators to calculate 67.5 percent of each hospital's rank-determining score in the four specialties analyzed. Reputation accounts for only 32.5 percent and will soon be reduced to 27.5 percent."
But I do want to point out that the US News' defense that the rankings are not significantly biased by reputations is reconcilable with the research showing that reputation apparently has a big effect. One thing you'll notice about the hospital where I work is that it's huge--depending on how you count beds possibly the largest pediatric hospital in the country--implausibly large for a city like Cincinnati. What happens is that because of it's reputation, we get children referred here from all over the US and indeed from the whole world--last time I checked, there were patients from 86 countries currently admitted to the hospital. Two things must generally be true for patients to be sent over such vast distances: 1) the hospital must have a reputation for treating whatever condition that patient has, and 2) the probability of better outcomes here must be much higher than at hospitals closer to home. Given that, you would expect the outcomes measures that US News looks at to be somewhat biased by hospitals' reputations, since reputation determines the kinds of patients a top-tier hospital will get.