A group of leading interventional cardiologists has launched an attack on the growing role of appropriate use criteria (AUC) for PCI in the US. They argue that severe flaws in current guidelines render unreliable current attempts to assess the rate of appropriate procedures.
In a paper published in JACC: Cardiovascular Interventions, Steven Marso and colleagues (Paul Teirstein, Dean Kereiakes, Jeffrey Moses, John Lasala, and J Aaron Grantham) criticize a study in JAMA published last year from the National Cardiovascular Data Registry (NCDR) that found a large degree of inappropriate or uncertain PCI procedures, as well as a wide range of variability among institutions. Marso et al write that the JAMA paper sensationalized the data by focusing attention on the low rate of appropriate indications for nonacute PCI– 50.4%– while failing to point out that the study found that 84.6% of procedures in the entire study population– acute and nonacute alike– were deemed appropriate. Furthermore, given the imprecision built into the system, they ask: what is the “acceptable threshold” of inappropriate PCI?
The authors write that the AUC panel “purposefully limited involvement of the interventional community during the development process, in order to avoid having a majority of committee members “whose livelihood is tied to the technology under study.” But the under-representation of interventionists may have biased the results, they argue. One particular case as graded by the AUC panel was the most common reason for cases to be categorized as inappropriate: the AUC committee decided that PCI was inappropriate for a patient with 1- to 2-vessel disease, no proximal LAD involvement or prior CABG, class I or II symptoms, low-risk noninvasive findings, and on no or minimal medications. But most clinicians believe this is an uncertain but not inappropriate indication, they say. The AUC panel may have “got this one wrong,” they write.
Marso et al also point to the “lack of specific criteria for interpreting” stress tests in the NCDR database. In addition, they disagree with the inappropriate classification of most cases of class II angina before medical therapy has been attempted, arguing that both COURAGE and BARI 2D showed that PCI is a valid option for these patients. Finally, the authors argue that the NCDR database contains numerous inaccuracies, including misclassification of patients’ angina status or noninvasive risk assessment.
One striking feature of the controversy is that two of the authors of the JAMA paper (Paul Chan and John Spertus) and two of the authors of the JACC: Cardiovascular Interventions paper (Steven Marso and Aaron Grantham) are all at the same institution: Saint Luke’s Mid America Heart Institute in Kansas City, Missouri. Marso and colleagues state that 56% of cases classified as inappropriate at their institution “were misclassified due to incorrectly coding CCS class status, not documenting angina equivalents, or inaccurate documentation of the noninvasive risk assessment findings.”
Until the NCDR database is fixed, Marso et al write, “it could be argued” that the authors “should refrain from approving AUC-related clinical studies until such time that assurances are both valid and reliably collected.”
Sanjay Kaul sent the following comment to CardioBrief:
Because there are undesirable scientific, economic, logistic, & philosophical implications of unfocused broad (i.e., inappropriate) use of PCI, it is incumbent upon us as a professional society to track how often we use it judiciously. The PCI AUC, although far from perfect, are a step in the right direction. While some of the authors’ criticisms regarding the AUC in general and the Chan et al paper in particular are quite “appropriate”, I do not agree with their main contention that interventional cardiologists were underrepresented in the technical panel (4 out of 17) to minimize bias. Management of stable CAD is hardly the exclusive domain of interventional cardiologists! They do, however, have some sage recommendations for refining the AUC. Ultimately, such ‘back and forth’ amongst the protagonists is a healthy exercise. I expect more light than heat will be generated as a consequence.
Editorial Comment: Since the publication of COURAGE and the subsequent Mark Midei scandal, no issue has been more explosive than the problem of possible overuse of PCI in non-urgent cases. No one really knows the full scope of the problem. As I hope to write in a future post, it is unclear whether Mark Midei was an outlier who went far beyond the bounds of acceptable practice (though as the Marso paper makes clear, there is no clear consensus on what exactly defines “acceptable practice”) or a scapegoat who was severely punished for doing what many other interventional cardiologists were also doing at the same time.
The full scope of the problem will not be measured by one paper from the NCDR, or by one response from interventional cardiologists. It’s going to be a long time and a lot of hard work will have to be done before we have a clear idea of the situation. But one thing is certain: there’s no chance that we will be going back anytime soon to the wild west days of interventional cardiology.
Marso et al score a number of valid points about the deficiencies of the NCDR and AUC. But they don’t propose a real alternative, except to suggest that interventional cardiologists are perfectly good at policing themselves and should be allowed to decide for themselves what procedures are appropriate. Outside scrutiny is clearly unwelcome in their view. This perspective may gain them some popularity within the interventional cardiology community but it is unlikely to get much traction in the larger world.
It’s easy to ridicule and criticize guidelines, appropriate use criteria, and the like. They will never be perfect. The documents will need to be continually updated and revised. And there will be legitimate differences of opinion about the details.
It’s understandable that fiercely independent physicians chafe when they’re told what to do. Several years ago, after COURAGE but before the Midei scandal broke, one of the co-authors of the Marso paper responded to a question on National Public Radio about stent overuse:
I definitely have a bias toward stents because I have a lot of experience with stents and I’ve seen patients do so much better.
One of his colleagues responded:
…sometimes there’s a tendency to believe in your procedures too much… most of the time interventional cardiologists are like that, they are going to say, well I can fix the artery. The question of course is, in some cases, should you?