Inter- and Intra-observer Agreement of the Peripheral Arterial Calcium Scoring System in Patients Undergoing (Infra)Popliteal Endovascular Interventions

Abstract

Purpose: Peripheral arterial calcification is an important predictor of outcomes after both conservative and endovascular treatment. Digital subtraction angiography (DSA)-based calcification scores are limited by low sensitivity and inter-observer agreement. The Peripheral Arterial Calcium Scoring System (PACSS) assesses the severity of target lesion calcification. The newly introduced modified PACSS (mPACSS) also evaluates target vessel calcification. This study aimed to assess the inter- and intra-observer reliability of PACSS and mPACSS on computed tomography angiography (CTA) in (infra)popliteal endovascular interventions. Methods: A random sample of 50 limbs from the prospective multicenter Dutch Chronic Lower Limb-Threatening Ischemia Registry (THRILLER) were included. Three experienced independent raters scored PACSS on CTA. Three months later, one blinded rater assessed the same 50 CTA scans, keeping track of assessment time. The reliability of the original 5-step PACSS, a simplified binary PACSS (0–2 vs 3–4) and the 7-step mPACSS were tested using Cohen’s and Fleiss’ kappa statistics. Results: In total, 50 limbs (mean age 70.1 ± 11.0, 29 men) with 41 popliteal and 40 infrapopliteal lesions were scored. Inter-observer agreement of PACSS and binary PACSS were moderate (κ = 0.60) and substantial (κ = 0.72), respectively, while intra-observer agreement was almost perfect in both scores (κ = 0.86). Inter- and intra-observer agreement of mPACSS were moderate (κ = 0.48) and substantial (κ = 0.77), respectively. Mean assessment time for an experienced rater was 3.43 ± 0.93 min per CTA scan. Conclusion: Both the semi-quantitative PACSS and mPACSS scores for (infra)popliteal arteries can be performed reliably on pre-operative CTA. Graphic Abstract: (Figure presented.)