Krosschell KJ, Bosch M, Nelson L, Duong T, Lowes LP, Alfano LN, Benjamin D, Carry TB, Devine G, Kelley C, Gadekan R, Malkus EC, Pasternak A, Provance-Orr S, Roemeiser-Logan L, Nicorici A, Trussell D, Young SD, Fetterman JR, Montes J, Powers PJ, Quinones R, Quigley J, Coffey CS, Yankey JW, Bartlett AW, Kissel JT, Kolb SJ, NeuroNEXT Clinical Trial Network and on behalf of the NN101 SMA Biomarker Investigators.
Motor Function Test Reliability During the NeuroNEXT Spinal Muscular Atrophy Infant Biomarker Study. Journal of Neuromuscular Diseases. 2018; 5(4):509-521.
PubMed: 30223401
BACKGROUND: The NeuroNEXT SMA Infant Biomarker Study, a two year, longitudinal, multi-center study of infants with SMA type 1 and healthy infants, presented a unique opportunity to assess multi-site rater reliability on three infant motor function tests (MFTs) commonly used to assess infants with SMA type 1.
OBJECTIVE: To determine the effect of prospective MFT rater training and the effect of rater experience on inter-rater and intra-rater reliability for the Test of Infant Motor Performance Screening Items (TIMPSI), the Children's Hospital of Philadelphia Infant Test of Neuromuscular Disorders (CHOP-INTEND) and the Alberta Infant Motor Scale (AIMS).
METHODS: Training was conducted utilizing a novel set of motor function test (MFT) videos to optimize accurate MFT administration and reliability for the study duration. Inter- and intra-rater reliability of scoring for the TIMPSI and inter-rater reliability of scoring for the CHOP INTEND and the AIMS was assessed using intraclass correlation coefficients (ICC). Effect of rater experience on reliability was examined using ICC. Agreement with 'expert' consensus scores was examined using Pearson's correlation coefficients.
RESULTS: Inter-rater reliability on all MFTs was good to excellent. Intra-rater reliability for the primary MFT, the TIMPSI, was excellent for the study duration. Agreement with 'expert' consensus was within predetermined limits (≥85%) after training. Evaluator experience with SMA and MFTs did not affect reliability.
CONCLUSIONS: Reliability of scores across evaluators was demonstrated for all three study MFTs and scores were reproducible on repeated administration. Evaluator experience had no effect on reliability.