TY - JOUR
T1 - A Systematic Categorization of Performance Measures for Estimated Non-Linear Associations Between an Outcome and Continuous Predictors
AU - TG2 of the STRATOS Initiative
AU - Ullmann, Theresa
AU - Heinze, Georg
AU - Abrahamowicz, Michal
AU - Perperoglou, Aris
AU - Sauerbrei, Willi
AU - Schmid, Matthias
AU - Dunkler, Daniela
AU - Abrahamowicz, Michal
AU - Binder, Harald
AU - Dunkler, Daniela
AU - Harrell, Frank
AU - Heinze, Georg
AU - Henrion, Marc
AU - Kammer, Michael
AU - Nold, Mariana
AU - Perperoglou, Aris
AU - Sauerbrei, Willi
AU - Schmid, Matthias
N1 - Publisher Copyright:
© 2025 The Author(s). WIREs Computational Statistics published by Wiley Periodicals LLC.
PY - 2025/8/31
Y1 - 2025/8/31
N2 - In regression analysis, associations between continuous predictors and the outcome are often assumed to be linear. However, modeling the associations as non-linear can improve model fit. Many flexible modeling techniques, like (fractional) polynomials and spline-based approaches, are available. Such methods can be systematically compared in simulation studies, which require suitable performance measures to evaluate the accuracy of the estimated curves against the true data-generating functions. Although various measures have been proposed in the literature, no systematic overview exists so far. To fill this gap, we introduce a categorization of performance measures for evaluating estimated non-linear associations between an outcome and continuous predictors. This categorization includes many commonly used measures. The measures can not only be used in simulation studies, but also in application studies to compare different estimates to each other. We further illustrate and compare the behavior of different performance measures through some examples and a Shiny app. This article is categorized under: Statistical and Graphical Methods of Data Analysis > Modeling Methods and Algorithms.
AB - In regression analysis, associations between continuous predictors and the outcome are often assumed to be linear. However, modeling the associations as non-linear can improve model fit. Many flexible modeling techniques, like (fractional) polynomials and spline-based approaches, are available. Such methods can be systematically compared in simulation studies, which require suitable performance measures to evaluate the accuracy of the estimated curves against the true data-generating functions. Although various measures have been proposed in the literature, no systematic overview exists so far. To fill this gap, we introduce a categorization of performance measures for evaluating estimated non-linear associations between an outcome and continuous predictors. This categorization includes many commonly used measures. The measures can not only be used in simulation studies, but also in application studies to compare different estimates to each other. We further illustrate and compare the behavior of different performance measures through some examples and a Shiny app. This article is categorized under: Statistical and Graphical Methods of Data Analysis > Modeling Methods and Algorithms.
KW - fractional polynomials
KW - functional associations
KW - simulation
KW - smoothing
KW - splines
U2 - 10.1002/wics.70042
DO - 10.1002/wics.70042
M3 - Review article
AN - SCOPUS:105015422216
SN - 1939-5108
VL - 17
JO - Wiley Interdisciplinary Reviews: Computational Statistics
JF - Wiley Interdisciplinary Reviews: Computational Statistics
IS - 3
M1 - e70042
ER -