Impact of Outliers on Regression Models Performance: A Comparative Analysis of Diabetes Data | ||
| المجلة العلمية للدراسات والبحوث المالية والتجارية | ||
| Volume 6, Issue 2 - Serial Number 1, July 2025, Pages 241-269 PDF (1.38 M) | ||
| Document Type: المقالة الأصلية | ||
| DOI: 10.21608/cfdj.2025.363449.2188 | ||
| Author | ||
| Abdelreheem Bassuny* | ||
| Higher Institute of Management in EL Mahalla El-Kubra | ||
| Abstract | ||
| This study used a dataset of 150 diabetic patients from Kafr El-Sheikh, Egypt, collected between 2000 and 2024, to examine the impact of outliers on the performance of different regression models: OLS, RR, QR, and SVR. Outliers were addressed using the Trimmed Mean method, and performance was evaluated using R², MSE, and MAE. The results showed that the OLS model was the most sensitive to outliers, while the QR model was relatively robust. For example, the MSE for the SVR model decreased by 50.59% upon removing outliers, whereas the changes in RR and QR were less significant. Without outliers, the RR model achieved the highest R² value (0.8618), and the QR model had the lowest MSE (0.9875) and MAE (0.9072). These findings highlight the critical need to carefully select regression techniques and outlier handling methods, even with seemingly robust models like QR, to ensure valid and reliable statistical inferences. Future research should explore alternative outlier handling methods, investigate the causes of outliers, and develop data and model-specific outlier treatment strategies. | ||
| Keywords | ||
| : outliers; Quintile Regression; Ridge Regression; Support vector regression | ||
|
Statistics Article View: 87 PDF Download: 152 |
||
