Spatial clustering is important for identifying regions with similar spatial patterns in spatial datasets. This study focuses on selecting the optimal tuning parameter for the generalized lasso in spatial clustering analysis. Common approaches for selecting the tuning parameter in the generalized lasso include generalized cross-validation (GCV) and approximate leave-one-out cross-validation (ALOCV). However, these methods often produce substantially different tuning parameter values, which may lead to inconsistent clustering results and misinterpretation. In general, ALOCV tends to select larger tuning parameters, whereas GCV tends to select smaller ones. To address this issue, we propose an ensemble learning cross-validation (ELCV) approach that combines the validation errors from ALOCV and GCV using arithmetic, geometric, and harmonic means to obtain a more balanced tuning parameter selection. In addition, an analytical justification of the proposed ensemble framework is provided to demonstrate its theoretical relationship with ALOCV and GCV. A simulation study was conducted under four spatial clustering scenarios, namely three separated clusters, three connected clusters, five separated clusters, and five connected clusters, combined with three noise standard deviation levels to evaluate the robustness of the proposed methods. The Index of Edge Detection Accuracy (IEDA) was used as the primary criterion for assessing clustering performance. The simulation results showed that the proposed methods based on the geometric mean, and the harmonic mean, consistently achieved better and more stable performance across different scenarios and noise levels, as indicated by higher IEDA values and lower estimation errors compared to ALOCV and GCV. Finally, the proposed methods were applied to cluster the productivity of oil palm fresh fruit bunches (FFB) across several planting blocks in oil palm concessions in Kalimantan, Indonesia.
Spatial clustering is important for identifying regions with similar spatial patterns in spatial datasets. This study focuses on selecting the optimal tuning parameter for the generalized lasso in spatial clustering analysis. Common approaches for selecting the tuning parameter in the generalized lasso include generalized cross-validation (GCV) and approximate leave-one-out cross-validation (ALOCV). However, these methods often produce substantially different tuning parameter values, which may lead to inconsistent clustering results and misinterpretation. In general, ALOCV tends to select larger tuning parameters, whereas GCV tends to select smaller ones. To address this issue, we propose an ensemble learning cross-validation (ELCV) approach that combines the validation errors from ALOCV and GCV using arithmetic, geometric, and harmonic means to obtain a more balanced tuning parameter selection. In addition, an analytical justification of the proposed ensemble framework is provided to demonstrate its theoretical relationship with ALOCV and GCV. A simulation study was conducted under four spatial clustering scenarios, namely three separated clusters, three connected clusters, five separated clusters, and five connected clusters, combined with three noise standard deviation levels to evaluate the robustness of the proposed methods. The Index of Edge Detection Accuracy (IEDA) was used as the primary criterion for assessing clustering performance. The simulation results showed that the proposed methods based on the geometric mean, and the harmonic mean, consistently achieved better and more stable performance across different scenarios and noise levels, as indicated by higher IEDA values and lower estimation errors compared to ALOCV and GCV. Finally, the proposed methods were applied to cluster the productivity of oil palm fresh fruit bunches (FFB) across several planting blocks in oil palm concessions in Kalimantan, Indonesia.
Price excludes VAT (USA)
Tax calculation will be finalised during checkout.
Instant access to the full article PDF.
Arlot S, and Celisse A (2010) A survey of cross-validation procedures. Stat Surv, 4, 40–79. https://doi.org/10.48550/arXiv.0907.4728
Arnold TB, Tibshirani RJ (2016) Efficient implementations of the generalized lasso dual path algorithm. J Comput Graph Stat 25(1):1–27. https://doi.org/10.1080/10618600.2015.1008638
Banerjee S, Carlin BP, Gelfand AE (2015) Hierarchical modeling and analysis for spatial data. Chapman and Hall/CRC
Bishop CM (2006) Pattern recognition and machine learning. Springer, Berlin
Breiman L (1996) Bagging predictors. Mach Learn 24:123–140. https://doi.org/10.1007/BF00058655
Craven P, Wahba G (1979) Smoothing noisy data with spline functions (Estimating the Correct Degree of Smoothing by the Method of Generalized Cross-Validation). Numer Math 31:377–403
Cressie N (1993) Statistics for spatial data. John Wiley & Sons, Inc.
Dietterich TG (2000) Ensemble methods in machine learning. Multiple classifier systems. Springer, pp 1–15
Fischer MM, Getis A (2010) Handbook of applied spatial analysis: software tools, methods and applications. Springer
Gelfand AE, Kim H-J, Sirmans CF, Banerjee S (2003) Spatial modeling with spatially varying coefficient processes. J Am Stat Assoc 98(462):387–396. https://doi.org/10.1198/016214503000170
Geman S, Bienenstock E, Doursat R (1992) Neural networks and the bias-variance dilemma. Neural Comput 4:1–58
Golub GH, Heath M, Ruskeep D (1979) Generalized cross-validation as a method for choosing a good ridge parameter. Technometrics 21(2):215–223. https://doi.org/10.2307/1268518
Hansen LK, Salamon P (1990) Neural network ensembles. IEEE Trans Pattern Anal Mach Intell 12(10):993–1001
Hastie T, Tibshirani R, Friedman J (2009) The elements of statistical learning: data mining, inference, and prediction. Springer
Kurnia A, Rahardiantoro S, Oktarina SD, Anisa R, Rahman NAN, and Handayani D (2024) Modified generalized lasso for variable selection in lag distributed modeling of fresh fruit bunch production from oil palm plantations in Riau-Indonesia. Int J Adv Soft Compu Appl 16 (1), 1–17. IJASCA.240330.01
Oktarina SD, Nurkhoiry R, Pradiko I (2021) The effect of climate change to palm oil price dynamics: a supply and demand model. IOP Conf Ser Earth Environ Sci 782(3):032062. https://doi.org/10.1088/1755-1315/782/3/032062
Rad KR, and Maleki A (2018) A scalable estimate of the extra-sample prediction error via approximate leave-one-out
Rad KR, Zhou W, and Maleki A (2020) Error bounds in estimating the out-of-sample prediction error using leave-one-out cross validation in high-dimensions. In: Proceedings of the 23rd International Conference on Artificial Intelligence and Statistics (AISTATS), 108
Rahardiantoro S (2023) Extension of the generalized lasso application in the spatial data analysis. (Dissertation)
Rahardiantoro S, Sakamoto W (2021) Clustering regions based on socio-economic factors which affected the number of COVID-19 cases in Java Island. J Phys Conf Ser 1863(1):012014. https://doi.org/10.1088/1742-6596/1863/1/012014
Rahardiantoro S, Sakamoto W (2022) Optimum tuning parameter selection in generalized lasso for clustering with spatially varying coefficient models. IOP Conf Ser Earth Environ Sci 950(1):012093. https://doi.org/10.1088/1755-1315/950/1/012093
Rahardiantoro S, Sakamoto W (2024) Spatio-temporal clustering analysis using generalized lasso with an application to reveal the spread of Covid-19 cases in Japan. Comput Stat 39:1513–1537. https://doi.org/10.1007/s00180-023-01331-x
Rahardiantoro S, Oktarina SD, Kurnia A, Maharani NS, Juhanda AR (2024) Spatio-temporal clustering using generalized lasso to identify the spread of Covid-19 in Indonesia according to provincial flight route-based connections. Spat Stat 1(63):100857. https://doi.org/10.1016/j.spasta.2024.100857
Rahardiantoro S, Juhanda ARN, Kurnia A, Aswi A, Sartono B, Handayani D, Soleh AM, Yanti Y, Cramb S (2024) Spatio-temporal modeling to identify factors associated with stunting in Indonesia using a modified generalized lasso. Spat Spatio-temporal Epidemiol 51:100694. https://doi.org/10.1016/j.sste.2024.100694
Rahardiantoro S, Darajati A, Wijayanto H, Kurnia A (2026) A spatial approach to correlated high- dimensional stunting data in Indonesia using a modified generalized lasso. Int J Adv Soft Compu Appl 18(1):304–320. https://doi.org/10.15849/ijasca.v18i1.18
Stone M (1974) Cross-validatory choice and assessment of statistical predictions. J Roy Stat Soc: Ser B (Methodol) 36(2):111–147
Tibshirani, R.J., Taylor, J., 2011. The solution path of the generalized lasso. Ann. Statis. 39(3). https://doi.org/10.1214/11-AOS878.
Tiefelsdorf M, Boots BN (2004) Analyzing spatial structure: a practical guide to the analysis of spatial data. SAGE Publications
van Erven T, Harremos P (2014) Rényi divergence and Kullback-Leibler divergence. IEEE Trans Inf Theory 60(7):3797–3820. https://doi.org/10.1109/TIT.2014.2320500
Wang S, Zhou W, Maleki A, Lu H, and Mirrokni V (2018) Approximate leave-one-out for high- dimensional non-differentiable learning problems. arXiv:1810.02716
Zhao Y, Bondell H (2020) Solution paths for the generalized lasso with applications to spatially varying coefficients regression. Comput Stat Data Anal 142:106821. https://doi.org/10.1016/j.csda.2019.106821
Zhou ZH (2012) Ensemble methods: foundations and algorithms. Chapman and Hall/CRC, New York. https://doi.org/10.1201/b12207
Program in Statistics and Data Science, School of Data Science, Mathematics, and Informatics, IPB University, Bogor, Indonesia
Septian Rahardiantoro, Sachnaz Desta Oktarina, Gerry Alfa Dito, Indahwati Indahwati & Anang Kurnia
Program in Statistics, Universitas Negeri Jakarta, Jakarta, Indonesia
Dian Handayani
Authors
Correspondence to Septian Rahardiantoro or Anang Kurnia.
This research is supported by The Directorate General of Higher Education, Research and Technology of the Ministry of Education, Culture, Research and Technology the Republic of Indonesia based on contract number 027/E5/PG.02.00.PL/2024 for the Fundamental Research schema. This research was also supported by the IPB University research grant “Penelitian Dosen Muda” 2024 under Contract Number 23445/IT3/PT.01.03/P/B/2024.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
Rahardiantoro, S., Oktarina, S.D., Dito, G.A. et al. The Ensemble Learning to Determine Optimal Tuning Parameter of the Generalized Lasso in Spatial Clustering Analysis. J Stat Theory Pract 20, 102 (2026). https://doi.org/10.1007/s42519-026-00627-7
Received: 15 April 2025
Accepted: 11 July 2026
Published: 22 July 2026
Version of record: 22 July 2026
DOI: https://doi.org/10.1007/s42519-026-00627-7