Research article

Simulated annealing in feature selection approach for modeling aboveground carbon stock at the transition between Brazilian Savanna and Atlantic Forest biomes

Laís Almeida Araújo , Isáira Leite e Lopes, Rafael Menali Oliveira, Sérgio Henrique Godinho Silva, Carolina Souza Jarochinski e Silva, Lucas Rezende Gomide

Laís Almeida Araújo
Federal University of Lavras. Email: la_sal@hotmail.com
Isáira Leite e Lopes
Federal University of Lavras
Rafael Menali Oliveira
Federal University of Lavras
Sérgio Henrique Godinho Silva
Federal University of Lavras
Carolina Souza Jarochinski e Silva
Federal University of Lavras
Lucas Rezende Gomide
Federal University of Lavras

Online First: June 27, 2022
Araújo, L., Lopes, I., Oliveira, R., Silva, S., Silva, C., Gomide, L. 2022. Simulated annealing in feature selection approach for modeling aboveground carbon stock at the transition between Brazilian Savanna and Atlantic Forest biomes. Annals of Forest Research DOI:10.15287/afr.2022.2064


Forest ecosystems are important in the carbon storage process. Thus, the objective was to investigate the effectiveness of the Simulated Annealing meta-heuristic analysis for selecting variables to maximize the accuracy of the aboveground carbon prediction at the tree level. We used data from uneven-aged forests located in the Rio Grande Basin - Minas Gerais, Brazil, where 227 trees had their carbon stock measured. The classic Spurr linear model, stepwise linear regression and pan-tropical coverage, Random Forest (RF), and the hybrid SARF method (Simulated Annealing and Random Forest) were used to estimate the carbon stock from the selection of variables for the different compartments of the tree (total, stem, branch, and leaf). The SARF consisted of the metaheuristic to select the variables to be used in the RF. These methods were evaluated by the root mean square error (RMSE), coefficient of determination (R²), and residual graph. As a result, the pan-tropical equation demonstrated superior performance than the Spurr model due to its greater homogeneity of residues. The stepwise technique reduced the number of variables and the error of the estimates, mainly for the validation set. SARF showed better adjustments than RF, as it reduced in on average 99.2% of the number of variables and 9% of the error of estimates considering all compartments. In general, variables such as volume, basic wood density, canopy projection area, diameter at 0%, diameter at breast height, height, and latitude contributed strongly to the carbon independent of the tree compartment. Among the methods, SARF is an alternative to the traditional method, as it can extract accurate information from a large data set


Abbasi B., Niaki S.T.A., Khalife M.A., & Faize Y., 2011. A hybrid variable neighborhood search and simulated annealing algorithm to estimate the three parameters of the Weibull distribution. Expert Systems with Applications, 38(1):700-708. https://doi.org/10.1016/j. eswa.2010.07.022

Anifowose F.A., Labadin J., Abdulraheem A., 2014. Non- linear feature selection-based hybrid computational intelligence models for improved natural gas reservoir characterization. J Nat Gas Sci Eng 21:397–410. https:// doi.org/10.1016/j.jngse.2014.09.001

Bagherzadeh-Khiabani F., Ramezankhani A., Azizi F., Hadaegh F., Steyerberg E.W., Khalili D., 2016. A tutorial on variable selection for clinical prediction models: feature selection methods in data mining could improve the results. J Clin Epidemiol 71:76–85. https:// doi.org/10.1016/j.jclinepi.2015.10.002

Baker D.J., Richards G., Grainger A., Gonzalez P., Brown S., DeFries R., Held A., Kellndorfer J., Ndunda P., Ojima D. et al., 2010. Achieving forest carbon information with higher certainty: A five-part plan. Environ Sci Policy 13:249–260. https://doi.org/10.1016/j. envsci.2010.03.004

Breiman L., 2001. Random forests. Machine Learning 45, 5–32. https://doi.org/https://doi. org/10.1023/A:1010933404324

Bui D.T., Bui Q.T., Nguyen Q.P., Pradhan B., Nampak H., Trinh P.T., 2017. Ahybrid artificial intelligence approach using GIS-based neural-fuzzy inference system and particle swarm optimization for forest fire susceptibility modeling at a tropical area. Agric For Meteorol 233:32– 44. https://doi.org/10.1016/j.agrformet.2016.11.002

Burrows W.H., Hoffmann M.B., Compton J.F., Back P.V., Tait L.J., 2000. Allometric relationships and community biomass estimates for some dominant eucalypts in Central Queensland woodlands. Aust J Bot 48:707–714. https://doi.org/10.1071/BT99066

Carreiras J.M.B., Vasconcelos M.J., Lucas R.M., 2012. Understanding the relationship between aboveground biomass and ALOS PALSAR data in the forests of Guinea-Bissau (West Africa). Remote Sens Environ 121:426–442. https://doi.org/10.1016/j.rse.2012.02.012

Carvalho L.G. de, Oliveira M.S. de, Alves M. de C., Vianello R.L., Sediyama G.C., Neto P.C., Dantas A.A.A., 2008. Clima. In: Scolforo J.R.S., Carvalho L.M.T., Oliveira A.D. (eds.) Zoneamento ecológico - econômico do estado de Minas Gerais: comoponentes geofísico e biótico. pp 89–101.

Chave J., Andalo C., Brown S., Cairns M.A., Chambers J.Q., Eamus D., Fölster H., Fromard F., Higuchi N., Kira T. et al., 2005. Tree allometry and improved estimation of carbon stocks and balance in tropical forests. Oecologia 145:87–99. https://doi.org/10.1007/s00442- 005-0100-x

Chave J., Réjou-Méchain M., Búrquez A., Chidumayo E., Colgan M.S., Delitti W.B.C., Duque A., Eid T., Fearnside P.M., Goodman R.C. et al., 2014. Improved allometric models to estimate the aboveground biomass of tropical trees. Glob Chang Biol 20:3177–3190. https://doi.org/10.1111/gcb.12629

Chinembiri T.S., Bronsveld M.C., Rossiter D.G., Dube T., 2013. The precision of C stock estimation in the Ludhikola watershed using model-based and design- based approaches. Nat Resour Res 22:297–309. https:// doi.org/10.1007/s11053-013-9216-6

Coletta V., Menguzzato G., Pellicone G., Veltri A., Marziliano P.A., 2016. Effect of thinning on above- ground biomass accumulation in a Douglas-fir plantation in southern Italy. J For Res 27:1313–1320. https://doi.org/10.1007/s11676-016-0247-9

Corona-Núñez R.O., Mendoza-Ponce A., López- Martínez R., 2017. Model selection changes the spatial heterogeneity and total potential carbon in a tropical dry forest. For Ecol Manage 405:69–80. https://doi. org/10.1016/j.foreco.2017.09.018

Dantas D., Terra M. de C.N.S., Schorr L.P.B., Calegario N., 2021. Machine learning for carbon stock prediction in a tropical forest in southeastern brazil. Bosque 42:131–140. https://doi.org/10.4067/S0717-92002021000100131

Day P., Iannucci S., Banicescu I., 2020. Autonomic feature selection using computational intelligence. Futur Gener Comput Syst 111:68–81. https://doi.org/10.1016/j. future.2020.04.015

Drake J.M., Randin C., Guisan A., 2006. Modelling ecological niches with support vector machines. J Appl Ecol 43:424–432. https://doi.org/10.1111/j.1365- 2664.2006.01141.x

Enquist B.J., Niklas K.J., 2001. Correction: Corrigendum: Invariant scaling relations across tree-dominated communities. Nature 425:741. https://doi.org/10.1038/ nature02023

Feldpausch T.R., Lloyd J., Lewis S.L., Brienen R.J.W., Gloor M., Monteagudo Mendoza A., Lopez-Gonzalez G., Banin L., Abu Salim K., Affum-Baffoe K. et al., 2012. Tree height integrated into pantropical forest biomass estimates. Biogeosciences 9:3381–3403. https://doi.org/10.5194/bg-9-3381-2012

Fox J., Weisberg S., Price B., et al., 2019. car: Companion to applied regression. R package version 3(3).

Gauchi J.-P., Chagnon P., 2001. Comparison of selection methods of explanatory variables in PLS regression with application to manufacturing process data. Chemom Intell Lab Syst 58:171–193. https://doi.org/10.1016/ S0169-7439(01)00158-7

Genuer R., Poggi J.M., Tuleau-Malot C., 2010. Variable selection using random forests. Pattern Recognit Lett 31:2225–2236. https://doi.org/10.1016/j. patrec.2010.03.014

Gleason C.J., Im J., 2012. Forest biomass estimation from airborne LiDAR data using machine learning approaches. Remote Sens Environ 125:80–91. https:// doi.org/10.1016/j.rse.2012.07.006

Goodman R.C., Phillips O.L., Baker T.R., 2014. The importance of crown dimensions to improve tropical tree biomass estimates . Ecol Appl 24(4):680-698. https://doi.org/10.1890/13-0070.1

Guangyi M., Yujun S., Saeed S., 2017. Models for predicting the biomass of Cunninghamia lanceolata trees and stands in Southeastern China. PLoS One 12:1–14. https://doi.org/10.1371/journal.pone.0169747

Guo P.-T., Li M.-F., Luo W., Tang Q.-F., Liu Z.-W., Lin Z.-M., 2015. Digital mapping of soil organic matter for rubber plantation at regional scale: An application of random forest plus residuals kriging approach. Geoderma 237–238:49–59. https://doi.org/10.1016/j. geoderma.2014.08.009

Guyon I., Elisseeff A., 2003. An introduction to variable and feature selection. J of Machine Learn Res 3:1157– 1182.

Han J., Kamber M., Pei J., 2011. Data mining: concepts and techniques. Elsevier.

Hapfelmeier A., Ulm K., 2014. Variable selection by Random Forests using data with missing values. Comput Stat Data Anal 80:129–139. https://doi.org/10.1016/j. csda.2014.06.017

Heinrich V.H.A., Dalagnol R., Cassol H.L.G., et al., 2021. Large carbon sink potential of secondary forests in the Brazilian Amazon to mitigate climate change. Nat Commun 12:1785. https://doi.org/10.1038/s41467-021-22050-1

Henry M., Picard N., Trotta C., Manlay R.J., Valentini R., Bernoux M., Saint-André L., 2011. Estimating tree biomass of sub-Saharan African forests: A review of available allometric equations. Silva Fenn 45:477–569. https://doi.org/10.14214/sf.38

Hong H., Tsangaratos P., Ilia I., Liu J., Zhu A.-X., Xu C., 2018. Applying genetic algorithms to set the optimal combination of forest fire related variables and model forest fire susceptibility based on data mining models. The case of Dayu County, China. Sci Total Environ 630:1044–1056. https://doi.org/10.1016/j. scitotenv.2018.02.278

Kavzoglu T, Mather PM, 2002. The role of feature selection in artificial neural network applications. Int J Remote Sens 23:2919–2937. https://doi. org/10.1080/01431160110107743

Kazempour Larsary M, Pourbabaei H, Sanaei A, et al., 2021. Tree-size dimension inequality shapes aboveground carbon stock across temperate forest strata along environmental gradients. For Ecol Manage 496:1–10. https://doi.org/10.1016/j.foreco.2021.119482

Kuyah S, Muthuri C, Jamnadass R, Mwangi P, Neufeldt H, Dietz J, 2012. Crown area allometries for estimation of aboveground tree biomass in agricultural landscapes of western Kenya. Agrofor Syst 86:267–277. https://doi. org/10.1007/s10457-012-9529-1

Labani M, Moradi P, Ahmadizar F, Jalili M, 2018. A novel multivariate filter method for feature selection in text classification problems. Eng Appl Artif Intell 70:25–37. https://doi.org/10.1016/j.engappai.2017.12.014

Liu H., Yu L., 2005. Toward integrating feature selection algorithms for classification and clustering. IEEE Trans Knowl Data Eng 17:491–502. https://doi.org/10.1109/ TKDE.2005.66

Mafarja M.M., Mirjalili S., 2017. Hybrid Whale Optimization Algorithm with simulated annealing for feature selection. Neurocomputing 260:302–312. https://doi.org/10.1016/j.neucom.2017.04.053

Magalhães T.M., Seifert T., 2015. Estimation of tree biomass, carbon stocks, and error propagation in Mecrusse Woodlands. Open J For 05:471–488. https:// doi.org/10.4236/ojf.2015.54041

Manimala K., Selvi K., Ahila R., 2011. Hybrid soft computing techniques for feature selection and parameter optimization in power quality data mining. Appl Soft Comput J 11:5485–5497. https://doi. org/10.1016/j.asoc.2011.05.010

Marziliano P.A., Lafortezza R., Colangelo G., Davies C., Sanesi G., 2013. Structural diversity and height growth models in urban forest plantations: A case-study in northern Italy. Urban For Urban Green 12:246–254. https://doi.org/10.1016/j.ufug.2013.01.006

Marziliano P.A., Menguzzato G., Scuderi A., Scuderi A., Scalise C., Coletta V., 2017. Biomass conversion and expansion factors in Douglas-fir stands of different planting density: Variation according to individual growth and prediction equations. For Syst 26(1):e003. https://doi.org/10.5424/fs/2017261-10239

Mello C.R., Viola M.R., Beskow S., Norton L.D., 2013. Multivariate models for annual rainfall erosivity in Brazil. Geoderma 202–203:88–102. https://doi. org/10.1016/j.geoderma.2013.03.009

Mendoza-Ponce A., Corona-Núñez R., Kraxner F., Leduc S., Patrizio P., 2018. Identifying effects of land use cover changes and climate change on terrestrial ecosystems and carbon stocks in Mexico. Glob Environ Chang 53:12–23. https://doi.org/10.1016/j. gloenvcha.2018.08.004

Mouazen A.M., Kuang B., De Baerdemaeker J., Ramon H., 2010. Comparison among principal component, partial least squares and back propagation neural network analyses for accuracy of measurement of selected soil properties with visible and near infrared spectroscopy. Geoderma 158:23–31. https://doi.org/10.1016/j. geoderma.2010.03.001

Návar J., 2009. Allometric equations for tree species and carbon stocks for forests of northwestern Mexico. For Ecol Manage 257:427–434. https://doi.org/10.1016/j. foreco.2008.09.028

Nunes M.H., Görgens E.B., 2016. Artificial intelligence procedures for tree taper estimation within a complex vegetation mosaic in Brazil. PLoS One 11(5):e0154738. https://doi.org/10.1371/journal.pone.0154738

Ou Q., Lei X., Shen C., 2019. Individual tree diameter growth models of larch–spruce–fir mixed forests based on machine learning algorithms. Forests 10:187. https:// doi.org/10.3390/f10020187

Pechanec V., Purkyt J., Benc A., Nwaogu C., Štěrbová L., Cudlín P., 2018. Modelling of the carbon sequestration and its prediction under climate change. Ecol Inform 47:50–54. https://doi.org/10.1016/j.ecoinf.2017.08.006

Pham MH, Do TH, Pham VM, Bui QT, 2020. Mangrove forest classification and aboveground biomass estimation using an atom search algorithm and adaptive neuro-fuzzy inference system. PLoS One 15(5):e0233110. https://doi.org/10.1371/journal. pone.0233110

Picard N., Saint-André L., Henry M., 2012. Manual for building tree volume and biomass allometric equations: From field measurement to prediction. Food and Agricultural Organization of the United Nations, Rome, and Centre de Coopération Internationale en Recherche Agronomique pour le Développement.

Pilli R., Anfodillo T., Carrer M., 2006. Towards a functional and simplified allometry for estimating forest biomass. For Ecol Manage 237:583–593. https://doi. org/10.1016/j.foreco.2006.10.004

Reddy N., Gebreslasie M., Ismail R., 2017. A hybrid partial least squares and random forest approach to modelling forest structural attributes using multispectral remote sensing data. South African J Geomatics 6(3):377. https://doi.org/10.4314/sajg.v6i3.8

Ribeiro S.C., Fehrmann L., Soares C.P.B., Jacovine L.A.G., Kleinn C., Gaspar R.O., 2011. Above- and belowground biomass in a Brazilian Cerrado. For Ecol Manage 262(3):491–499. https://doi.org/10.1016/j. foreco.2011.04.017

Sanquetta C.R., Corte A.P.D., Da Silva F., 2011. Biomass expansion factor and root-to-shoot ratio for Pinus in Brazil. Carbon Balance Manag 6(6). https://doi. org/10.1186/1750-0680-6-6

Sanquetta C.R., Dalla Corte A.P., Behling A., Oliveira Piva L.R., Péllico Netto S., Rodrigues A.L., Sanquetta M.N.I., 2018. Selection criteria for linear regression models to estimate individual tree biomasses in the Atlantic Rain Forest, Brazil. Carbon Balance Manag 13:25. https://doi.org/10.1186/s13021-018-0112-6

Scolforo H.F., Scolforo J.R.S., Mello C.R., Mello J.M., Ferraz Filho A.C., 2015. Spatial distribution of aboveground carbon stock of the arboreal vegetation in Brazilian Biomes of Savanna, Atlantic Forest and Semi- arid woodland. PLoS One 10(6):e0128781. https://doi. org/10.1371/journal.pone.0128781

Segura M.A., Acuña L.M., Andrade H.J., 2018. Allometric models to estimate aboveground biomass of small trees in wet tropical forests of Colombian Pacific Area. Rev Árvore 42. https://doi.org/10.1590/1806- 90882018000200009

Siddiq Z., Hayyat M.U., Khan A.U., et al., 2021. Models to estimate the above and below ground carbon stocks from a subtropical scrub forest of Pakistan. Glob Ecol Conserv 27:e01539. https://doi.org/10.1016/j. gecco.2021.e01539

Silveira E.M. de O., Silva S.H.G., Acerbi-Junior F.W., Carvalho M.C., Carvalho L.M.T., Scolforo J.R.S., Wulder M.A., 2019. Object-based random forest modelling of aboveground forest biomass outperforms a pixel-based approach in a heterogeneous and mountain tropical environment. Int J Appl Earth Obs Geoinf 78:175–188. https://doi.org/10.1016/j.jag.2019.02.004

Sun S., Peng Q., Shakoor A., 2014. A kernel-based multivariate feature selection method for microarray data classification. PLoS One 9(7):e102541. https://doi. org/10.1371/journal.pone.0102541

Tetemke B.A., Birhane E., Rannestad M.M., Eid T., 2021. Species diversity and stand structural diversity of woody plants predominantly determine aboveground carbon stock of a dry Afromontane forest in Northern Ethiopia. For Ecol Manage 500(15):119634. https://doi. org/10.1016/j.foreco.2021.119634

Vafaei S., Soosani J., Adeli K., Fadaei H., Naghavi H., Pham T.D., Bui D.T., 2018. Improving accuracy estimation of Forest Aboveground Biomass based on incorporation of ALOS-2 PALSAR-2 and Sentinel- 2A imagery and machine learning: A case study of the Hyrcanian forest area (Iran). Remote Sens 10(2):172. https://doi.org/10.3390/rs10020172

Vahedi A.A., 2016. Artificial neural network application in comparison with modeling allometric equations for predicting above-ground biomass in the Hyrcanian mixed-beech forests of Iran. Biomass and Bioenergy 88:66–76. https://doi.org/10.1016/j. biombioe.2016.03.020

Vargas-Larreta B., López-Sánchez C.A., Corral-Rivas J.J., López-Martínez J.O., Aguirre-Calderón C.G., Álvarez-González J.G., 2017. Allometric equations for estimating biomass and carbon stocks in the temperate forests of North-Western Mexico. Forests 8(8):269. https://doi.org/10.3390/f8080269

Vicharnakorn P., Shrestha R.P., Nagai M., Salam A.P., Kiratiprayoon S., 2014. Carbon stock assessment using remote sensing and forest inventory data in Savannakhet, Lao PDR. Remote Sens 6:5452–5479. https://doi.org/10.3390/rs6065452

Vieilledent G., Vaudry R., Andriamanohisoa S.F.D., Rakotonarivo O.S., Randrianasolo H.Z., Razafindrabe H.N., Rakotoarivony C.B., Ebeling J., Rasamoelina M., 2012. A universal approach to estimate biomass and carbon stock in tropical forests using generic allometric models. Ecol Appl 22:572–583. https://doi. org/10.1890/11-0039.1

Vieira G.C., de Mendonça A.R., da Silva G.F., Zanetti S.S., da Silva M.M., dos Santos A.R., 2018. Prognoses of diameter and height of trees of eucalyptus using artificial intelligence. Sci Total Environ 619–620:1473– 1481. https://doi.org/10.1016/j.scitotenv.2017.11.138

Wang B., Waters C., Orgill S., Cowie A., Clark A., Li Liu D., Simpson M., McGowen I., Sides T., 2018. Estimating soil organic carbon stocks using different modelling techniques in the semi-arid rangelands of eastern Australia. Ecol Indic 88:425–438. https://doi. org/10.1016/j.ecolind.2018.01.049

Wang M., Wan Y., Ye Z., Lai X., 2017. Remote sensing image classification based on the optimal support vector machine and modified binary coded ant colony optimization algorithm. Inf Sci (Ny) 402:50–68. https:// doi.org/10.1016/j.ins.2017.03.027

Were K., Bui D.T., Dick Ø.B., Singh B.R., 2015. A comparative assessment of support vector regression, artificial neural networks, and random forests for predicting and mapping soil organic carbon stocks across an Afromontane landscape. Ecol Indic 52:394– 403. https://doi.org/10.1016/j.ecolind.2014.12.028

Wu C., Shen H., Shen A., Deng J., Gan M., Zhu J., Xu H., Wang K., 2016. Comparison of machine-learning methods for above-ground biomass estimation based on Landsat imagery. J Appl Remote Sens 10:035010. https://doi.org/10.1117/1.jrs.10.035010

Wu C., Tao H., Zhai M., Lin Y., Wang K., Deng J., Shen A., Gan M., Li J., Yang H., 2018. Using nonparametric modeling approaches and remote sensing imagery to estimate ecological welfare forest biomass. J For Res 29:151–161. https://doi.org/10.1007/s11676-017-0404-9

Zianis D., Mencuccini M., 2004. On simplifying allometric analyses of forest biomass. For Ecol Manage 187:311– 332. https://doi.org/10.1016/j.foreco.2003.07.007


Cover letter
| DOWNLOAD 37KB
No metrics available for this article.