The Application of Feed - Forward Neural Network Architecture for Improving Energy Efficiency


  • Delia Balacian Bucharest University of Economic Studies
  • Denisa Maria Melian Bucharest University of Economic Studies, Bucharest, Romania
  • Stelian Stancu Informatics and Economic Cybernetics Department, Bucharest University of Economic Studies, Centre for Industrial and Services Economics, Romanian Academy, Bucharest, Romania



Feed – Forward Neural Network, Energy Consumption, Prediction Model, Building Energy


The energy sector contributes approximately two-thirds of global greenhouse gas emissions. In this context, the sector must adapt to new supply and demand networks for all future energy sources. The ongoing transformation in the European energy field is driven by the ambition of the European Union to reach the climate objectives set for 2030. The main actions are increasing renewable energy production, adapting transition fuels like natural gas to reduce emissions, improving energy efficiency across all economic sectors, prioritizing building, transportation, and industry, developing Carbon Capture and Storage technologies, and ensuring universal access to clean and affordable energy. The significant changes envisaged in the energy sector to increase renewable energy production and consumption require improved integration and more use of predictive tools to support stakeholders' decision-making processes. This article presents a case study to assess the performance of predictive models based on a Feed-Forward Neural Network architecture that employ Root Mean Squared Propagation as their optimization function in terms of choosing the most appropriate activation function for this kind of data input and output. The training and testing phases of the models use data about building energy consumption. The lowest training time and Root Mean Square Error values were similar for Rectified Linear Unit and Tanh activation functions. The model with the Rectified linear Unit activation function performed best.


Amasyali, K., & El-Gohary, N. (2018). A review of data-driven building energy consumption prediction studies. Renewable and Sustainable Energy Reviews, 81 1192-1205

Aydinalp, M., Ugursal, V., & Fung, A. (2004). Modelling of the space and domestic hot-water heating energy-consumption in the residential sector using neural networks. Applied Energy, 79, 159-178

Chatterjee, A., Engelen, R., Kawa, S., Sweeney, C., & Michalak, A. (2013, July 24). Background error covariance estimation for atmospheric CO2 data assimilation. JGR Atmospheres, 118(10140-10154),

D’Amico, A., Ciulla, G., Traverso, M., Brano, V., & Palumbo, E. (2019). Artificial Neural Networks to assess energy and environmental performance of buildings: An Italian case study. Journal of Cleaner Production, 239 117993.

European Comission. (2019, May 9). Root mean square error (RMSE). Retrieved May 2023, from Collaboration in Research and Methodology for Official Statistics:

Government of British Columbia. (2018). How It Works: Energy Step Code.

Government of Canada. (2022). Natual resources Canada, energy efficiency.

Haibo, F., Jianfeng, Z., Haonan, Z., Shiyao, Z., Dezhi, L., & Niraj, T. (2022). Uncertainties in whole-building life cycle assessment: A systematic review. Journal of Building Engineering, 50, ISSN 2352-7102,

Hestness, J., Narang, S., Ardalani, N., Diamos, G., Jun, H., Kianinejad, H., . . . Zhou, Y. (2017, December 1). Deep learning scaling is predictable, empirically. Cornell University:

Howard, A., Balbach, C., Miller, C., Haberl, J., Gowri, K., & Dane, S. (2019). ASHRAE - Great Energy Predictor III . Retrieved December 2022, from ASHRAE:

International Energy Agency. (2020, March 23). If the energy sector is to tackle climate change, it must also think about water. Retrieved May 2023, from IEA:

Jerez, S., Montávez, J., Jimenez-Guerrero, P., Gómez-Navarro, J., Lorente-Plazas, R., & Zorita, E. (2012, January). A multi-physics ensemble of present-day climate regional simulations over the Iberian Peninsula. Climate Dynamics, 40, 3023-3046, DOI: 10.1007/s00382-012-1539-1

Johnson, M., & Nguyen, D. (2017). How much data is enough? Predicting how accuracy varies with training data size. Macquarie University, Sydney

Kaplan, J., McCandlish, S., Henighan, T., Brown, T., Chess, B., Child, R., . . . Amodei, D. (2020, January 23). Scaling laws for neural language models. Cornell University:

Karunathilake, H., Hewage, K., & Sadiq, R. (2018). Opportunities and challenges in energy demand reduction for Canadian residential sector: A review. Renewable and Sustainable Energy Reviews, 82

Mathieu, B., Xiao, q. Z., Elyes, N., Xiaofeng, G., & Patrice, C. (2019). Modeling and forecasting building energy consumption: A review of data driven techniques. Sustainable Cities and Society, 48,

McKeen, S., Wilczak, J., Grell, G., Djalalova, I., Peckham, S., Hsie, E., . . . Mathur, R. (2005). Assessment of an ensemble of seven realtime ozone forecasts over eastern North America during the summer of 2004. Journal of Geophysical Research, 110 doi:10.1029/2005JD005858

Mihalakakou, G., Santamouris, M., & Tsangrassoulis, A. (2022). On the energy consumption in residential buildings. Energy and Buildings, 34(7) 727-736.

Prabatha, T., Hewage, K., Karunathilake, H., & Sadiq, R. (2020). To retrofit or not? Making energy retrofit decisions through life cycle thinking for Canadian residences. Energy and Buildings, 226, 110393.

Rosenfeld, J., Rosenfeld, A., Belinkov, Y., & Shavit, N. (2019). A constructive prediction of the generalization error across scales.

Seyedzadeh, S., Rahimian, F., Oliver, S., Glesk, I., & Kumar, B. (2020). Data driven model improved by multi-objective optimisation for prediction of building energy loads. Automation in Construction, 116,

Taylor, M. H., Losch, M., Wenzel, M., & Schröter, J. (2013). On the sensitivity of field reconstruction and prediction using empirical orthogonal functions derived from gappy data. Journal of Climate, 26(22),

Thrampoulidis, E., Mavromatidis, G., Lucchi, A., & Orehounig, K. (2021). A machine learning-based surrogate model to approximate optimal building retrofit solutions. Applied Energy, 281,

Tian, Z., Si, B., Shi, X., & Fang, Z. (2019). An application of Bayesian Network approach for selecting energy efficient HVAC systems. Journal of Building Engineering, 25

Wei, Y., Zhang, X., Shi, Y., Xia, L., Pan, S., Wu, J., . . . Zhao, X. (2018). A review of data-driven approaches for prediction and classification of building energy consumption. Renewable and Sustainable Energy Reviews, 82 1027-1047.

Zhang, H., Hewage, K., Prabatha, T., & Sadiq, R. (2021). Life cycle thinking-based energy retrofits evaluation framework for Canadian residences: A Pareto optimization approach. Building and Environment, 204

Zhichao, T., Binghui, S., Xing, S., & Zigeng, F. (2019). An application of Bayesian Network approach for selecting energy efficient HVAC systems. Journal of Building Engineering, 25,




How to Cite

Balacian, D., Melian, D. M., & Stancu, S. (2023). The Application of Feed - Forward Neural Network Architecture for Improving Energy Efficiency. Postmodern Openings, 14(2), 1-17.



Postmodern Economy

Publish your work at the Scientific Publishing House LUMEN

It easy with us: publish now your work, novel, research, proceeding at Lumen Scientific Publishing House

Send your manuscript right now