A Look at the Evaluation Framework for Smart Growth Programmes


  • Liliana Olivia Lucaciu The Bucharest University of Economic Studies, Romania




impact evaluation, smart growth, smart cities, quantitative methods, competitiveness policies.


The research is focused on the methodology for the evaluation of the programmes supporting smart growth based on knowledge and innovation drivers. The paper offers a synthetic view of the smart growth concept, its evolution in the last decades and the way it is transposed into the public interventions. The pressure for a better understanding of the interventions outcomes is increasing, and the quantitative methods are expected to improve the robustness and credibility of the evidence. However, the complex environment, data availability and accessibility are some of the constraints for extensive use of quantitative methods. Tailored evaluation frameworks with clear and strong links between the programmes implemented and the evidences produced and analysed are expected to ensure evaluations are useful and lead to policies improvements. The paper analyses the specific features of the evaluation framework of smart growth programmes with a focus on European Structural and Investment Funds 2014-2020, Smart cities strategies and their interactions. The research methodology is based on an extensive literature review, combining principles from theory and research with practical experience, testing the models on the specific case of current ESIF programmes and adapting them to the features of the smart growth – smart cities interventions. The paper outlines key elements of an evaluation framework, the programmes’ elements and their causal links, potential evaluation questions from the perspective of smart cities stakeholders or ESIF stakeholders or both, an inventory of suitable variables with examples from the competitiveness and regional development programmes 2014-2020 in Romania.


Befield, K. (2018). Its time to update the definition of ”smart growth”. Retrieved from https://www.smartcitiesdive.com/ex/sustainablecitiescollective/itstime-update-definition-smart-growth/18308/

Berman, E. M., & Wang, X. H. (2011). Essential Statistics for public managers and policy analysts. Kindle Edition. Thousand Oaks, USA: SAGE Publications.

Bigulova, V. [veronikabigulova]. (2014, December 10). The brand Barcelona: Smart City for smart people [Video file]. Retrieved from https://issuu.com/veronikabigulova/docs/vb_ma_thesis_brand_barcelon a_smart_

Bondonio, D. (2009). Impact identification strategies for evaluating business incentive programs. POLIS Working Papers 129, Institute of Public Policy and Public Choice - POLIS.Retrieved from http://polis.unipmn.it/pubbl/RePEc/uca/ucapdv/bondonio145.pdf

Carli, R., Dotoli, M., Pellegrino, R., & Ranieri, L. (2013). Measuring and managing the smartness of cities: A framework for classifying performance indicators. Conference: Proceedings of the 2013 IEEE International Conference on Systems, Man, and Cybernetics, 1288-1293. doi:10.1109/SMC.2013.223

Downs, A. (2005). Smart growth. Why We Discuss It More than We Do It .Journal of the American Planning Association, Vol. 71, No. 4, 2005. Retreived from: https://pdfs.semanticscholar.org/76fe/40d52963932c9e51396759ae7d4cf4 fd6a33.pdf

European Commission. (2010a). Communication from the Commission. Europe 2020: A strategy for smart, sustainable and inclusive growth. Retrieved from http://eurlex.europa.eu/LexUriServ/LexUriServ.do?uri=COM:2010:2020:FIN:EN:PDF

European Commission. (2010b). Europe 2020: Flagship Initiative Innovation Union. Communication from the commission to the European Parliament, the Council, the European Economic and Social Committee and Committee of the Regions. Retrieved from https://cdn2.euraxess.org/sites/default/files/policy_library/communicati on_innovation_union.pdf

European Commission (2013). EU Regulation – Common Provision Regulation (CPR). Retrieved from: http://ec.europa.eu/newsroom/dae/document.cfm?doc_id=4803

European Commission. (2014). Guidance on Monitoring and Evaluation, Concepts and Recommendations. Retrieved from http://ec.europa.eu/regional_policy/sources/docoffic/2014/working/wd _2014_en.pdf

European Commission. (2015). Contribution of the European Structural and Investment Funds to the 10 Commission priorities jobs, growth and investment. Retrieved from https://ec.europa.eu/commission/sites/betapolitical/files/key-jobs-growth-invest_en.pdf

Filion, P. (2003). Towards Smart Growth? The difficult implementation of alternatives to urban dispersion. Canadian Journal of Urban Research, 12(1), 48-70. Retrieved from www.jstor.org/stable/44387636

Harrison, C. & Abbot Donnely, I. (2011). A theory of smart cities. Proceedings of the 55th Annual Meeting of the ISSS, 1-15. Retrieved from http://journals.isss.org/index.php/proceedings55th/article/view/1703/57 2.

Holotescu, C., Lucaciu, L., Andone, D., Cişmariu, C., Grosseck, G., & Slavici, T. (2017). Entrepreneurship learning ecosystem for smart cities through MOOCs. BRAIN. Broad Research in Artificial Intelligence and Neuroscience, 8(2), 33-44. Retrieved from http://www.edusoft.ro/brain/index.php/brain/article/view/687

Ingram, G. K., Carbonell, A., Hong, Y. H., & Flint, A. (2009). Smart growth policies: An evaluation of programs outcomes. Cambridge, USA: Lincoln Institute of Land Policy.

Institute of Urban Strategies The Mori Memorial Foundation (IUS-MMF). (2017). The global power city index. Retrieved from http://mori-mfoundation.or.jp/english/ius2/gpci2/index.shtml

Khandker, S., Koolwal, G., & Samad, H. (2010). Handbook on impact evaluation – Quantitative methods and practices. Washington, D.C., USA: The World Bank. Retrieved from https://openknowledge.worldbank.org/bitstream/handle/10986/2693/52 0990PUB0EPI1101Official0Use0Only1.pdf

Lee, S.& Leigh, N.G. (2005). The Role of Inner Ring Suburbs in Metropolitan Smart Growth Strategies. Journal of Planning Literature, Vol. 19, No. 3 (February 2005). doi: 10.1177/0885412204271878.

Loi, M. & Rodrigues, M. (2012). A note on the impact evaluation of public policies: the counterfactual analysis. European Commission, Joint Research Centre Institute for the Protection and Security of the Citizen. doi:10.2788/50327

Lombardi, P. (2011). New challenges in the evaluation of Smart Cities. Network Industries Quarterly, 13(3), 8-10. Retrieved from https://www.researchgate.net/publication/299497205_New_challenges_in _the_evaluation_of_Smart_Cities

Roman, K. (2018). Analysis and evaluation of the implementation of the smart city concept in selected Polish cities. BRAIN. Broad Research in Artificial Intelligence and Neuroscience, 9(1), 138-145. Retrieved from https://www.edusoft.ro/brain/index.php/brain/article/view/758

Yamauchi, T., Kutami, M., Konishi-Nagano, T. (2014). Development of quantitative evaluation method regarding value and environmental impact of cities. Fujitsu Scientific and Technical Journal, 50(2), 112-120. Retrieved from https://pdfs.semanticscholar.org/5cea/b455c17db77ef63add16920887b23 ae1b31d.pdf




How to Cite

Lucaciu, L. O. (2018). A Look at the Evaluation Framework for Smart Growth Programmes. Revista Romaneasca Pentru Educatie Multidimensionala, 10(3), 60-76. https://doi.org/10.18662/rrem/63

Publish your work at the Scientific Publishing House LUMEN

It easy with us: publish now your work, novel, research, proceeding at Lumen Scientific Publishing House

Send your manuscript right now