The Reliability of Self-Reported GPA in Educational Research: A Comparison of Self-Reported and Officially Recorded Data
DOI:
https://doi.org/10.18662/rrem/15.4/786Keywords:
education achievement, GPA, self-reported data, reliability, suppression effectAbstract
Researchers use often self-reported grades as indicators of students’ educational achievement because of difficulties in obtaining the official records. However, the results of such studies are questionable due to doubts regarding the reliability of self-reported grade data and factors that may lead to distortion. In this study, we help to resolve this issue by comparing self-reported grade point averages (GPAs) of 926 eighth grade Romanian students from the previous academic year with their official GPAs. At the descriptive and practical levels, we conclude that the distortions are positive—overreporting is more frequent than underreporting—and that their limited magnitude allows for the use of self-reported grades for the usually description i.e. of achievements in a population of students but not for individual students’ diagnostics. At the explanatory level, the distortions are non-random, and there are two main causal mechanisms. First, overreporting is a cognitive and commitment-based error. Second, overreporting is an effect of social desirability, according to which students are expected to perform well based on their social characteristics. However, this second causal channel is not visible in bivariate tests because it is statistically suppressed by the main mechanism and the correlation of actual GPA with gender and socioeconomic status (SES – parents’ education and class) variables.
References
ACT. (2013). Accuracy of Student-Reported High School GPA (ACT Information Brief 2013-12). Iowa City, IA: ACT.
Akinwande, M., O., Dikko, H. G., & Samson, A. (2015). Variance inflation factor: As a condition for the inclusion of suppressor variable(s) in regression analysis. Open Journal of Statistics, 5, 754-767. https://doi.org/10.4236/ojs.2015.57075
Beyer, J. M. (1999). Taming and promoting charisma to change organizations. The Leadership Quarterly, 10(2), 307-330.
Bourdieu, P., & Passeron, J. C. (1970). La reproduction. Paris: Minuit.
Caskie, G. I., Sutton, M. C., & Eckhardt, A. G. (2014). Accuracy of self-reported college GPA: Gender-moderated differences by achievement level and academic self-efficacy. Journal of College Student Development, 55(4), 385-390.
Cassady, J. C. (2001). Self-reported GPA and SAT: A methodological note. Practical Assessment, Research, and Evaluation, 7(12). https://doi.org/10.7275/5hym-y754
Christian, D. D., Stuckey, A. G., Boykin, A. A., & Adams, J. J. (2020). Predicting college enrollment of graduating high school seniors: How accurate is self-report? Professional School Counseling, 23(1_part_3). https://doi.org/10.1177/2156759X20903512
Cole, J. S., & Gonyea, R. M. (2010). Accuracy of self-reported SAT and ACT test scores: Implications for research. Research in Higher Education, 51(4), 305-319.
Coleman, J. S. (1966). Equality of educational opportunity (summary report). U.S. Dept. of Health, Education, & Welfare. Washington: Office of Education.
Conger, A. J. (1974). A revised definition for suppressor variables: A guide to their identification and interpretation. Educational and Psychological Measurement, 34, 35-46. https://doi.org/10.1177/001316447403400105
Crockett, L. J., Schulenberg, J. E., & Petersen, A. C. (1987). Congruence between objective and self-report data in a sample of young adolescents. Journal of Adolescent Research, 2(4), 383–392. https://doi.org/10.1177/074355488724006
Darlington, R. B. (1968). Multiple regression in psychological research and practice. Psychological Bulletin, 69, 161-182. https://doi.org/10.1037/h0025471
Dickhäuser, O., & Plenter, I. (2005). "Letztes Halbjahr stand ich zwei": Zur Akkuratheit selbst berichteter Noten [On the accuracy of self-reported school marks]. Zeitschrift für Pädagogische Psychologie / German Journal of Educational Psychology, 19(4), 219–224. https://doi.org/10.1024/1010-0652.19.4.219
Dobbins, G. H., Farh, J. L., & Werbel, J. D. (1993). The Influence of Self-Monitoring on Inflation of Grade-Point Averages for Research and Selection Purposes 1. Journal of Applied Social Psychology, 23(4), 321-334.
Feng, X. & Rost, D. H. (2015). Self reported academic records: Further evidence for their (partial) usability. Psychologie in Erziehung und Unterricht, 62, 253-264. https://doi.org/10.2378/peu2015.art19d
Frucot, V. G., & Cook, G. L. (1994). Further research on the accuracy of students' self-reported grade point averages, SAT scores, and course grades. Perceptual and Motor Skills, 79(2), 743–746. https://doi.org/10.2466/pms.1994.79.2.743
Hackman, D. A., Farah, M. J., & Meaney, M. J. (2010). Socioeconomic status and the brain: Mechanistic insights from human and animal research. Nature Reviews Neuroscience, 11(9), 651–659. https://doi.org/10.1038/nrn2897
Hair, N. L., Hanson, J. L., Wolfe, B. L., and Pollak, S. D. (2015). Association of child poverty, brain development, and academic achievement. JAMA Pediatrics, 169, 822–829. https://doi.org/10.1001/jamapediatrics.2015.1475
Hatos, A. (2008). Impactul segregării şi diferenţierii asupra performanţelor şcolare ale elevilor din clasele 10-12. O analiză multinivel. Calitatea Vieții, XIX(1–2), 141–158.
Kuncel, N. R., Credé, M., & Thomas, L. L. (2005). The validity of self-reported grade point averages, class ranks, and test scores: A meta-analysis and review of the literature. Review of Educational Research, 75(1), 63-82.
Li, Z., Qiu, Z. (2018). How does family background affect children’s educational achievement? Evidence from Contemporary China. The Journal of Chinese Sociology, 5(13). https://doi.org/10.1186/s40711-018-0083-8
Lucas, S. R. (2001). Effectively maintained inequality: Education transitions, track mobility, and social background effects. American Journal of Sociology, 106(6), 1642-1690.
Maxey, E. J., & Ormsby, V. J. (1971). The accuracy of self-report information collected on the ACT Test Battery: High school grades and items of nonacademic achievement. ERIC no. ED054738
Mayer, R. E., Stull, A. T., Campbell, J., Almeroth, K., Bimber, B., Chun, D, Allan, K. (2007). Overestimation bias in self-reported SAT scores. Educational Psychology Review, 19(4), 443-454.
Möller, J., Streblow, L., Pohlmann, B., & Köller, O. (2006). An extension to the internal/external frame of reference model to two verbal and numerical domains. European Journal of Psychology of Education, 21(4), 467–487.
Noble, K. G., Houston, S. M., Brito, N. H., Bartsch, H., Kan, E., Kuperman, J. M., et al. (2015). Family income, parental education and brain structure in children and adolescents. Nat. Neurosci., 18, 773–778. https://doi.org/10.1038/nn.3983
Noble, K. G., Mccandliss, B. D., and Farah, M. J. (2007). Socioeconomic gradients predict individual differences in neurocognitive abilities. Develop. Sci., 10, 464–480. https://doi.org/10.1111/j.1467-7687.2007.00600.x
Noftle, E. E., & Robins, R. W. (2007). Personality predictors of academic outcomes: big five correlates of GPA and SAT scores. Journal of personality and social psychology, 93(1), 116.
Pandey, S., & Elliott, W. (2010). Suppressor variables in social work research: Ways to identify in multiple regression rodels. Journal of the Society for Social Work and Research, 1(1), 28-40. https://doi.org/ 10.5243/jsswr.2010.2
Raftery, A. E., & Hout, M. (1993). Maximally maintained inequality: Expansion, reform, and opportunity in Irish education, 1921–1975. Sociology of Education, 66(1), 41–62.
Rivers, S. E., Brackett, M. A., Reyes, M. R., Mayer, J. D., Caruso, D. R., & Salovey, P. (2012). Measuring emotional intelligence in early adolescence with the MSCEIT-YV: Psychometric properties and relationship with academic performance and psychosocial functioning. Journal of Psychoeducational Assessment, 30(4), 344-366.
Rivkin, S. G., Hanushek, E. A., & Kain, J. F. (2005). Teachers, schools, and academic achievement. Econometrica, 73(2), 417-458.
Schwartz, J. A., & Beaver, K. M. (2015). Making (up) the grade? Estimating the genetic and environmental influences of discrepancies between self-reported grades and official GPA scores. Journal of Youth Adolescence, 44, 1125-1138. https://doi.org/10.1007/s10964-014-0185-9
Shaw, E. J., & Mattern, K. D. (2009). Examining the Accuracy of Self-Reported High School Grade Point Average. Research Report No. 2009-5.
Shepperd, J. A. (1993). Productivity loss in performance groups: A motivation analysis. Psychological bulletin, 113(1), 67.
Sparfeldt, Jörn & Buch, Susanne & Rost, Detlef & Lehmann, Grit. (2008). Akkuratesse selbstberichteter Zensuren [Accuracy of self-reported grades in school]. Psychologie in Erziehung und Unterricht (PEU), 55, 68-75.
Sticca, F., Goetz, T., Bieg, M., Hall, N. C., Eberle, F., & Haag, L. (2017). Examining the accuracy of students’ self-reported academic grades from a correlational and a discrepancy perspective: Evidence from a longitudinal study. PloS One, 12(11).
Talento-Miller E, Peyton J. (2006). Moderators of the accuracy of self-report grade point average. McLean, VA: Graduate Management Admission Council Research Reports, Report No.: 06–10.
Thomson, S. (2018) Achievement at school and socioeconomic background—An educational perspective. NPJ Science of Learning, 3(5). https://doi.org/10.1038/s41539-018-0022-0
Trice, A. D. (1990). Reliability of students' self-reports of scholastic aptitude scores: Data from juniors and seniors. Perceptual and Motor Skills.
Ursache, A., and Noble, K. G. (2016). Socioeconomic status, white matter, and executive function in children. Brain Behaviour, 6, e00531.
Watkins, D., & Cheung, S. (1995). Culture, gender, and response bias: An analysis of responses to the Self-Description Questionnaire. Journal of Cross-Cultural Psychology, 26(5), 490-504.
Yongmin Sun, & Yuanzhang Li. (2009). Postdivorce family stability and changes in adolescents’ academic performance: A Growth-Curve Model. Journal of Family Issues, 30(11), 1527-1555. https://doi.org/10.1177/0192513X09339022
Zimmerman, M. A., Caldwell, C. H., & Bernat, D. H. (2002). Discrepancy between self-report and school‐record grade point average: Correlates with psychosocial outcomes among African American adolescents. Journal of Applied Social Psychology, 32(1), 86-109.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 The Authors & LUMEN Publishing House
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant this journalright of first publication, with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work, with an acknowledgement of the work's authorship and initial publication in this journal.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g. post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g. in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as an earlier and greater citation of published work (See The Effect of Open Access).
Revista Romaneasca pentru Educatie Multidimensionala Journal has an Attribution-NonCommercial-NoDerivs
CC BY-NC-ND
