Abstract
Individual differences in metacognitive accuracy are generally thought to reflect differences in metacognitive ability. If so, memory monitoring performance should be consistent across different metacognitive tasks and show high test-retest reliability. Two experiments examined these possibilities, using four common metacognitive tasks: ease of learning judgments, feeling of knowing judgments, judgments of learning, and text comprehension monitoring. Alternate-forms correlations were computed for metacognitive accuracy (with a 1-week interval between tests). Although individual differences in memory and confidence were stable across both sessions and tasks, differences in metacognitive accuracy were not. These results pose considerable practical and theoretical challenges for metacognitive researchers.
Article PDF
Similar content being viewed by others
References
Angus, D. (Ed.) (1985).The best short stories of the modern age (rev. ed.). New York: Fawcett Premier.
Arbuckle, T. Y., &Cuddy, L. L. (1969). Discrimination of item strength at time of presentation.Journal of Experimental Psychology,81, 126–131.
Bain, C. E., Beaty, J., &Hunter, J. P. (1986).The Norton introduction to literature (4th ed.). New York: Norton.
Begg, I., Duft, S., Lalonde, P., Melnick, R., &Sanvito, J. (1989). Memory predictions are based on ease of processing.Journal of Memory & Language,28, 610–632.
Campbell, R. L., &Bickhard, M. H. (1986).Knowing levels and developmental stages. New York: Karger.
Costermans, J., Lories, G., &Ansay, C. (1992). Confidence level and feeling of knowing in question answering: The weight of inferential processes.Journal of Experimental Psychology: Learning, Memory, & Cognition,18, 142–150.
Cull, W. L., &Zechmeister, E. B. (1994). The learning ability paradox in adult metamemory research: Where are the metamemory differences between good and poor learners?Memory & Cognition,22, 249–257.
Dunlosky, J., &Nelson, T. O. (1992). Importance of the kind of cue for judgments for learning (JOL) and the delayed-JOL effect.Memory & Cognition,20, 374–380.
Dunlosky, J., &Nelson, T. O. (1994). Does the sensitivity of judgments of learning (JOLs) to the effects of various study activities depend on when the JOLs occur?Journal of Memory & Language,33, 545–565.
Dunlosky, J., & Schwartz, B. L. (1995, November).Does relational information affect people’s predictions of eventual free recall? Poster session presented at the annual meeting of the Psychonomic Society, Los Angeles.
Gernsbacher, M. A., Varner, K. R., &Faust, M. E. (1990). Investigating differences in general comprehension skill.Journal of Experimental Psychology: Learning, Memory, & Cognition,16, 430–445.
Glenberg, A. M., &Epstein, W. (1985). Calibration of comprehension.Journal of Experimental Psychology: Learning, Memory, & Cognition,11, 702–718.
Glenberg, A. M., &Epstein, W. (1987). Inexpert calibration of comprehension.Memory & Cognition,15, 84–93.
Glenberg, A. M., Sanocki, T., Epstein, W., &Morris, C. (1987). Enhancing calibration of comprehension.Journal of Experimental Psychology: General,116, 119–136.
Glenberg, A. M., Wilkinson, A. C., &Epstein, W. (1982). The illusion of knowing: Failure in the self-assessment of comprehension.Memory & Cognition,10, 597–602.
Glover, J. A. (1989). Improving readers’ estimates of learning from text: The role of inserted questions.Reading Research Quarterly,28, 68–75.
Hart, J. T. (1965). Memory and the feeling-of-knowing experience.Journal of Educational Psychology,56, 208–216.
Karmiloff-Smith, A. (1992).Beyond modularity: A developmental perspective on cognitive science. Cambridge, MA: MIT Press.
Kearney, E. M., &Zechmeister, E. B. (1989). Judgments of item difficulty by good and poor associative learners.American Journal of Psychology,102, 365–383.
Kelemen, W. L., &Weaver, C. A., III (1997). Enhanced metamemory at delays: Why do judgments of learning improve over time?Journal of Experimental Psychology: Learning, Memory, & Cognition,23, 1394–1409.
King, J. F., Zechmeister, E. B., &Shaughnessy, J. J. (1980). Judgments of knowing: The influence of retrieval practice.American Journal of Psychology,93, 329–343.
Kirk, R. E. (1995).Experimental design: Procedures for the behavioral sciences (3rd ed.). Pacific Grove, CA: Brooks/Cole.
Koriat, A. (1993). How do we know what we know? The accessibility account of the feeling of knowing.Psychological Review,100, 609–639.
Koriat, A. (1994). Metamemory’s knowledge of its own knowledge: The accessibility account of the feeling of knowing. In J. Metcalfe & A. P. Shimamura (Eds.),Metacognition: Knowing about knowing (pp. 185–206). Cambridge, MA: MIT Press.
Koriat, A. (1995). Dissociating knowing and the feeling of knowing: Further evidence for the accessibility model.Journal of Experimental Psychology: General,124, 311–333.
Koriat, A. (1997, November).Practice improves resolution but impairs calibration: A cue-utilization approach to judgments of learning. Paper presented at the annual meeting of the Psychonomic Society, Philadelphia.
Krinsky, R., &Nelson, T. O. (1985). The feeling of knowing for different types of retrieval failure.Acta Psychologica,58, 141–158.
Leonesio, R. J., &Nelson, T. O. (1990). Do different metamemory judgments tap the same underlying aspects of memory?Journal of Experimental Psychology: Learning, Memory, & Cognition,16, 464–470.
Lovelace, E. A. (1984). Metamemory: Monitoring future recallability during study.Journal of Experimental Psychology: Learning, Memory, & Cognition,10, 756–766.
Lundeberg, M. A., Fox, P. W., &Puncochar, J. (1994). Highly confident but wrong: Gender differences and similarities in confidence judgments.Journal of Educational Psychology,86, 114–121.
Maki, R. H. (1998). Metacomprehension of text: Influence of absolute confidence level on bias and accuracy. In D. L. Medin (Ed.),The psychology of learning and motivation (Vol. 38, pp. 223–248). San Diego: Academic Press.
Maki, R. H., &Berry, S. L. (1984). Metacomprehension of text material.Journal of Experimental Psychology: Learning, Memory, & Cognition,10, 663–679.
Maki, R. H., Foley, J. M., Kajer, W. K., Thompson, R. C., &Willert, M. G. (1990). Increased processing enhances calibration of comprehension.Journal of Experimental Psychology: Learning, Memory, & Cognition,16, 609–616.
Maki, R. H., Jonas, D., &Kallod, M. (1994). The relationship between comprehension and metacomprehension ability.Psychonomic Bulletin & Review,1, 126–129.
Maki, R. H., &Serra, M. (1992). The basis of test predictions for text material.Journal of Experimental Psychology: Learning, Memory, & Cognition,18, 116–126.
Maki, R. H., &Swett, S. (1987). Metamemory for narrative text.Memory & Cognition,15, 72–83.
Metcalfe, J., Schwartz, B. L., &Joaquim, S. G. (1993). The cue familiarity heuristic in metacognition.Journal of Experimental Psychology: Learning, Memory, & Cognition,19, 851–861.
Metcalfe, J., &Shimamura, A. P. (1994).Metacognition: Knowing about knowing. Cambridge, MA: MIT Press.
Nelson, T. O. (1984). A comparison of current measures of the accuracy of feeling-of-knowing predictions.Psychological Bulletin,95, 109–133.
Nelson, T. O. (1988). Predictive accuracy of the feeling of knowing across different criterion tasks and across different subject populations and individuals. In M. M. Gruenberg, P. E. Morris, & R. N. Sykes (Eds.),Practical aspects of memory: Current research and issues (Vol. 1, pp. 190–196). New York: Wiley.
Nelson, T. O. (1992).Metacognition: Core readings. Boston: Allyn & Bacon.
Nelson, T. O. (1996a). Consciousness and metacognition.American Psychologist,51, 102–116.
Nelson, T. O. (1996b). Gamma is a measure of the accuracy of predicting performance on one item relative to another item, not of the absolute performance of an individual item.Applied Cognitive Psychology,10, 257–260.
Nelson, T. O., &Dunlosky, J. (1991). When people’s judgments of learning (JOLs) are extremely accurate at predicting subsequent recall: The “delayed-JOL effect.”Psychological Science,2, 267–270.
Nelson, T. O., &Dunlosky, J. (1994). Norms of paired-associate recall during multitrial learning of Swahili-English translation equivalents.Memory,2, 325–335.
Nelson, T. O., Dunlosky, J., White, D. M., Steinberg, J., Townes, B. D., &Anderson, D. (1990). Cognition and metacognition at extreme altitudes on Mount Everest.Journal of Experimental Psychology: General,119, 367–374.
Nelson, T. O., Leonesio, R. J., Landwehr, R. S., &Narens, L. (1986). A comparison of three predictors of an individual’s memory performance: The individual’s feeling of knowing versus normative feeling of knowing versus base-rate item difficulty.Journal of Experimental Psychology: Learning, Memory, & Cognition,12, 279–287.
Nelson, T. O., Leonesio, R. J., Shimamura, A. P., Landwehr, R. S., &Narens, L. (1982). Overlearning and the feeling of knowing.Journal of Experimental Psychology: Learning, Memory, & Cognition,8, 279–288.
Nelson, T. O., McSpadden, M., Fromme, K., &Marlatt, G. A. (1986). Effects of alcohol intoxication on metamemory and on retrieval from long-term memory.Journal of Experimental Psychology: General,115, 247–254.
Nelson, T. O., &Narens, L. (1980). Norms of 300 general-information questions: Accuracy of recall, latency of recall, and feeling-of-knowing ratings.Journal of Verbal Learning & Verbal Behavior,19, 338–368.
Nelson, T. O., &Narens, L. (1990). Metamemory: A theoretical framework and new findings. In G. H. Bower (Ed.),The psychology of learning and motivation (Vol. 26, pp. 125–173). San Diego: Academic Press.
Paivio, A., Yuille, J. C., & Madigan, S. A. (1968). Concreteness, imagery, and meaningfulness values for 925 nouns.Journal of Experimental Psychology Monographs,76 (1, Pt. 2).
Patton, J. H., Weaver, C. A., III, Burns, K. D., Brady, M. D., & Bryant, D. S. (1991, April).Cognitive impulsivity and cognitive skills. Paper presented at the annual meeting of the Southwestern Psychological Association, New Orleans.
Pressley, M., &Ghatala, E. S. (1990). Self-regulated learning: Monitoring learning from text.Educational Psychologist,25, 19–33.
Pressley, M., Ghatala, E. S., Woloshyn, V., &Pirie, J. (1990). Sometimes adults miss the main idea and do not realize it: Confidence in responses to short-answer and multiple-choice comprehension questions.Reading Research Quarterly,25, 232–249.
Pressley, M., Levin, J. R., &Ghatala, E. S. (1984). Memory strategy monitoring in adults and children.Journal of Verbal Learning & Verbal Behavior,23, 270–288.
Pressley, M., Snyder, B. L., Levin, J. R., Murray, H. G., &Ghatala, E. S. (1987). Perceived readiness for examination performance (PREP) produced by initial reading of text and text containing adjunct questions.Reading Research Quarterly,22, 219–236.
Rabinowitz, J. C., Ackerman, B. P., Craik, F. I. M., &Hinchley, J. L. (1982). Aging and metamemory: The roles of relatedness and imagery.Journal of Gerontology,37, 688–695.
Reder, L. M. (1996).Implicit memory and metacognition. Mahwah, NJ: Erlbaum.
Reder, L. M., &Schunn, C. D. (1996). Metacognition does not imply awareness: Strategy choice is governed by implicit learning and memory. In L. M. Reder (Ed.),Implicit memory and metacognition (pp. 45–78). Mahwah, NJ: Erlbaum.
Schneider, W. (1988).Micro Experimental Laboratory (Version 1.0) [Computer software]. Pittsburgh: Psychological Software Tools.
Schraw, G., Dunkle, M. E., Bendixen, L. D., &Roedel, T. D. (1995). Does a general monitoring skill exist?Journal of Educational Psychology,87, 433–444.
Schraw, G., Potenza, M., &Nebelsick-Gullet, L. (1993). Constraints on the calibration of performance.Contemporary Educational Psychology,18, 455–463.
Schraw, G., &Roedel, T. D. (1994). Test difficulty and judgment bias.Memory & Cognition,22, 63–69.
Schwartz, B. L. (1994). Sources of information in metamemory: Judgments of learning and feelings of knowing.Psychonomic Bulletin & Review,1, 357–375.
Schwartz, B. L., &Metcalfe, J. (1994). Methodological problems and pitfalls in the study of human metacognition. In J. Metcalfe & A. P. Shimamura (Eds.),Metacognition: Knowing about knowing (pp. 93–113). Cambridge, MA: MIT Press.
Slife, B. D., &Weaver, C. A., III. (1992). Depression, cognitive skill, and metacognitive skill in problem solving.Cognition & Emotion,6, 1–22.
Spellman, B. A., &Bjork, R. A. (1992). When predictions create reality: Judgments of learning may alter what they are intended to assess.Psychological Science,3, 315–316.
Thiede, K. W., &Dunlosky, J. (1994). Delaying students’ metacognitive monitoring improves their accuracy in predicting their recognition performance.Journal of Educational Psychology,86, 290–302.
Thompson, W. B., &Mason, S. E. (1996). Instability of individual differences in the association between confidence judgments and memory performance.Memory & Cognition,24, 226–234.
Underwood, B. J. (1966). Individual and group predictions of item difficulty for free learning.Journal of Experimental Psychology,71, 673–679.
Walczyk, J. J., &Hall, V. C. (1989). Is the failure to monitor comprehension an instance of cognitive impulsivity?Journal of Educational Psychology,81, 294–298.
Weaver, C. A., III (1990). Constraining factors in calibration of comprehension.Journal of Experimental Psychology: Learning, Memory, & Cognition,16, 214–222.
Weaver, C. A., III, &Bryant, D. S. (1995). Monitoring of comprehension: The role of text difficulty in metamemory for narrative and expository text.Memory & Cognition,23, 12–22.
Weaver, C. A., III,Bryant, D. S., &Burns, K. D. (1995). Comprehension monitoring: Extensions of the Kintsch and van Dijk model. In C. A. Weaver, III, S. Mannes, & C. R. Fletcher (Eds.),Discourse comprehension: Essays in honor of Walter Kintsch (pp. 177–193). Hillsdale, NJ: Erlbaum.
Weaver, C. A., III, &Kelemen, W. L. (1997). Judgments of learning at delays: Shifts in response patterns or increased metamemory accuracy?Psychological Science,8, 318–321.
Wellman, H. M. (1978). Knowledge of the interaction of memory variables: A developmental study of metamemory.Developmental Psychology,14, 24–29.
Wright, D. B. (1996). Measuring feeling of knowing.Applied Cognitive Psychology,10, 261–268.
Yates, J. F. (1990).Judgment and decision making. Englewood Cliffs, NJ: Prentice-Hall.
Yussen, S. R., &Levy, V. M. (1975). Developmental changes in predicting one’s own span of short-term memory.Journal of Experimental Child Psychology,19, 502–508.
Author information
Authors and Affiliations
Corresponding author
Additional information
This work was supported by a Baylor University Research Council award to C.A.W. Portions of these data were presented in November 1997 at the annual meeting of the Psychonomic Society, Philadelphia. The authors thank Asher Koriat, Ruth Maki, Tom Nelson, and Roddy Roediger for insightful comments on an earlier version of this manuscript.
—Accepted by guest action editor, Henry L. Roediger, III
Electronic supplementary material
Rights and permissions
About this article
Cite this article
Kelemen, W.L., Frost, P.J. & Weaver, C.A. Individual differences in metacognition: Evidence against a general metacognitive ability. Memory & Cognition 28, 92–107 (2000). https://doi.org/10.3758/BF03211579
Received:
Accepted:
Issue date:
DOI: https://doi.org/10.3758/BF03211579


