CogSci 2025

•

August 01, 2025

•

San Francisco, United States

keywords:

psychology

artificial intelligence

natural language processing

Large language models (LLMs) excel at personality prediction but are often impractical for deployment due to high computational demands. This work introduces cognitive distillation with Chain-of-Thought calibration, a novel framework for transferring structured reasoning from large LLMs to smaller, efficient models. Inspired by cognitive architectures like ACT-R, our method aligns intermediate inference steps using exemplars from single or multiple LLMs. A 1.5B-parameter model distilled through this process surpasses Qwen1.5-110B in predictive accuracy, achieving a 28% improvement in Pearson correlation while using just 1.36% of its parameters. Ablation studies reveal that moderate sampling diversity and multi-model ensembles enhance cognitive skill transfer and construct validity. These findings demonstrate that high-level reasoning can be efficiently and faithfully transferred, enabling psychometrically robust personality assessment in resource-constrained settings. This approach bridges AI and cognitive science, offering a scalable path toward plausible, cognitively grounded language models.

Downloads

PaperTranscript English (automatic)

Next from CogSci 2025

Quantifying Risk Propensities of Large Language Models: Ethical Focus and Bias Detection through Role-Play
poster

Quantifying Risk Propensities of Large Language Models: Ethical Focus and Bias Detection through Role-Play

CogSci 2025

Yifan Zeng and 2 other authors

01 August 2025

Similar lecture

Personality Vector: Modulating Personality of Large Language Models by Model Merging
poster

Personality Vector: Modulating Personality of Large Language Models by Model Merging

EMNLP 2025

Jang Hyun Kim
Seungjong Sun
Seo Yeon Baek
Jang Hyun Kim and 2 other authors

07 November 2025