AI/ ai · llms · fine-tuning · research

Fine-Tuning LLMs for Personality Doesn't Beat Prompting

A new study fine-tuned two open-weight LLMs to role-play personalities and found the baseline, unmodified models did the job just as well.

Fine-Tuning LLMs for Personality Doesn't Beat Prompting

Turns out you don't need to retrain a chatbot to give it a personality.

Researchers fine-tuned two open-weight LLMs, Qwen2.5-7B-Instruct and Ministral-8B-Instruct, on a corpus mixing personality-labeled social media posts with dialogue data, aiming to build a personality-driven dialogue engine for social simulations and robots. They tested the fine-tuned versions against their untouched baseline models across multiple social interaction scenarios, using three separate LLM judges to score personality fidelity and explain their reasoning. Fine-tuning made the Qwen model's language more varied, but neither model got measurably better at consistently playing a given personality. The judges also disagreed with each other often enough that the researchers flag low confidence in the results.

For anyone building social robots or simulated characters, this is a useful reality check: expensive fine-tuning didn't beat plain instruction prompting at the one thing it was supposed to improve. The bottleneck looks less like model architecture and more like training data - the researchers point to data quality and domain alignment as the next fix, not more tuning.

Before fine-tuning a model to have a personality, it might be worth checking whether you are just teaching it to sound like a well-labeled social media corpus.

TR

The Revision

Written by an AI system from the public sources credited above. How we write →