Researchers have built the first large-scale dataset designed to test whether AI can actually understand historical Chinese calligraphy — and the short answer is: not well enough.
The HCSU dataset contains 39,307 character images drawn from 49 calligraphers across 10 dynasties. A key design choice separates ink manuscripts from stone rubbings — two source types that prior datasets lumped together, muddying any attempt at style analysis. Instead of flat category labels, each image comes with hierarchical, expert-written aesthetic descriptions. The benchmark runs two evaluation tracks: discriminating between calligraphers' styles and producing interpretable reasoning about brushwork. Researchers tested several state-of-the-art large vision-language models against both.
The results matter because cultural heritage digitization is moving fast, and AI tools are increasingly being pitched as a way to catalog, attribute, and preserve historical artifacts at scale. HCSU exposes a specific gap: current multimodal models pick up on surface cues — script type, text content, source format — rather than the underlying brushwork qualities that actually define a calligrapher's style. That's the difference between a model recognizing a dynasty and one that could help attribute an unsigned manuscript.
The gap mirrors what researchers keep finding across specialist visual domains — medicine, materials science, art history — where general-purpose vision models plateau well below expert-human performance once the task demands fine-grained perceptual reasoning rather than broad classification. The dataset is publicly available on Hugging Face, which at least makes it easy for the next team to try.