SSRN 2025 2025

Metacls a Closer Look at [Cls] Token for Few-Shot Transformer

A few-shot transformer paper examining how CLS tokens absorb domain information and why reinitializing or adapting them can improve transfer.

Bibliography

Authors: X Liu, B Zhang, J Chen, B Shan, Z Han, Y Ye

Venue: Available at SSRN 5201363

Year: 2025

Scholar snapshot: 1 citation

Links

Keywords

few-shot learningtransformerscls token

Newer

AsyncDSB: Schedule-Asynchronous Diffusion Schrödinger Bridge for Image Inpainting