AI & ML
Subliminal Learning in Vision-Language Models
arXiv eess.IV0 views
arXiv:2611.08538v1 Announce Type: cross Abstract: Subliminal learning is a phenomenon in large language models (LLMs) where a teacher passes a hidden preference to a student through training data unrelated to that preference. We study whether subliminal learning also occurs in vision-language models (VLMs). We finetune a teacher VLM to prefer a specific animal or facial attribute and use a control teacher from the same base model. Both teachers generate numbers for an unrelated visual task involving geometric shapes. Two students initialized from the same base VLM are finetuned on the same images, using numbers generated by either the biased or control teacher. Across VLMs ranging from 2B to 7B parameters, we find that both animal and facial preferences can transfer through this unrelated task. Students trained on biased-teacher outputs select the target more often than control students, with a difference of up to $\sim$10 percentage points in the animal preference task. Transfer can become stronger with more training data and varies with the target preference, model, and how the numbers are generated. Beyond preferences, we show that the biased student's explanations use more of the same words and phrases as the biased teacher's explanations than those of the control student, even when all three models select the same image. These results matter for training VLMs and show that training on unrelated data may change both a VLM's image preferences and how it explains its choices, and that transfer can become stronger with more training samples.
Source:https://arxiv.org/abs/2611.08538PreviousSuper-resolved digital terrain models for GEDI geolocation correction: agreement with airborne LiDAR DTM-based corrections at the beam level, not the footprint levelNexteSharp: Diffusion-based Sharp Monocular Metric Event-to-Depth Estimation
Related posts
![AMR Mechanical and Electrical Engineering — Ch.08: Contents {#contents .TOC-Heading} [KR]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fbtw3oxs45o0rlsdwb57q.png)
AMR Mechanical and Electrical Engineering — Ch.08: Contents {#contents .TOC-Heading} [KR]
0dev.to
![AMR Mechanical and Electrical Engineering — Ch.10: Chapter 10. Battery and BMS [KR]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2F1oq75ffn9xkv43oaf8j7.png)
AMR Mechanical and Electrical Engineering — Ch.10: Chapter 10. Battery and BMS [KR]
0dev.to
![AMR Mechanical and Electrical Engineering — Ch.11: Contents {#contents .TOC-Heading} [KR]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fonn99mga9ifg36liirww.png)
AMR Mechanical and Electrical Engineering — Ch.11: Contents {#contents .TOC-Heading} [KR]
0dev.to
![AMR Mechanical and Electrical Engineering — Ch.13: Contents {#contents .TOC-Heading} [KR]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2F6h1hrp24iuq1ixb1m2xd.png)
AMR Mechanical and Electrical Engineering — Ch.13: Contents {#contents .TOC-Heading} [KR]
0dev.to
![AMR Mechanical and Electrical Engineering — Ch.15: Chapter 15. EMI / EMC Design [KR]](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto%2Cformat=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2Fibat7i5er6079kccmeqf.png)
AMR Mechanical and Electrical Engineering — Ch.15: Chapter 15. EMI / EMC Design [KR]
0dev.to
Hypergraph Generation via Structured Stochastic Diffusion
0arXiv stat.CO