Sophie Wang

@SophieLWang

Studying intelligent representations @MIT_CSAIL

sophielwang.com

Joined November 2023

163 Following

3,261 Followers

Replies Reposts Media

Pinned
Sophie Wang
@SophieLWang
Oct 6
Can “chicken” make a base model reason? 🐔 Yes! Why? With the right first tokens, base models can match RL in reasoning. We trace this to learned training data associations and use a simple data edit to make “chicken” elicit reasoning too. blog: sophielwang.com/cues
49
Sophie Wang
@SophieLWang
Oct 19
From the archives 🦫
1
Sophie Wang
@SophieLWang
Oct 12
I wrote a blog post detailing the writing approach I took while working on my recent paper: sophielwang.com/blog/paper-wri… I describe the behind the scenes for how this paper came to be, why and how I storyboarded figures before running experiments, and some figure design tips! :)
Sophie Wang
@SophieLWang
Oct 6
00:10
Can “chicken” make a base model reason? 🐔 Yes! Why? With the right first tokens, base models can match RL in reasoning. We trace this to learned training data associations and use a simple data edit to make “chicken” elicit reasoning too. blog: sophielwang.com/cues
34
Sophie Wang
@SophieLWang
Oct 9
Super interesting work showing that representations can be aligned across modalities using an orthogonal transformation!
Dominik Schnaus
@dominik_schnaus
Oct 9
DINOv2 has never seen a caption, and Qwen3 has never seen an image. We still aligned their embedding spaces without a single image-caption pair. It even works when the images and the captions come from different datasets. Project page: dominik-schnaus.github.io/unpaired-roset… ⬇️
1
Sophie Wang
@SophieLWang
Oct 7
In our blog post, you can interactively explore the reasoning effect of token cues and RL on base models! 📎 paper: arxiv.org/abs/2610.06851 ✍ blog: sophielwang.com/cues 💻 code: github.com/sophicle/cues
Sophie Wang
@SophieLWang
Oct 6
00:10
Can “chicken” make a base model reason? 🐔 Yes! Why? With the right first tokens, base models can match RL in reasoning. We trace this to learned training data associations and use a simple data edit to make “chicken” elicit reasoning too. blog: sophielwang.com/cues
12

Sophie Wang

Sophie Wang’s posts