GLADIA

Universal representations, model merging, audio & more!

Model Merging — a biased overview

A friendly tour of model merging, suspiciously aligned with my own research.

27 min read · August 17, 2025

2025 · model merging machine learning research
Attention sinks from the graph perspective

Why causal transformers naturally concentrate attention on their earliest tokens.

12 min read · August 17, 2025

2025 · transformers attention graph neural networks