Multimodal Landscape

LLaVA's simplicity (3 components: vision encoder + projection layer + LLM) spawned an entire VLM family. Native multimodal (Gemini) captures cross-modal interactions but costs vastly more to train. Open-source has closed the gap — Qwen-VL series dominates benchmarks while remaining self-hostable.