Yann LeCun | Ravid Shwartz-Zivhttps://www.ravid-shwartz-ziv.com/author/yann-lecun/Yann LeCunSource Themes Academic (https://sourcethemes.com/academic/)en-usSat, 01 Aug 2026 00:00:00 +0000https://www.ravid-shwartz-ziv.com/img/ravid-shwartz-ziv-social-v2.pngYann LeCunhttps://www.ravid-shwartz-ziv.com/author/yann-lecun/HP-JEPA: Hierarchical Partitioning for Multi-Resolution Graph Joint-Embedding Predictive Learninghttps://www.ravid-shwartz-ziv.com/publication/hp-jepa/Sat, 01 Aug 2026 00:00:00 +0000https://www.ravid-shwartz-ziv.com/publication/hp-jepa/S-JEPA: Soft Clustering Anchors for Self-Supervised Speech Representation Learninghttps://www.ravid-shwartz-ziv.com/publication/s-jepa/Wed, 17 Jun 2026 00:00:00 +0000https://www.ravid-shwartz-ziv.com/publication/s-jepa/<p>Related work: the earlier <a href="https://www.ravid-shwartz-ziv.com/publication/gmm-anchored-jepa/">GMM-Anchored JEPA study</a> uses fixed soft acoustic clusters to support speech representation learning.</p>On Training in Imaginationhttps://www.ravid-shwartz-ziv.com/publication/training-in-imagination/Thu, 07 May 2026 12:51:32 +0000https://www.ravid-shwartz-ziv.com/publication/training-in-imagination/AI Must Embrace Specialization via Superhuman Adaptable Intelligencehttps://www.ravid-shwartz-ziv.com/publication/superhuman-adaptable-intelligence/Fri, 27 Feb 2026 03:26:21 +0000https://www.ravid-shwartz-ziv.com/publication/superhuman-adaptable-intelligence/Soft Clustering Anchors for Self-Supervised Speech Representation Learning in Joint Embedding Prediction Architectureshttps://www.ravid-shwartz-ziv.com/publication/gmm-anchored-jepa/Fri, 30 Jan 2026 20:51:37 +0000https://www.ravid-shwartz-ziv.com/publication/gmm-anchored-jepa/<p>Related work: <a href="https://www.ravid-shwartz-ziv.com/publication/s-jepa/">S-JEPA</a> is the later speech study with a continuous two-phase training procedure and online clustering targets.</p>JEPA as a Neural Tokenizer: Learning Robust Speech Representations with Density Adaptive Attentionhttps://www.ravid-shwartz-ziv.com/publication/jepa-neural-tokenizer/Mon, 08 Dec 2025 00:00:00 +0000https://www.ravid-shwartz-ziv.com/publication/jepa-neural-tokenizer/Attention Sinks and Compression Valleys in LLMs are Two Sides of the Same Coinhttps://www.ravid-shwartz-ziv.com/publication/attention-sinks-compression-valleys/Tue, 07 Oct 2025 21:27:24 +0000https://www.ravid-shwartz-ziv.com/publication/attention-sinks-compression-valleys/Layer by Layer: Uncovering Hidden Representations in Language Modelshttps://www.ravid-shwartz-ziv.com/publication/layer-by-layer/Sun, 13 Jul 2025 00:00:00 +0000https://www.ravid-shwartz-ziv.com/publication/layer-by-layer/From Tokens to Thoughts: How LLMs and Humans Trade Compression for Meaninghttps://www.ravid-shwartz-ziv.com/publication/tokens-to-thoughts/Wed, 21 May 2025 16:29:00 +0000https://www.ravid-shwartz-ziv.com/publication/tokens-to-thoughts/Rate-In: Information-Driven Adaptive Dropout Rates for Improved Inference-Time Uncertainty Estimationhttps://www.ravid-shwartz-ziv.com/publication/rate-in/Tue, 10 Dec 2024 04:03:46 +0000https://www.ravid-shwartz-ziv.com/publication/rate-in/Seq-VCR: Preventing Collapse in Intermediate Transformer Representations for Enhanced Reasoninghttps://www.ravid-shwartz-ziv.com/publication/seqvcr/Mon, 04 Nov 2024 00:00:00 +0000https://www.ravid-shwartz-ziv.com/publication/seqvcr/LiveBench: A Challenging, Contamination-Limited LLM Benchmarkhttps://www.ravid-shwartz-ziv.com/publication/livebanch/Thu, 27 Jun 2024 00:00:00 +0000https://www.ravid-shwartz-ziv.com/publication/livebanch/To Compress or Not to Compress--Self-Supervised Learning and Information Theory: A Reviewhttps://www.ravid-shwartz-ziv.com/publication/compress/Wed, 19 Apr 2023 00:00:00 +0000https://www.ravid-shwartz-ziv.com/publication/compress/What Do We Maximize in Self-Supervised Learning?https://www.ravid-shwartz-ziv.com/publication/ssl/Mon, 01 Aug 2022 00:00:00 +0000https://www.ravid-shwartz-ziv.com/publication/ssl/Pre-Train Your Loss: Easy Bayesian Transfer Learning with Informative Priorshttps://www.ravid-shwartz-ziv.com/publication/learned_prior/Sun, 01 May 2022 00:00:00 +0000https://www.ravid-shwartz-ziv.com/publication/learned_prior/