<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
  <channel>
    <title>Neural Tokenizers — FoundationIndex</title>
    <link>https://foundationindex.ustunozgur.com/s/neural-tokenizers</link>
    <description>Learned neural compressors that turn images, video clips, and audio waveforms into compact sequences of discrete or continuous tokens so Transformers and diffusion models can read and generate media efficiently.</description>
    <language>en</language>
    <atom:link href="https://foundationindex.ustunozgur.com/s/neural-tokenizers/feed.xml" rel="self" type="application/rss+xml" />
    <item>
      <title>Neural Tokenizers · Paper · 2026-06-29</title>
      <link>https://foundationindex.ustunozgur.com/s/neural-tokenizers#neural-tokenizers-avtok-2026</link>
      <guid>https://foundationindex.ustunozgur.com/s/neural-tokenizers#neural-tokenizers-avtok-2026</guid>
      <pubDate>Mon, 29 Jun 2026 00:00:00 GMT</pubDate>
      <description>&lt;p&gt;Pham et al. proposed AVTok, extending 1D visual tokenization into a unified dual-stream Transformer tokenizer that compresses paired audio and video streams into a single compact 1D discrete codebook—enabling joint audio-video, audio-to-video, and video-to-audio generation without separate modality tokenizers.&lt;/p&gt;&lt;p&gt;Sources: &lt;a href=&quot;https://arxiv.org/abs/2606.30811&quot;&gt;AVTok: 1D Unified Tokenization for Holistic Audio-Video Generation&lt;/a&gt;&lt;/p&gt;</description>
    </item>
    <item>
      <title>Neural Tokenizers · Release · 2025-01-07</title>
      <link>https://foundationindex.ustunozgur.com/s/neural-tokenizers#neural-tokenizers-cosmos-2025</link>
      <guid>https://foundationindex.ustunozgur.com/s/neural-tokenizers#neural-tokenizers-cosmos-2025</guid>
      <pubDate>Tue, 07 Jan 2025 00:00:00 GMT</pubDate>
      <description>&lt;p&gt;NVIDIA released the Cosmos Tokenizer family alongside its Cosmos world foundation model platform, offering causal 3D continuous and Finite Scalar Quantization (FSQ) discrete image and video tokenizers with up to 8× temporal and 16× spatial compression.&lt;/p&gt;&lt;p&gt;Sources: &lt;a href=&quot;https://arxiv.org/abs/2501.03575&quot;&gt;Cosmos World Foundation Model Platform for Physical AI&lt;/a&gt;, &lt;a href=&quot;https://github.com/NVIDIA/Cosmos-Tokenizer&quot;&gt;NVIDIA/Cosmos-Tokenizer on GitHub&lt;/a&gt;&lt;/p&gt;</description>
    </item>
    <item>
      <title>Neural Tokenizers · Paper · 2023-10-09</title>
      <link>https://foundationindex.ustunozgur.com/s/neural-tokenizers#neural-tokenizers-magvit-v2-2023</link>
      <guid>https://foundationindex.ustunozgur.com/s/neural-tokenizers#neural-tokenizers-magvit-v2-2023</guid>
      <pubDate>Mon, 09 Oct 2023 00:00:00 GMT</pubDate>
      <description>&lt;p&gt;Yu et al. introduced MAGVIT-v2, replacing learned vector codebooks with Lookup-Free Quantization (LFQ) for joint image and video tokenization—scaling discrete visual vocabularies past 262,000 tokens without codebook collapse and outperforming Diffusion Models on ImageNet generation.&lt;/p&gt;&lt;p&gt;Sources: &lt;a href=&quot;https://arxiv.org/abs/2310.05737&quot;&gt;Language Model Beats Diffusion -- Tokenizer is Key to Visual Generation&lt;/a&gt;&lt;/p&gt;</description>
    </item>
    <item>
      <title>Neural Tokenizers · Paper · 2022-10-24</title>
      <link>https://foundationindex.ustunozgur.com/s/neural-tokenizers#neural-tokenizers-encodec-2022</link>
      <guid>https://foundationindex.ustunozgur.com/s/neural-tokenizers#neural-tokenizers-encodec-2022</guid>
      <pubDate>Mon, 24 Oct 2022 00:00:00 GMT</pubDate>
      <description>&lt;p&gt;Défossez et al. at Meta AI published EnCodec, pairing streaming convolutional encoder-decoders with Residual Vector Quantization (RVQ), multiscale spectrogram discriminators, and Transformer entropy coding—establishing the discrete acoustic codec pattern behind neural Audio &amp;amp; Speech Models and Text-to-Speech (TTS) &amp;amp; Voice Cloning.&lt;/p&gt;&lt;p&gt;Sources: &lt;a href=&quot;https://arxiv.org/abs/2210.13438&quot;&gt;High Fidelity Neural Audio Compression&lt;/a&gt;&lt;/p&gt;</description>
    </item>
    <item>
      <title>Neural Tokenizers · Paper · 2020-12-17</title>
      <link>https://foundationindex.ustunozgur.com/s/neural-tokenizers#neural-tokenizers-vqgan-2020</link>
      <guid>https://foundationindex.ustunozgur.com/s/neural-tokenizers#neural-tokenizers-vqgan-2020</guid>
      <pubDate>Thu, 17 Dec 2020 00:00:00 GMT</pubDate>
      <description>&lt;p&gt;Esser, Rombach, and Ommer introduced VQGAN, augmenting discrete autoencoders with perceptual and patch-based adversarial losses so high-resolution images compress into crisp token grids without pixel-loss blur, allowing autoregressive Transformers to synthesize megapixel images.&lt;/p&gt;&lt;p&gt;Sources: &lt;a href=&quot;https://arxiv.org/abs/2012.09841&quot;&gt;Taming Transformers for High-Resolution Image Synthesis&lt;/a&gt;&lt;/p&gt;</description>
    </item>
    <item>
      <title>Neural Tokenizers · Paper · 2017-11-02</title>
      <link>https://foundationindex.ustunozgur.com/s/neural-tokenizers#neural-tokenizers-vqvae-2017</link>
      <guid>https://foundationindex.ustunozgur.com/s/neural-tokenizers#neural-tokenizers-vqvae-2017</guid>
      <pubDate>Thu, 02 Nov 2017 00:00:00 GMT</pubDate>
      <description>&lt;p&gt;van den Oord, Vinyals, and Kavukcuoglu published Neural Discrete Representation Learning, introducing VQ-VAE to map encoder features onto a learned discrete codebook via nearest-neighbor vector quantization and straight-through gradients—preventing posterior collapse and enabling discrete image, video, and audio tokenization.&lt;/p&gt;&lt;p&gt;Sources: &lt;a href=&quot;https://arxiv.org/abs/1711.00937&quot;&gt;Neural Discrete Representation Learning&lt;/a&gt;&lt;/p&gt;</description>
    </item>
  </channel>
</rss>
