<?xml version="1.0" encoding="UTF-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
  <channel>
    <title>Recurrent Neural Networks — FoundationIndex</title>
    <link>https://foundationindex.ustunozgur.com/s/recurrent-neural-networks</link>
    <description>Sequence models that read text or time-series data one token at a time, passing an internal memory vector forward from each step to the next like a running summary.</description>
    <language>en</language>
    <atom:link href="https://foundationindex.ustunozgur.com/s/recurrent-neural-networks/feed.xml" rel="self" type="application/rss+xml" />
    <item>
      <title>Recurrent Neural Networks · Milestone · 2017-06-12</title>
      <link>https://foundationindex.ustunozgur.com/s/recurrent-neural-networks#rnn-transformer-transition-2017</link>
      <guid>https://foundationindex.ustunozgur.com/s/recurrent-neural-networks#rnn-transformer-transition-2017</guid>
      <pubDate>Mon, 12 Jun 2017 00:00:00 GMT</pubDate>
      <description>&lt;p&gt;Vaswani et al.&amp;apos;s Transformer (Attention Is All You Need) replaced step-by-step recurrent loops with parallelizable self-attention, eliminating the sequential training bottleneck that limited RNN and LSTM scaling.&lt;/p&gt;&lt;p&gt;Sources: &lt;a href=&quot;https://arxiv.org/abs/1706.03762&quot;&gt;Attention Is All You Need&lt;/a&gt;&lt;/p&gt;</description>
    </item>
    <item>
      <title>Recurrent Neural Networks · Paper · 2014-09-10</title>
      <link>https://foundationindex.ustunozgur.com/s/recurrent-neural-networks#rnn-seq2seq-2014</link>
      <guid>https://foundationindex.ustunozgur.com/s/recurrent-neural-networks#rnn-seq2seq-2014</guid>
      <pubDate>Wed, 10 Sep 2014 00:00:00 GMT</pubDate>
      <description>&lt;p&gt;Ilya Sutskever, Oriol Vinyals, and Quoc Le introduced Sequence-to-Sequence (Seq2Seq) learning with multi-layer LSTMs, showing that an encoder-decoder neural network could map variable-length input sentences directly to variable-length translations.&lt;/p&gt;&lt;p&gt;Sources: &lt;a href=&quot;https://arxiv.org/abs/1409.3215&quot;&gt;Sequence to Sequence Learning with Neural Networks&lt;/a&gt;&lt;/p&gt;</description>
    </item>
    <item>
      <title>Recurrent Neural Networks · Paper · 1997-11-15</title>
      <link>https://foundationindex.ustunozgur.com/s/recurrent-neural-networks#rnn-lstm-1997</link>
      <guid>https://foundationindex.ustunozgur.com/s/recurrent-neural-networks#rnn-lstm-1997</guid>
      <pubDate>Sat, 15 Nov 1997 00:00:00 GMT</pubDate>
      <description>&lt;p&gt;Sepp Hochreiter and Jürgen Schmidhuber published Long Short-Term Memory (LSTM), adding input, forget, and output gates around a constant error carousel so recurrent networks could retain information across hundreds of steps without vanishing gradients.&lt;/p&gt;&lt;p&gt;Sources: &lt;a href=&quot;https://doi.org/10.1162/neco.1997.9.8.1735&quot;&gt;Long Short-Term Memory&lt;/a&gt;&lt;/p&gt;</description>
    </item>
  </channel>
</rss>
