@@ -66,13 +66,13 @@ Word_Level:
6666Char_Level :
6767 Hutter_Prize :
6868 - << : *Krause2017d
69- Bit per Character (BPC) : 1.08
69+ Bits per Character (BPC) : 1.08
7070 Number of params (M) : 46
7171 - &Merity2018
7272 model : 3 layer AWD-LSTM
7373 authors : Merity et al.
7474 year : 2018
75- Bit per Character (BPC) : 1.232
75+ Bits per Character (BPC) : 1.232
7676 Number of params (M) : 47
7777 paper : An Analysis of Neural Language Modeling at Multiple Scales
7878 url : https://arxiv.org/abs/1803.08240
@@ -81,7 +81,7 @@ Char_Level:
8181 model : Large FS-LSTM-4
8282 authors : Mujika et al.
8383 year : 2017
84- Bit per Character (BPC) : 1.245
84+ Bits per Character (BPC) : 1.245
8585 Number of params (M) : 47
8686 paper : Fast-Slow Recurrent Neural Networks
8787 url : https://arxiv.org/abs/1705.08639
@@ -90,40 +90,40 @@ Char_Level:
9090 model : Large mLSTM +emb +WN +VD
9191 authors : Krause et al.
9292 year : 2016
93- Bit per Character (BPC) : 1.24
93+ Bits per Character (BPC) : 1.24
9494 Number of params (M) : 46
9595 paper : Multiplicative LSTM for sequence modelling
9696 url : https://arxiv.org/abs/1609.07959
9797 code : []
9898 - << : *Mujika2017
9999 model : FS-LSTM-4
100- Bit per Character (BPC) : 1.277
100+ Bits per Character (BPC) : 1.277
101101 Number of params (M) : 27
102102 - &Zilly2016
103103 model : Large RHN
104104 authors : Zilly et al.
105105 year : 2016
106- Bit per Character (BPC) : 1.27
106+ Bits per Character (BPC) : 1.27
107107 Number of params (M) : 46
108108 paper : Recurrent Highway Networks
109109 url : https://arxiv.org/abs/1607.03474
110110 code : []
111111
112112 Text8 :
113113 - << : *Krause2017d
114- Bit per Character (BPC) : 1.19
114+ Bits per Character (BPC) : 1.19
115115 Number of params (M) : 45
116116 - << : *Krause2016
117- Bit per Character (BPC) : 1.27
117+ Bits per Character (BPC) : 1.27
118118 Number of params (M) : 45
119119 - << : *Zilly2016
120- Bit per Character (BPC) : 1.27
120+ Bits per Character (BPC) : 1.27
121121 Number of params (M) : 46
122122 -
123123 model : LayerNorm HM-LSTM
124124 authors : Chung et al.
125125 year : 2017
126- Bit per Character (BPC) : 1.29
126+ Bits per Character (BPC) : 1.29
127127 Number of params (M) : 35
128128 paper : Hierarchical Multiscale Recurrent Neural Networks
129129 url : https://arxiv.org/abs/1609.01704
@@ -132,37 +132,37 @@ Char_Level:
132132 model : BN LSTM
133133 authors : Cooijmans et al.
134134 year : 2016
135- Bit per Character (BPC) : 1.36
135+ Bits per Character (BPC) : 1.36
136136 Number of params (M) : 16
137137 paper : Recurrent Batch Normalization
138138 url : https://arxiv.org/abs/1603.09025
139139 code : []
140140 - << : *Krause2016
141141 model : Unregularised mLSTM
142- Bit per Character (BPC) : 1.4
142+ Bits per Character (BPC) : 1.4
143143 Number of params (M) : 45
144144
145145 Penn_Treebank :
146146 - << : *Merity2018
147- Bit per Character (BPC) : 1.175
147+ Bits per Character (BPC) : 1.175
148148 Number of params (M) : 13.8
149149 - << : *Merity2018
150150 model : 6 layer QRNN
151- Bit per Character (BPC) : 1.187
151+ Bits per Character (BPC) : 1.187
152152 Number of params (M) : 13.8
153153 - << : *Mujika2017
154154 model : FS-LSTM-4
155- Bit per Character (BPC) : 1.19
155+ Bits per Character (BPC) : 1.19
156156 Number of params (M) : 27.0
157157 - << : *Mujika2017
158158 model : FS-LSTM-2
159- Bit per Character (BPC) : 1.193
159+ Bits per Character (BPC) : 1.193
160160 Number of params (M) : 27.0
161161 -
162162 model : NASCell
163163 authors : Zoph & Le
164164 year : 2016
165- Bit per Character (BPC) : 1.214
165+ Bits per Character (BPC) : 1.214
166166 Number of params (M) : 16.3
167167 paper : Neural Architecture Search with Reinforcement Learning
168168 url : https://arxiv.org/abs/1611.01578
@@ -171,7 +171,7 @@ Char_Level:
171171 model : 2-Layer Norm HyperLSTM
172172 authors : Ha et al.
173173 year : 2016
174- Bit per Character (BPC) : 1.219
174+ Bits per Character (BPC) : 1.219
175175 Number of params (M) : 14.4
176176 paper : HyperNetworks
177177 url : https://arxiv.org/abs/1609.09106
0 commit comments