back
user profile
gfysfm
1,076karma·133submissions·May 27, 2017
recent activity (133 total)
comment
Hi, I wrote the post! Also not a ML researcher, just an interested engineer, so I'm sure I got some things wrong. > MoE should be the better tradeoff for the local/single-user scenario si…
comment
Hi, I wrote the post. Thank you! That’s how it does work, but unfortunately denoising the last paragraph requires computing attention scores for every token in that paragraph, which requires checking …