ENTITY
The Pile
The Pile
PulseAugur coverage of The Pile — every cluster mentioning The Pile across labs, papers, and developer communities, ranked by signal.
Total · 30d
3
3 over 90d
Releases · 30d
0
0 over 90d
Papers · 30d
2
2 over 90d
TIER MIX · 90D
RECENT · PAGE 1/1 · 2 TOTAL
-
New VPD method decomposes language model parameters, improving interpretability
Researchers have introduced adVersarial Parameter Decomposition (VPD), an improved method for interpreting language model parameters. This new technique builds upon previous work like Stochastic Parameter Decomposition …
-
RWKV project revives RNNs to challenge Transformer dominance in LLMs
The RWKV (Receptance Weighted Key Value) project introduces a novel architecture that revives Recurrent Neural Networks (RNNs) while incorporating advantages typically found in Transformers. This approach aims to overco…