TransNormerLLM TransNormerLLM: A Faster and Better Large Language Model with Improved TransNormer OpenNLPLab/TransNormerLLM3-15B-Intermediate-Checkpoints Text Generation • Updated Apr 7, 2024 • 46 • 15 OpenNLPLab/TransNormerLLM2-1B-300B Text Generation • Updated Feb 26, 2024 • 3 • 3 OpenNLPLab/TransNormerLLM2-3B-300B Text Generation • Updated Feb 26, 2024 • 3 OpenNLPLab/TransNormerLLM2-7B-300B Text Generation • Updated Feb 26, 2024 • 4
OpenNLPLab/TransNormerLLM3-15B-Intermediate-Checkpoints Text Generation • Updated Apr 7, 2024 • 46 • 15
HGRN2 HGRN2: Gated Linear RNNs with State Expansion HGRN2: Gated Linear RNNs with State Expansion Paper • 2404.07904 • Published Apr 11, 2024 • 20 Scaling Laws for Linear Complexity Language Models Paper • 2406.16690 • Published Jun 24, 2024 • 23
HGRN Hierarchically Gated Recurrent Neural Network for Sequence Modeling OpenNLPLab/HGRN-150M Text Generation • Updated Nov 10, 2023 • 5 • 2 OpenNLPLab/HGRN-355M Text Generation • Updated Nov 10, 2023 • 6 • 2 OpenNLPLab/HGRN-1B Text Generation • Updated Nov 10, 2023 • 8 Hierarchically Gated Recurrent Neural Network for Sequence Modeling Paper • 2311.04823 • Published Nov 8, 2023 • 2
Hierarchically Gated Recurrent Neural Network for Sequence Modeling Paper • 2311.04823 • Published Nov 8, 2023 • 2
TransNormerLLM TransNormerLLM: A Faster and Better Large Language Model with Improved TransNormer OpenNLPLab/TransNormerLLM3-15B-Intermediate-Checkpoints Text Generation • Updated Apr 7, 2024 • 46 • 15 OpenNLPLab/TransNormerLLM2-1B-300B Text Generation • Updated Feb 26, 2024 • 3 • 3 OpenNLPLab/TransNormerLLM2-3B-300B Text Generation • Updated Feb 26, 2024 • 3 OpenNLPLab/TransNormerLLM2-7B-300B Text Generation • Updated Feb 26, 2024 • 4
OpenNLPLab/TransNormerLLM3-15B-Intermediate-Checkpoints Text Generation • Updated Apr 7, 2024 • 46 • 15
HGRN Hierarchically Gated Recurrent Neural Network for Sequence Modeling OpenNLPLab/HGRN-150M Text Generation • Updated Nov 10, 2023 • 5 • 2 OpenNLPLab/HGRN-355M Text Generation • Updated Nov 10, 2023 • 6 • 2 OpenNLPLab/HGRN-1B Text Generation • Updated Nov 10, 2023 • 8 Hierarchically Gated Recurrent Neural Network for Sequence Modeling Paper • 2311.04823 • Published Nov 8, 2023 • 2
Hierarchically Gated Recurrent Neural Network for Sequence Modeling Paper • 2311.04823 • Published Nov 8, 2023 • 2
HGRN2 HGRN2: Gated Linear RNNs with State Expansion HGRN2: Gated Linear RNNs with State Expansion Paper • 2404.07904 • Published Apr 11, 2024 • 20 Scaling Laws for Linear Complexity Language Models Paper • 2406.16690 • Published Jun 24, 2024 • 23
