CatLIP: CLIP-level Visual Recognition Accuracy with 2.7x Faster Pre-training on Web-scale Image-Text Data
Paper
•
2404.15653
•
Published
•
29
Infrastructure
-
-
MoDE: CLIP Data Experts via Clustering
Paper • 2404.16030 • Published • 15 -
MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuning
Paper • 2405.12130 • Published • 50 -
Reducing Transformer Key-Value Cache Size with Cross-Layer Attention
Paper • 2405.12981 • Published • 33 -
LiteVAE: Lightweight and Efficient Variational Autoencoders for Latent Diffusion Models
Paper • 2405.14477 • Published • 19 -
Thermodynamic Natural Gradient Descent
Paper • 2405.13817 • Published • 16 -
Tele-Aloha: A Low-budget and High-authenticity Telepresence System Using Sparse RGB Cameras
Paper • 2405.14866 • Published • 9 -
Transformers Can Do Arithmetic with the Right Embeddings
Paper • 2405.17399 • Published • 54 -
2BP: 2-Stage Backpropagation
Paper • 2405.18047 • Published • 26 -
VeLoRA: Memory Efficient Training using Rank-1 Sub-Token Projections
Paper • 2405.17991 • Published • 14 -
Jina CLIP: Your CLIP Model Is Also Your Text Retriever
Paper • 2405.20204 • Published • 37 -
Artificial Generational Intelligence: Cultural Accumulation in Reinforcement Learning
Paper • 2406.00392 • Published • 14 -
Block Transformer: Global-to-Local Language Modeling for Fast Inference
Paper • 2406.02657 • Published • 41 -
PLaD: Preference-based Large Language Model Distillation with Pseudo-Preference Pairs
Paper • 2406.02886 • Published • 10 -
Scaling Laws for Reward Model Overoptimization in Direct Alignment Algorithms
Paper • 2406.02900 • Published • 13 -
GenAI Arena: An Open Evaluation Platform for Generative Models
Paper • 2406.04485 • Published • 22 -
WildBench: Benchmarking LLMs with Challenging Tasks from Real Users in the Wild
Paper • 2406.04770 • Published • 28 -
Why Has Predicting Downstream Capabilities of Frontier AI Models with Scale Remained Elusive?
Paper • 2406.04391 • Published • 8 -
Boosting Large-scale Parallel Training Efficiency with C4: A Communication-Driven Approach
Paper • 2406.04594 • Published • 6 -
The Prompt Report: A Systematic Survey of Prompting Techniques
Paper • 2406.06608 • Published • 68 -
DiTFastAttn: Attention Compression for Diffusion Transformer Models
Paper • 2406.08552 • Published • 25 -
Interpreting the Weight Space of Customized Diffusion Models
Paper • 2406.09413 • Published • 20 -
Cognitively Inspired Energy-Based World Models
Paper • 2406.08862 • Published • 10 -
MLKV: Multi-Layer Key-Value Heads for Memory Efficient Transformer Decoding
Paper • 2406.09297 • Published • 6 -
A Simple and Effective L_2 Norm-Based Strategy for KV Cache Compression
Paper • 2406.11430 • Published • 25 -
MMBench-Video: A Long-Form Multi-Shot Benchmark for Holistic Video Understanding
Paper • 2406.14515 • Published • 33 -
Model Merging and Safety Alignment: One Bad Model Spoils the Bunch
Paper • 2406.14563 • Published • 30 -
Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judges
Paper • 2406.12624 • Published • 37 -
Efficient World Models with Context-Aware Tokenization
Paper • 2406.19320 • Published • 8 -
We-Math: Does Your Large Multimodal Model Achieve Human-like Mathematical Reasoning?
Paper • 2407.01284 • Published • 81 -
MMEvalPro: Calibrating Multimodal Benchmarks Towards Trustworthy and Efficient Evaluation
Paper • 2407.00468 • Published • 35 -
μ-Bench: A Vision-Language Benchmark for Microscopy Understanding
Paper • 2407.01791 • Published • 6 -
No Training, No Problem: Rethinking Classifier-Free Guidance for Diffusion Models
Paper • 2407.02687 • Published • 24 -
Learning to (Learn at Test Time): RNNs with Expressive Hidden States
Paper • 2407.04620 • Published • 34 -
HEMM: Holistic Evaluation of Multimodal Foundation Models
Paper • 2407.03418 • Published • 12 -
MJ-Bench: Is Your Multimodal Reward Model Really a Good Judge for Text-to-Image Generation?
Paper • 2407.04842 • Published • 55 -
ANOLE: An Open, Autoregressive, Native Large Multimodal Models for Interleaved Image-Text Generation
Paper • 2407.06135 • Published • 22 -
An accurate detection is not all you need to combat label noise in web-noisy datasets
Paper • 2407.05528 • Published • 4 -
CosmoCLIP: Generalizing Large Vision-Language Models for Astronomical Imaging
Paper • 2407.07315 • Published • 7 -
SHERL: Synthesizing High Accuracy and Efficient Memory for Resource-Limited Transfer Learning
Paper • 2407.07523 • Published • 6 -
NeedleBench: Can LLMs Do Retrieval and Reasoning in 1 Million Context Window?
Paper • 2407.11963 • Published • 44 -
Efficient Training with Denoised Neural Weights
Paper • 2407.11966 • Published • 9 -
From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients
Paper • 2407.11239 • Published • 8 -
EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
Paper • 2407.11062 • Published • 10 -
NNsight and NDIF: Democratizing Access to Foundation Model Internals
Paper • 2407.14561 • Published • 35 -
LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understanding
Paper • 2407.15754 • Published • 20 -
KAN or MLP: A Fairer Comparison
Paper • 2407.16674 • Published • 43 -
SIGMA: Sinkhorn-Guided Masked Video Modeling
Paper • 2407.15447 • Published • 8 -
PERSONA: A Reproducible Testbed for Pluralistic Alignment
Paper • 2407.17387 • Published • 20 -
Longhorn: State Space Models are Amortized Online Learners
Paper • 2407.14207 • Published • 18 -
VSSD: Vision Mamba with Non-Casual State Space Duality
Paper • 2407.18559 • Published • 20 -
Diffusion Feedback Helps CLIP See Better
Paper • 2407.20171 • Published • 36 -
Finch: Prompt-guided Key-Value Cache Compression
Paper • 2408.00167 • Published • 17 -
POA: Pre-training Once for Models of All Sizes
Paper • 2408.01031 • Published • 27 -
The Impact of Hyperparameters on Large Language Model Inference Performance: An Evaluation of vLLM and HuggingFace Pipelines
Paper • 2408.01050 • Published • 9 -
UniBench: Visual Reasoning Requires Rethinking Vision-Language Beyond Scaling
Paper • 2408.04810 • Published • 24 -
VisualAgentBench: Towards Large Multimodal Models as Visual Foundation Agents
Paper • 2408.06327 • Published • 17 -
Heavy Labels Out! Dataset Distillation with Label Space Lightening
Paper • 2408.08201 • Published • 21 -
Towards flexible perception with visual memory
Paper • 2408.08172 • Published • 23 -
MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?
Paper • 2408.13257 • Published • 26 -
K-Sort Arena: Efficient and Reliable Benchmarking for Generative Models via K-wise Human Preferences
Paper • 2408.14468 • Published • 37 -
Dolphin: Long Context as a New Modality for Energy-Efficient On-Device Language Models
Paper • 2408.15518 • Published • 42 -
SaRA: High-Efficient Diffusion Model Fine-tuning with Progressive Sparse Low-Rank Adaptation
Paper • 2409.06633 • Published • 15 -
RetrievalAttention: Accelerating Long-Context LLM Inference via Vector Retrieval
Paper • 2409.10516 • Published • 43 -
InfiMM-WebMath-40B: Advancing Multimodal Pre-Training for Enhanced Mathematical Reasoning
Paper • 2409.12568 • Published • 50 -
Oryx MLLM: On-Demand Spatial-Temporal Understanding at Arbitrary Resolution
Paper • 2409.12961 • Published • 25 -
Prithvi WxC: Foundation Model for Weather and Climate
Paper • 2409.13598 • Published • 45 -
Making Text Embedders Few-Shot Learners
Paper • 2409.15700 • Published • 29 -
Time-MoE: Billion-Scale Time Series Foundation Models with Mixture of Experts
Paper • 2409.16040 • Published • 16 -
VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models
Paper • 2409.17066 • Published • 28 -
Differential Transformer
Paper • 2410.05258 • Published • 180 -
Addition is All You Need for Energy-efficient Language Models
Paper • 2410.00907 • Published • 151 -
Selective Attention Improves Transformer
Paper • 2410.02703 • Published • 25 -
A Comprehensive Survey of Mamba Architectures for Medical Image Analysis: Classification, Segmentation, Restoration and Beyond
Paper • 2410.02362 • Published • 18 -
AuroraCap: Efficient, Performant Video Detailed Captioning and a New Benchmark
Paper • 2410.03051 • Published • 6 -
MLP-KAN: Unifying Deep Representation and Function Learning
Paper • 2410.03027 • Published • 31 -
Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generation
Paper • 2410.05363 • Published • 45 -
Unveiling the Backbone-Optimizer Coupling Bias in Visual Representation Learning
Paper • 2410.06373 • Published • 36 -
One Initialization to Rule them All: Fine-tuning via Explained Variance Adaptation
Paper • 2410.07170 • Published • 16 -
SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Acceleration
Paper • 2410.02367 • Published • 50 -
Contrastive Localized Language-Image Pre-Training
Paper • 2410.02746 • Published • 37 -
CLIP-MoE: Towards Building Mixture of Experts for CLIP with Diversified Multiplet Upcycling
Paper • 2409.19291 • Published • 21 -
PrefixQuant: Static Quantization Beats Dynamic through Prefixed Outliers in LLMs
Paper • 2410.05265 • Published • 33 -
LOKI: A Comprehensive Synthetic Data Detection Benchmark using Large Multimodal Models
Paper • 2410.09732 • Published • 54 -
Your Mixture-of-Experts LLM Is Secretly an Embedding Model For Free
Paper • 2410.10814 • Published • 51 -
MixEval-X: Any-to-Any Evaluations from Real-World Data Mixtures
Paper • 2410.13754 • Published • 75 -
Harnessing Webpage UIs for Text-Rich Visual Understanding
Paper • 2410.13824 • Published • 30 -
FlatQuant: Flatness Matters for LLM Quantization
Paper • 2410.09426 • Published • 15 -
LoLDU: Low-Rank Adaptation via Lower-Diag-Upper Decomposition for Parameter-Efficient Fine-Tuning
Paper • 2410.13618 • Published • 6 -
SeerAttention: Learning Intrinsic Sparse Attention in Your LLMs
Paper • 2410.13276 • Published • 29 -
AutoTrain: No-code training for state-of-the-art models
Paper • 2410.15735 • Published • 59 -
PyramidDrop: Accelerating Your Large Vision-Language Models via Pyramid Visual Redundancy Reduction
Paper • 2410.17247 • Published • 47 -
Breaking the Memory Barrier: Near Infinite Batch Size Scaling for Contrastive Loss
Paper • 2410.17243 • Published • 92 -
MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmark
Paper • 2410.19168 • Published • 24 -
COAT: Compressing Optimizer states and Activation for Memory-Efficient FP8 Training
Paper • 2410.19313 • Published • 19 -
LARP: Tokenizing Videos with a Learned Autoregressive Generative Prior
Paper • 2410.21264 • Published • 9 -
Dialog2Flow: Pre-training Soft-Contrastive Action-Driven Sentence Embeddings for Automatic Dialog Flow Extraction
Paper • 2410.18481 • Published • 5 -
Relaxed Recursive Transformers: Effective Parameter Sharing with Layer-wise LoRA
Paper • 2410.20672 • Published • 6 -
CLEAR: Character Unlearning in Textual and Visual Modalities
Paper • 2410.18057 • Published • 209 -
ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference
Paper • 2410.21465 • Published • 11 -
Accelerating Direct Preference Optimization with Prefix Sharing
Paper • 2410.20305 • Published • 6 -
ReferEverything: Towards Segmenting Everything We Can Speak of in Videos
Paper • 2410.23287 • Published • 19 -
A Pointer Network-based Approach for Joint Extraction and Detection of Multi-Label Multi-Class Intents
Paper • 2410.22476 • Published • 27 -
NeuZip: Memory-Efficient Training and Inference with Dynamic Compression of Neural Networks
Paper • 2410.20650 • Published • 17 -
M2rc-Eval: Massively Multilingual Repository-level Code Completion Evaluation
Paper • 2410.21157 • Published • 6 -
"Give Me BF16 or Give Me Death"? Accuracy-Performance Trade-Offs in LLM Quantization
Paper • 2411.02355 • Published • 51 -
How Far is Video Generation from World Model: A Physical Law Perspective
Paper • 2411.02385 • Published • 34 -
Sparsing Law: Towards Large Language Models with Greater Activation Sparsity
Paper • 2411.02335 • Published • 11 -
Controlling Language and Diffusion Models by Transporting Activations
Paper • 2410.23054 • Published • 18 -
LLM2CLIP: Powerful Language Model Unlock Richer Visual Representation
Paper • 2411.04997 • Published • 39 -
Can sparse autoencoders be used to decompose and interpret steering vectors?
Paper • 2411.08790 • Published • 8 -
Cut Your Losses in Large-Vocabulary Language Models
Paper • 2411.09009 • Published • 49 -
Search, Verify and Feedback: Towards Next Generation Post-training Paradigm of Foundation Models via Verifier Engineering
Paper • 2411.11504 • Published • 24 -
SmoothCache: A Universal Inference Acceleration Technique for Diffusion Transformers
Paper • 2411.10510 • Published • 9 -
SageAttention2 Technical Report: Accurate 4 Bit Attention for Plug-and-play Inference Acceleration
Paper • 2411.10958 • Published • 57 -
When Precision Meets Position: BFloat16 Breaks Down RoPE in Long-Context Training
Paper • 2411.13476 • Published • 16 -
Multimodal Autoregressive Pre-training of Large Vision Encoders
Paper • 2411.14402 • Published • 47 -
Marco-o1: Towards Open Reasoning Models for Open-Ended Solutions
Paper • 2411.14405 • Published • 61 -
Natural Language Reinforcement Learning
Paper • 2411.14251 • Published • 31 -
Ultra-Sparse Memory Network
Paper • 2411.12364 • Published • 23 -
Factorized Visual Tokenization and Generation
Paper • 2411.16681 • Published • 19 -
Cautious Optimizers: Improving Training with One Line of Code
Paper • 2411.16085 • Published • 19 -
Star Attention: Efficient LLM Inference over Long Sequences
Paper • 2411.17116 • Published • 53 -
Training Noise Token Pruning
Paper • 2411.18092 • Published • 1 -
GATE OpenING: A Comprehensive Benchmark for Judging Open-ended Interleaved Image-Text Generation
Paper • 2411.18499 • Published • 18 -
The Well: a Large-Scale Collection of Diverse Physics Simulations for Machine Learning
Paper • 2412.00568 • Published • 24 -
WF-VAE: Enhancing Video VAE by Wavelet-Driven Energy Flow for Latent Video Diffusion Model
Paper • 2411.17459 • Published • 12 -
KV Shifting Attention Enhances Language Modeling
Paper • 2411.19574 • Published • 8 -
APOLLO: SGD-like Memory, AdamW-level Performance
Paper • 2412.05270 • Published • 37 -
OmniDocBench: Benchmarking Diverse PDF Document Parsing with Comprehensive Annotations
Paper • 2412.07626 • Published • 28 -
ACDiT: Interpolating Autoregressive Conditional Modeling and Diffusion Transformer
Paper • 2412.07720 • Published • 31 -
KaSA: Knowledge-Aware Singular-Value Adaptation of Large Language Models
Paper • 2412.06071 • Published • 9 -
Efficient Generative Modeling with Residual Vector Quantization-Based Tokens
Paper • 2412.10208 • Published • 19 -
Byte Latent Transformer: Patches Scale Better Than Tokens
Paper • 2412.09871 • Published • 108 -
No More Adam: Learning Rate Scaling at Initialization is All You Need
Paper • 2412.11768 • Published • 43 -
Distilled Decoding 1: One-step Sampling of Image Auto-regressive Models with Flow Matching
Paper • 2412.17153 • Published • 39 -
Fourier Position Embedding: Enhancing Attention's Periodic Extension for Length Generalization
Paper • 2412.17739 • Published • 41 -
Tensor Product Attention Is All You Need
Paper • 2501.06425 • Published • 90 -
Parameter-Inverted Image Pyramid Networks for Visual Perception and Multimodal Understanding
Paper • 2501.07783 • Published • 8 -
SEAL: Entangled White-box Watermarks on Low-Rank Adaptation
Paper • 2501.09284 • Published • 10 -
ARWKV: Pretrain is not what we need, an RNN-Attention-Based Language Model Born from Transformer
Paper • 2501.15570 • Published • 25 -
Optimizing Large Language Model Training Using FP4 Quantization
Paper • 2501.17116 • Published • 36 -
DeepFlow: Serverless Large Language Model Serving at Scale
Paper • 2501.14417 • Published • 3 -
Scalable-Softmax Is Superior for Attention
Paper • 2501.19399 • Published • 24 -
The Surprising Agreement Between Convex Optimization Theory and Learning-Rate Scheduling for Large Model Training
Paper • 2501.18965 • Published • 7 -
RandLoRA: Full-rank parameter-efficient fine-tuning of large models
Paper • 2502.00987 • Published • 9 -
QLIP: Text-Aligned Visual Tokenization Unifies Auto-Regressive Multimodal Understanding and Generation
Paper • 2502.05178 • Published • 10 -
LM2: Large Memory Models
Paper • 2502.06049 • Published • 31 -
The Curse of Depth in Large Language Models
Paper • 2502.05795 • Published • 40 -
Native Sparse Attention: Hardware-Aligned and Natively Trainable Sparse Attention
Paper • 2502.11089 • Published • 167 -
You Do Not Fully Utilize Transformer's Representation Capacity
Paper • 2502.09245 • Published • 37 -
SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Features
Paper • 2502.14786 • Published • 157 -
MoBA: Mixture of Block Attention for Long-Context LLMs
Paper • 2502.13189 • Published • 17 -
Make LoRA Great Again: Boosting LoRA with Adaptive Singular Values and Mixture-of-Experts Optimization Alignment
Paper • 2502.16894 • Published • 32 -
Stable-SPAM: How to Train in 4-Bit More Stably than 16-Bit Adam
Paper • 2502.17055 • Published • 20 -
SpargeAttn: Accurate Sparse Attention Accelerating Any Model Inference
Paper • 2502.18137 • Published • 59 -
Scale-Distribution Decoupling: Enabling Stable and Effective Training of Large Language Models
Paper • 2502.15499 • Published • 15 -
NeoBERT: A Next-Generation BERT
Paper • 2502.19587 • Published • 38 -
Q-Filters: Leveraging QK Geometry for Efficient KV Cache Compression
Paper • 2503.02812 • Published • 10 -
Union of Experts: Adapting Hierarchical Routing to Equivalently Decomposed Transformer
Paper • 2503.02495 • Published • 9 -
EuroBERT: Scaling Multilingual Encoders for European Languages
Paper • 2503.05500 • Published • 81 -
ProReflow: Progressive Reflow with Decomposed Velocity
Paper • 2503.04824 • Published • 9 -
DiffCLIP: Differential Attention Meets CLIP
Paper • 2503.06626 • Published • 5 -
Gemini Embedding: Generalizable Embeddings from Gemini
Paper • 2503.07891 • Published • 45 -
RWKV-7 "Goose" with Expressive Dynamic State Evolution
Paper • 2503.14456 • Published • 153 -
TULIP: Towards Unified Language-Image Pretraining
Paper • 2503.15485 • Published • 49 -
LLM-FE: Automated Feature Engineering for Tabular Data with LLMs as Evolutionary Optimizers
Paper • 2503.14434 • Published • 7 -
CODA: Repurposing Continuous VAEs for Discrete Tokenization
Paper • 2503.17760 • Published • 4 -
Multi-Token Attention
Paper • 2504.00927 • Published • 56 -
MergeVQ: A Unified Framework for Visual Generation and Representation with Disentangled Token Merging and Quantization
Paper • 2504.00999 • Published • 95 -
ZClip: Adaptive Spike Mitigation for LLM Pre-Training
Paper • 2504.02507 • Published • 88 -
MIEB: Massive Image Embedding Benchmark
Paper • 2504.10471 • Published • 21 -
Efficient Generative Model Training via Embedded Representation Warmup
Paper • 2504.10188 • Published • 12 -
Efficient Hybrid Language Model Compression through Group-Aware SSM Pruning
Paper • 2504.11409 • Published • 9 -
CCMNet: Leveraging Calibrated Color Correction Matrices for Cross-Camera Color Constancy
Paper • 2504.07959 • Published • 10 -
It's All Connected: A Journey Through Test-Time Memorization, Attentional Bias, Retention, and Online Optimization
Paper • 2504.13173 • Published • 19 -
LoftUp: Learning a Coordinate-Based Feature Upsampler for Vision Foundation Models
Paper • 2504.14032 • Published • 7 -
Describe Anything: Detailed Localized Image and Video Captioning
Paper • 2504.16072 • Published • 63 -
I-Con: A Unifying Framework for Representation Learning
Paper • 2504.16929 • Published • 30 -
Breaking the Modality Barrier: Universal Embedding Learning with Multimodal LLMs
Paper • 2504.17432 • Published • 40 -
Softpick: No Attention Sink, No Massive Activations with Rectified Softmax
Paper • 2504.20966 • Published • 31 -
OpenVision: A Fully-Open, Cost-Effective Family of Advanced Vision Encoders for Multimodal Learning
Paper • 2505.04601 • Published • 29 -
FG-CLIP: Fine-Grained Visual and Textual Alignment
Paper • 2505.05071 • Published • 18 -
UMoE: Unifying Attention and FFN with Shared Experts
Paper • 2505.07260 • Published • 9 -
Continuous Visual Autoregressive Generation via Score Maximization
Paper • 2505.07812 • Published • 12 -
BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Dataset
Paper • 2505.09568 • Published • 99 -
DeCLIP: Decoupled Learning for Open-Vocabulary Dense Perception
Paper • 2505.04410 • Published • 44 -
Parallel Scaling Law for Language Models
Paper • 2505.10475 • Published • 82 -
Latent Flow Transformer
Paper • 2505.14513 • Published • 29 -
dKV-Cache: The Cache for Diffusion Language Models
Paper • 2505.15781 • Published • 16 -
ModernGBERT: German-only 1B Encoder Model Trained from Scratch
Paper • 2505.13136 • Published • 22 -
Memory-Efficient Visual Autoregressive Modeling with Scale-Aware KV Cache Compression
Paper • 2505.19602 • Published • 13 -
Differentiable Solver Search for Fast Diffusion Sampling
Paper • 2505.21114 • Published • 13 -
FuseLIP: Multimodal Embeddings via Early Fusion of Discrete Tokens
Paper • 2506.03096 • Published • 4 -
Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Models
Paper • 2506.05176 • Published • 78 -
Aligning Latent Spaces with Flow Priors
Paper • 2506.05240 • Published • 27 -
Leveraging Self-Attention for Input-Dependent Soft Prompting in LLMs
Paper • 2506.05629 • Published • 37 -
DiffusionBlocks: Blockwise Training for Generative Models via Score-Based Diffusion
Paper • 2506.14202 • Published • 2 -
V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planning
Paper • 2506.09985 • Published • 30 -
VLM2Vec-V2: Advancing Multimodal Embedding for Videos, Images, and Visual Documents
Paper • 2507.04590 • Published • 17 -
SingLoRA: Low Rank Adaptation Using a Single Matrix
Paper • 2507.05566 • Published • 115 -
RiemannLoRA: A Unified Riemannian Framework for Ambiguity-Free LoRA Optimization
Paper • 2507.12142 • Published • 37 -
Franca: Nested Matryoshka Clustering for Scalable Visual Representation Learning
Paper • 2507.14137 • Published • 35 -
When Tokens Talk Too Much: A Survey of Multimodal Long-Context Token Compression across Images, Videos, and Audios
Paper • 2507.20198 • Published • 28 -
Region-based Cluster Discrimination for Visual Representation Learning
Paper • 2507.20025 • Published • 19 -
CUDA-L1: Improving CUDA Optimization via Contrastive Reinforcement Learning
Paper • 2507.14111 • Published • 24 -
MetaCLIP 2: A Worldwide Scaling Recipe
Paper • 2507.22062 • Published • 37 -
Trainable Dynamic Mask Sparse Attention
Paper • 2508.02124 • Published • 19 -
DINOv3
Paper • 2508.10104 • Published • 295 -
Causal Attention with Lookahead Keys
Paper • 2509.07301 • Published • 21 -
Statistical Methods in Generative AI
Paper • 2509.07054 • Published • 11 -
AToken: A Unified Tokenizer for Vision
Paper • 2509.14476 • Published • 36 -
CAR-Flow: Condition-Aware Reparameterization Aligns Source and Target for Better Flow Matching
Paper • 2509.19300 • Published • 7 -
Muon Outperforms Adam in Tail-End Associative Memory Learning
Paper • 2509.26030 • Published • 20 -
NorMuon: Making Muon more efficient and scalable
Paper • 2510.05491 • Published • 9 -
Visual Autoregressive Models Beat Diffusion Models on Inference Time Scaling
Paper • 2510.16751 • Published • 21 -
Kimi Linear: An Expressive, Efficient Attention Architecture
Paper • 2510.26692 • Published • 122 -
Adversarial Flow Models
Paper • 2511.22475 • Published • 23 -
Distribution Matching Variational AutoEncoder
Paper • 2512.07778 • Published • 29 -
VQRAE: Representation Quantization Autoencoders for Multimodal Understanding, Generation and Reconstruction
Paper • 2511.23386 • Published • 16 -
Towards Scalable Pre-training of Visual Tokenizers for Generation
Paper • 2512.13687 • Published • 105 -
Next-Embedding Prediction Makes Strong Vision Learners
Paper • 2512.16922 • Published • 86 -
Bolmo: Byteifying the Next Generation of Language Models
Paper • 2512.15586 • Published • 17 -
mHC: Manifold-Constrained Hyper-Connections
Paper • 2512.24880 • Published • 297 -
Dynamic Large Concept Models: Latent Reasoning in an Adaptive Semantic Space
Paper • 2512.24617 • Published • 64 -
Scaling Text-to-Image Diffusion Transformers with Representation Autoencoders
Paper • 2601.16208 • Published • 51 -
OpenVision 3: A Family of Unified Visual Encoder for Both Understanding and Generation
Paper • 2601.15369 • Published • 20