Artificial General Intelligence, Small Models Capabilities Improvements, Small Models Reasoning Improvements, Multimodal Models, Consumer-Grade GPUs, Preference alignment, Supervised fine-tuning