Top papers: Deleting 40% Without Accuracy Drop, Turbo Sketch, AnimateDiff
Recent research by Meta, Cisco, and MIT shows that pruning 40-50% of Large Language Model layers can maintain accuracy, offering faster, cost-effective AI. Novel techniques like Img2Img Turbo Sketch and AnimateDiff-Lightning demonstrate efficient image creation and rapid video generation from text. These developments suggest smaller AI models can be equally effective, heralding a potential shift in resource utilization and training methods.
Read More