TechNow: Open source Grok-1, PrivateGPT, Apple Multimodal Models
In this article, we’ve got Grok-1, the colossal 314-billion parameter open-source LLM from xAI, shattering records and empowering researchers. For
Read More
Code
involve a code
Deep dive: Knowledge distillation
In this deep dive seri, we are going over Knowledge distillation (KD), Partial Function Application, Learning rate Scheduler for LLM
Read More
QLoRA: efficiently LLM Fine-Tuning
Parameter-efficient training (PEFT) techniques offer a way to fine-tune large language models (LLMs) on custom datasets with minimal computational resources.
Read More
DWM: Diffusion World Model
What’s New Meta’s Diffusion World Model (DWM) introduces a groundbreaking approach to predict multistep future states and rewards concurrently, outperforming
Read More
Build a Large Language Model (From Scratch)
“Build a Large Language Model (From Scratch)” by Sebastian Raschka blew up on Github this week and collected over 5000
Read More
Direct Preference Optimization instead of RLHF
Can you still do cutting-edge research on LLM if you do not have massive compute resources? RLHF became a key
Read More
LLM course in notebook
The “Large Language Model Course” blew up on Github this week and collected over 9000 stars. It’s a course on
Read More
Checkpointing for Memory Efficiency
In PyTorch, torch.utils.checkpoint reduces GPU memory use by segmenting large models during training. It stores only one segment at a time in
Read More
Sequential Modeling in Large Vision Models
The authors introduce a visual language model (LVM) without making use of any linguistic data trained on 1.64 billion unlabeled
Read More
8 Microsoft free Github Courses
In this article, we are going to explore 8 different Microsoft Github hosted courses for machine learning and AI. You
Read More