Microsoft and CMU researchers have begun to unravel three mysteries in deep learning related to ensemble, knowledge distillation, and self-distillation. Discover how their work has led to the first theoretical proof with empirical evidence for ensemble in deep learning: https://aka.ms/AAavuq3 | Microsoft Research
0:28
Microsoft and CMU researchers have begun to unravel three mysteries in deep learning related to ensemble, knowledge distillation, and self-distillation. Discover how their work has led to the first theoretical proof with empirical evidence for ensemble in deep learning: https://aka.ms/AAavuq3 | Microsoft Research
14K viewsJan 19, 2021
FacebookMicrosoft Research
Deep Learning in Self-Driving Cars
Deep Learning in Self-Driving Cars
Feb 12, 2021
thinkautonomous.ai
What is Knowledge distillation? | IBM
What is Knowledge distillation? | IBM
Apr 16, 2024
ibm.com
Mastering Self-Supervised Learning: From Distillation to DINO
8:45
Mastering Self-Supervised Learning: From Distillation to DINO
1 views2 months ago
YouTubeAI Researcher
Why Self-Distillation Is Taking Over LLM Post-Training (w/ the Researchers Behind It)
1:31:20
Why Self-Distillation Is Taking Over LLM Post-Training (w/ the Researchers Behind It)
5.3K views3 weeks ago
YouTubeDeep Learning with Yacine
Self-Distilled RLVR: Stable LLM Training Method
4:37
Self-Distilled RLVR: Stable LLM Training Method
62 views1 month ago
YouTubeAI Research Roundup
Self-Distillation Enables Continual Learning
11:52
Self-Distillation Enables Continual Learning
60 views3 months ago
YouTubeEmergent Behaviors
4:35
SSD: Simple Self-Distillation for LLM Coding
310 views1 month ago
YouTubeAI Research Roundup
6:48
Knowledge Distillation - The Alchemy of AI
1 views2 months ago
YouTubeLorem Ipsum III
1:25:20
Reinforcement Learning via Self-Distillation
1 views2 months ago
YouTubeWest Coast Machine Learning
7:00
Reinforcement Learning via Self-Distillation: SDPO for Rich Feedback in LLM Reinforcement Learning
13 views3 months ago
YouTubeCosmoX
47:03
Apple's SSD | Simple Self Distillation Research Paper| 2nd april
6 views1 month ago
YouTubePlugIn
0:35
Model Distillation Explained: How Big AI Models Get Shrunk for Your Phone
724 views3 weeks ago
YouTubeArivu
2:48
Apple Just Made AI Training Embarrassingly Simple
32 views1 month ago
YouTubeAIM Network
4:21
Why Self-Distillation Hurts LLM Reasoning
68 views1 month ago
YouTubeAI Research Roundup
29:57
[知识蒸馏][08] 练习两周半，从零实现SDPO（Reinforcement Learning via Self-Distillation)
7.7K views1 month ago
bilibili偷星九月333
20:36
[知识蒸馏][07] 练习两天半，从零实现SDFT(Self-Distillation Enables Continual Learning)
9.9K views2 months ago
bilibili偷星九月333
Artificial Intelligence | AI on Instagram: "Knowledge distillation is a deep learning technique where a compact “student” model learns to replicate the performance of a larger, more complex “teacher” model. Introduced in the paper “Distilling the Knowledge in a Neural Network” by Hinton, Vinyals, and Dean (2015), the process goes beyond simply training the student on labeled data, which they refer to as “hard labels”. Instead, the teacher provides “soft labels,” which are its full output probabi
9.2K views7 months ago
Instagramgetintoai
5:15
Simple Distillation
423.1K viewsNov 14, 2016
YouTubeScott Milam
11:25
Distillation I | MIT Digital Lab Techniques Manual
186.9K viewsFeb 4, 2010
YouTubeMIT OpenCourseWare
5:30
Knowledge Distillation | Machine Learning
8.9K viewsJul 28, 2021
YouTubeTwinEd Productions
1:21
Carrying out a distillation
44.7K viewsMay 13, 2016
YouTubeRoyal Society of Chemistry
8:12
An Introduction to Simple Distillation
213.3K viewsJul 20, 2012
YouTubeChemSurvival
19:05
Distilling the Knowledge in a Neural Network
23.8K viewsJun 28, 2020
YouTubeKapil Sachdeva
24:00
Knowledge Distillation Explained with Keras Example | #MLConcepts
4.6K viewsJun 22, 2021
YouTubeAI WITH Rithesh
3:01
Distillation: Process and Application | Method of Separation | Class 9
465K viewsMay 31, 2011
YouTubeStudy'n'Learn
2:44
Live on 28th Aug: Knowledge Distillation in Deep Learning
2.6K viewsAug 27, 2022
YouTubeApplied AI Course
23:12
Knowledge Distillation
11.9K viewsJul 18, 2019
YouTubeNLP Breakfast
9:35
Simple Distillation
342.2K viewsNov 11, 2022
YouTubeProfessor Dave Explains
4:19
AI model distillation
18.3K viewsFeb 19, 2025
YouTubeInterSystems Developers
See more
Static thumbnail place holder