books/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2026-04-10 12:33:42 +00:00
Code Issues Packages Projects Releases Wiki Activity

Memory efficient weight loading (#401)

Browse Source 
* memory efficient weight loading

* remove unused code
This commit is contained in:
Sebastian Raschka
2024-10-14 10:30:25 -05:00
committed by GitHub
parent 59a5c83726
commit 3d54af20f5
5 changed files with 1043 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

5
ch05/08_memory_efficient_weight_loading/README.md Normal file
View File

@@ -0,0 +1,5 @@
# Memory-efficient Model Weight Loading
This folder contains code to illustrate how to load model weights more efficiently
- [memory-efficient-state-dict.ipynb](memory-efficient-state-dict.ipynb): contains code to load model weights via PyTorch's `load_state_dict` method more efficiently