Top FREE model⦠one format made it WAY FASTER
Can a 4-bit LLM quantization outperform 8-bit, and how the world's best model behaves quantized to NVFP4.
Kimi is here: https://www.kimi.com/?utm_campaign=TR_j9o2iUOy&utm_content=&utm_medium=Youtube&utm_source=CH_kEMBez3l
π My favorite external drive (dependable): https://amzn.to/3Os9Wi3
π Thunderbolt 4 dock: https://amzn.to/3yVRicC
β‘ *Other gear I use:* https://www.amazon.com/shop/alexziskind
π₯ Related Videos π₯
π§¬π Mac Studio CLUSTER vs M3 Ultra π€― - https://youtu.be/d8yS-2OyJhw
π§³π§° Mini PC portable setup - https://youtu.be/4RYmsrarOSw
ππ» Dev setup on Mac - https://youtu.be/KiKUN4i1SeU
πΈπ§ Cheap mini runs a 70B LLM π€― - https://youtu.be/xyKEQjUzfAk
π§ͺπ₯ RAM torture test on Mac - https://youtu.be/l3zIwPgan7M
πβ‘ FREE Local LLMs on Apple Silicon | FAST! - https://youtu.be/bp2eev21Qfo
π§ π REALITY vs Appleβs Memory Claims | vs RTX4090m - https://youtu.be/fdvzQAWXU7A
β‘π₯ Thunderbolt 5 BREAKS Appleβs Upcharge - https://youtu.be/nHqrvxcRc7o
π§ π INSANE Machine Learning on Neural Engine - https://youtu.be/Y2FOUg_jo7k
π§±π₯οΈ Mac Mini Cluster - https://youtu.be/GBR6pHZ68Ho
* π οΈ Developer productivity Playlist - https://www.youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX
Julia Turc's channel: https://www.youtube.com/@juliaturc1
β β β β β β β β β
β€οΈ SUBSCRIBE TO MY YOUTUBE CHANNEL πΊ
Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1
Join this channel to get access to perks:
https://www.youtube.com/channel/UCajiMK_CY9icRhLepS8_3ug/join
β β β β β β β β β
π±LET'S CONNECT ON SOCIAL MEDIA
ALEX ON TWITTER: https://x.com/digitalix
JULIA on TWITTER: https://x.com/juliarturc
β β β β β β β β β
#nvfp4 #kimi #llm
Posted Fri at 1:53 PM
click to rate
Share this page with your family and friends.