Videos » Top FREE model… one format made it WAY FASTER

Top FREE model… one format made it WAY FASTER

Posted by admin
Can a 4-bit LLM quantization outperform 8-bit, and how the world's best model behaves quantized to NVFP4. Kimi is here: https://www.kimi.com/?utm_campaign=TR_j9o2iUOy&utm_content=&utm_medium=Youtube&utm_source=CH_kEMBez3l πŸ‘€ My favorite external drive (dependable): https://amzn.to/3Os9Wi3 πŸ‘€ Thunderbolt 4 dock: https://amzn.to/3yVRicC ⚑ *Other gear I use:* https://www.amazon.com/shop/alexziskind πŸŽ₯ Related Videos πŸŽ₯ 🧬🐍 Mac Studio CLUSTER vs M3 Ultra 🀯 - https://youtu.be/d8yS-2OyJhw 🧳🧰 Mini PC portable setup - https://youtu.be/4RYmsrarOSw πŸŽπŸ’» Dev setup on Mac - https://youtu.be/KiKUN4i1SeU πŸ’ΈπŸ§  Cheap mini runs a 70B LLM 🀯 - https://youtu.be/xyKEQjUzfAk πŸ§ͺπŸ”₯ RAM torture test on Mac - https://youtu.be/l3zIwPgan7M 🍏⚑ FREE Local LLMs on Apple Silicon | FAST! - https://youtu.be/bp2eev21Qfo πŸ§ πŸ“‰ REALITY vs Apple’s Memory Claims | vs RTX4090m - https://youtu.be/fdvzQAWXU7A ⚑πŸ’₯ Thunderbolt 5 BREAKS Apple’s Upcharge - https://youtu.be/nHqrvxcRc7o πŸ§ πŸš€ INSANE Machine Learning on Neural Engine - https://youtu.be/Y2FOUg_jo7k 🧱πŸ–₯️ Mac Mini Cluster - https://youtu.be/GBR6pHZ68Ho * πŸ› οΈ Developer productivity Playlist - https://www.youtube.com/playlist?list=PLPwbI_iIX3aQCRdFGM7j4TY_7STfv2aXX Julia Turc's channel: https://www.youtube.com/@juliaturc1 β€” β€” β€” β€” β€” β€” β€” β€” β€” ❀️ SUBSCRIBE TO MY YOUTUBE CHANNEL πŸ“Ί Click here to subscribe: https://www.youtube.com/@AZisk?sub_confirmation=1 Join this channel to get access to perks: https://www.youtube.com/channel/UCajiMK_CY9icRhLepS8_3ug/join β€” β€” β€” β€” β€” β€” β€” β€” β€” πŸ“±LET'S CONNECT ON SOCIAL MEDIA ALEX ON TWITTER: https://x.com/digitalix JULIA on TWITTER: https://x.com/juliarturc β€” β€” β€” β€” β€” β€” β€” β€” β€” #nvfp4 #kimi #llm
Posted Fri at 1:53 PM
click to rate

Embed  |  103 views