In this video, I'll show you how to install LLaMA 2 locally. We will install LLaMA 2 chat 13b fp16, but you can install ANY LLaMA 2 model after watching this video. I also put LLaMA 2 chat 13b fp16 through an extensive test. Does it do better than LLaMA 2 70b? Let's find out!
Enjoy :)
See NordPass Business in action now with a 3-month free trial here: nordpass.com/matthewberman code:matthewberman
Become a Patron 🔥 - / matthewberman
Join the Discord 💬 - / discord
Follow me on Twitter 🧠 - / matthewberman
Subscribe to my Substack 🗞️ - https://matthewberman.substack.com
Chapters:
0:00 - Intro
0:23 - Install Guide
3:40 - Testing LLaMA 2 13b fp16
Links:
Install Commands - https://gist.github.com/mberman84/455...
Runpod - bit.ly/3OtbnQx
LLM Leaderboard - https://tide-freckle-52b.notion.site/...
In-Depth Local Install Tutorial - • How To Install TextGen WebUI - Use AN...
LLaMA 2 Announcement - • Free, Open-Source, and Beats ChatGPT ...
LLaMA 2 70b Testing - • NEW A.I. By Meta Is THAT Good? LLaMA ...
TextGen WebUI - https://github.com/oobabooga/text-gen...
Torch Download URL - https://download.pytorch.org/whl/cu117
LLaMA 2 13b chat fp16 - https://huggingface.co/TheBloke/Llama...
