/r/LocalLLaMA

Year:

Only show posts with narrations

Dear Microsoft: Can we get a Phi 3.1 Small with GQA? Or even the same context implementation as 3.1 Mini? Please and thank you.

11 upvotes • Thrumpwart

Mark as read: Add to a list

I Created Promptimizer An Automated AI-Powered Prompt Optimization Framework (now works with Ollama!)

11 upvotes • Starks-Technology

Mark as read: Add to a list

Gemma 2 2B it finetuning colab notebook

11 upvotes • gvij

Mark as read: Add to a list

Having fun with ipython and llama-3.1 on llama.cpp server

11 upvotes • fairydreaming

Mark as read: Add to a list

Whats an unquantized model provider on OpenRouter for Llama 3 405B?

11 upvotes • Icy-Summer-3573

Mark as read: Add to a list

OpenAI API Compatible access to Google Gemini and Embedding Models

10 upvotes • theeashman

Mark as read: Add to a list

Cloud services that run Llama 3.1 on a price per token basis?

10 upvotes • saosebastiao

Mark as read: Add to a list

What determines Int8 performance in a GPU?

10 upvotes • vulcan4d

Mark as read: Add to a list

How To Build Your Retrieval Augmented Generation (RAG) Using Open-source Tools: LangChain, LLAMA 3, and Chroma. A visual guide + Jupyter Notebook. 🧠

10 upvotes • ml_a_day

Mark as read: Add to a list

A local perplexity.ai that is powered by everything you've seen, said, or heard

10 upvotes • louis3195

Mark as read: Add to a list

Title	Upvotes	Author	Mark as read	Favorited	Rating	Add to a list
Dear Microsoft: Can we get a Phi 3.1 Small with GQA? Or even the same context implementation as 3.1 Mini? Please and thank you.	11	Thrumpwart
I Created Promptimizer An Automated AI-Powered Prompt Optimization Framework (now works with Ollama!)	11	Starks-Technology
Gemma 2 2B it finetuning colab notebook	11	gvij
Having fun with ipython and llama-3.1 on llama.cpp server	11	fairydreaming
Whats an unquantized model provider on OpenRouter for Llama 3 405B?	11	Icy-Summer-3573
OpenAI API Compatible access to Google Gemini and Embedding Models	10	theeashman
Cloud services that run Llama 3.1 on a price per token basis?	10	saosebastiao
What determines Int8 performance in a GPU?	10	vulcan4d
How To Build Your Retrieval Augmented Generation (RAG) Using Open-source Tools: LangChain, LLAMA 3, and Chroma. A visual guide + Jupyter Notebook. 🧠	10	ml_a_day
A local perplexity.ai that is powered by everything you've seen, said, or heard	10	louis3195