/r/LocalLLaMA

Year:

Only show posts with narrations

Where can i test Llama 3.1 405B on mobile phone?

2 upvotes • ConflictRough320

Mark as read: Add to a list

Chemistry LLM ?

2 upvotes • crapaud_dindon

Mark as read: Add to a list

AI (multi)-agent marketplace – validate/refute this idea

2 upvotes • Jazzlike_Tooth929

Mark as read: Add to a list

Llama3 and GPT4All to create AI app

1 upvotes • mehdi_mka

Mark as read: Add to a list

Cannot login to Meta AI with facebook account to use Llama 3.1 - Any suggestions? My account must be flagged to be international. I'm in the US after traveling abroad. Have had my account for almost 10+ years.

1 upvotes • unamity1

Mark as read: Add to a list

Error: Failed to fetch the chat response

1 upvotes • AnnaAnanasBanan

Mark as read: Add to a list

Is there a list of leaderboards?

1 upvotes • tevlon

Mark as read: Add to a list

How to inference a Quantized Llama3.1 70B locally?

1 upvotes • stramzik

Mark as read: Add to a list

Did OpenAI just kill llama.cpp's GBNF grammars (used for guaranteed structured outputs) without acknowledging that their idea came from open-source? What advantages do llama.cpp's grammars have now that OpenAI supports something similar?

1 upvotes • nderstand2grow

Mark as read: Add to a list

Probability outputs appear "quantized" using non-quantized model (but not with quantized model)

1 upvotes • Due-Issue-4433

Mark as read: Add to a list

Title	Upvotes	Author	Mark as read	Favorited	Rating	Add to a list
Where can i test Llama 3.1 405B on mobile phone?	2	ConflictRough320
Chemistry LLM ?	2	crapaud_dindon
AI (multi)-agent marketplace – validate/refute this idea	2	Jazzlike_Tooth929
Llama3 and GPT4All to create AI app	1	mehdi_mka
Cannot login to Meta AI with facebook account to use Llama 3.1 - Any suggestions? My account must be flagged to be international. I'm in the US after traveling abroad. Have had my account for almost 10+ years.	1	unamity1
Error: Failed to fetch the chat response	1	AnnaAnanasBanan
Is there a list of leaderboards?	1	tevlon
How to inference a Quantized Llama3.1 70B locally?	1	stramzik
Did OpenAI just kill llama.cpp's GBNF grammars (used for guaranteed structured outputs) without acknowledging that their idea came from open-source? What advantages do llama.cpp's grammars have now that OpenAI supports something similar?	1	nderstand2grow
Probability outputs appear "quantized" using non-quantized model (but not with quantized model)	1	Due-Issue-4433