Skip to content
Navigation menu
Search
Powered by Algolia
Search
Log in
Create account
DEV Community
Close
#
llm
Follow
Hide
Posts
Left menu
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
Installing GPT4All, an Open-Source Chatbot Application for Running LLMs
Sanskriti Harmukh
Sanskriti Harmukh
Sanskriti Harmukh
Follow
for
Vultr
Sep 3
Installing GPT4All, an Open-Source Chatbot Application for Running LLMs
#
llm
#
ai
#
opensource
#
chatbot
10
reactions
Picked as gem
Picked as gem by you
Comments
Add Comment
9 min read
I told the model to separate fields with <TAB>. It did exactly that, and I lost 79 percent of my data.
Rickesh T N
Rickesh T N
Rickesh T N
Follow
Sep 5
I told the model to separate fields with <TAB>. It did exactly that, and I lost 79 percent of my data.
#
llm
#
prompting
#
debugging
#
localllm
Comments
Add Comment
3 min read
Every Greedy Metric Said the Model Was Improving. Then pass@64 Fell From 0.83 to 0.19
howcani howcani
howcani howcani
howcani howcani
Follow
Sep 5
Every Greedy Metric Said the Model Was Improving. Then pass@64 Fell From 0.83 to 0.19
#
ai
#
deeplearning
#
llm
#
machinelearning
1
reaction
Comments
Add Comment
4 min read
A 4B on a 6GB laptop matched frontier-model accuracy on aggregation — except when the answer is a number
Rickesh T N
Rickesh T N
Rickesh T N
Follow
Sep 5
A 4B on a 6GB laptop matched frontier-model accuracy on aggregation — except when the answer is a number
#
llm
#
benchmarks
#
localllm
#
agents
Comments
Add Comment
4 min read
How to count the tokens in an LLM prompt (and why the number matters)
iLostCount
iLostCount
iLostCount
Follow
Sep 5
How to count the tokens in an LLM prompt (and why the number matters)
#
ai
#
llm
#
webdev
#
beginners
Comments
Add Comment
2 min read
I Tested Q4_K_M vs MXFP4 on the Same Laptop — The Supposedly-Faster New Format Lost
Pitambar Mahato
Pitambar Mahato
Pitambar Mahato
Follow
Sep 5
I Tested Q4_K_M vs MXFP4 on the Same Laptop — The Supposedly-Faster New Format Lost
#
llm
#
benchmark
#
performance
#
ai
Comments
Add Comment
6 min read
I built an AI API that turns any online store URL into a structured product catalog
CRJ
CRJ
CRJ
Follow
Sep 5
I built an AI API that turns any online store URL into a structured product catalog
#
ai
#
api
#
llm
#
saas
Comments
Add Comment
2 min read
I built an epistemic gate to stop LLM data poisoning during fine-tuning. Tested across 5 architectures, orchestrated on a 2006 Toshiba laptop for $0.
Eduardo
Eduardo
Eduardo
Follow
Sep 4
I built an epistemic gate to stop LLM data poisoning during fine-tuning. Tested across 5 architectures, orchestrated on a 2006 Toshiba laptop for $0.
#
ai
#
llm
#
machinelearning
#
security
Comments
Add Comment
2 min read
Your agent truncates the corpus and answers anyway. Two harnesses, and a router that picks between them.
Rickesh T N
Rickesh T N
Rickesh T N
Follow
Sep 5
Your agent truncates the corpus and answers anyway. Two harnesses, and a router that picks between them.
#
llm
#
agents
#
localllm
#
benchmarks
Comments
Add Comment
5 min read
Temperature 0 is not reproducible. I measured 30 percent of my output changing between identical runs.
Rickesh T N
Rickesh T N
Rickesh T N
Follow
Sep 5
Temperature 0 is not reproducible. I measured 30 percent of my output changing between identical runs.
#
llm
#
benchmarks
#
localllm
#
reproducibility
Comments
1
comment
3 min read
Our 4B beat Claude Opus on a 440K-token corpus. Then it came last on the public benchmark.
Rickesh T N
Rickesh T N
Rickesh T N
Follow
Sep 5
Our 4B beat Claude Opus on a 440K-token corpus. Then it came last on the public benchmark.
#
llm
#
benchmarks
#
localllm
#
privateai
1
reaction
Comments
Add Comment
4 min read
What an agent loop is (and isn't): state, action, stop
Ramón Chancay 👨🏻💻
Ramón Chancay 👨🏻💻
Ramón Chancay 👨🏻💻
Follow
Sep 5
What an agent loop is (and isn't): state, action, stop
#
agents
#
agentloop
#
llm
#
agentarchitecture
Comments
Add Comment
3 min read
Model routing with OpenRouter and DeepSeek to cut costs without losing quality
Ramón Chancay 👨🏻💻
Ramón Chancay 👨🏻💻
Ramón Chancay 👨🏻💻
Follow
Sep 5
Model routing with OpenRouter and DeepSeek to cut costs without losing quality
#
openrouter
#
deepseek
#
llm
#
costoptimization
Comments
Add Comment
3 min read
Reverse Engineering Undocumented Architectures: LLM-Driven Opcode Table Extraction vs. Legacy Tooling Constraints
ddupard
ddupard
ddupard
Follow
Sep 5
Reverse Engineering Undocumented Architectures: LLM-Driven Opcode Table Extraction vs. Legacy Tooling Constraints
#
ai
#
architecture
#
llm
#
softwareengineering
Comments
Add Comment
5 min read
Ollama's -cloud suffix isn't a label, it's a silent instruction. I bypassed it.
Nathan C.
Nathan C.
Nathan C.
Follow
Sep 5
Ollama's -cloud suffix isn't a label, it's a silent instruction. I bypassed it.
#
ai
#
ollama
#
llm
#
opensource
3
reactions
Comments
Add Comment
5 min read
👋
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account