2·
5 days agotldr;
Set that minimum TTL to something between 40 minutes (2400 seconds) and 1 hour; this is a perfectly reasonable range.
- 0 Posts
- 2 Comments
Joined 1 year ago
Cake day: December 3rd, 2024
You are not logged in. If you use a Fediverse account that is able to follow users, you can follow this user.
you self host your own claude llm? damn and here i thought a 14B deepseek ollama instance was good shit - how did you get access to their proprietary weights?