Image 1 of 1
Image 1 of 1
Image 1 of 1
Image 1 of 1
A local model is not a gadget you buy and then try to justify. It is a workload you understand, a model you evaluate, and only then a machine you choose. Reverse that order and you can spend thousands of dollars to learn that a smaller model, a shorter context window, or a different runtime would have solved the actual problem.
This book is for people who want prompts, documents, embeddings, and inference to stay under their own control. You are comfortable opening a terminal, installing a package, reading an error message, and changing a configuration value. You may be a developer building an internal feature, an enthusiast with a capable desktop or Mac, or the person tired of an API invoice rising with every successful deployment.
A local model is not a gadget you buy and then try to justify. It is a workload you understand, a model you evaluate, and only then a machine you choose. Reverse that order and you can spend thousands of dollars to learn that a smaller model, a shorter context window, or a different runtime would have solved the actual problem.
This book is for people who want prompts, documents, embeddings, and inference to stay under their own control. You are comfortable opening a terminal, installing a package, reading an error message, and changing a configuration value. You may be a developer building an internal feature, an enthusiast with a capable desktop or Mac, or the person tired of an API invoice rising with every successful deployment.
