llama.cpp
0.5.0LLM inference in C/C++
Install
brew install llama.cppDetails
Sources
Supported platforms
| Architecture | Platforms | Version | Download |
|---|---|---|---|
| Apple Silicon | Golden Gate | 0.5.0 | FileSHA-256edf032b5a3a73bc47c94849bde12f877322b98dbe36d6cf149e24ce4db14b234 |
| Apple Silicon | Tahoe | 0.5.0 | FileSHA-2561dea72a74612d3fab141d92220c8c4e5746cd25fede74636fdec8b915845d605 |
| Apple Silicon | Sequoia | 0.5.0 | FileSHA-256b611092f4ec89b8268e10f360665b98e46f90ed64941594fb658da1674fcbd5b |
| ARM64 | Linux | 0.5.0 | FileSHA-256f9c4b954bd49b80bd60a14480504420155308138c8ce9ab7f9d1ffeb7525f523 |
| x86_64 | Linux | 0.5.0 | FileSHA-2569557f45d82abec9cbf64b80f1ccfded618cec11fceed42ee1a3684badd6c01b2 |
Dependencies
- ggml
- openssl@3
