nixsearch / pkg / openllm
openllm
Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud
version0.6.30
attributeopenllm
rev
systems✓ aarch64-darwin✓ aarch64-linux✓ x86_64-darwin✓ x86_64-linux
aarch64-darwin 34ca302a9572963c02e385c056be37c85ff51b77 aarch64-linux 34ca302a9572963c02e385c056be37c85ff51b77 x86_64-darwin 09061f748ee21f68a089cd5d91ec1859cd93d0be x86_64-linux 34ca302a9572963c02e385c056be37c85ff51b77 $ devbox add openllm@0.6.30
$ nix shell github:NixOS/nixpkgs/34ca302a9572963c02e385c056be37c85ff51b77#openllm # aarch64-darwin
$ nix shell github:NixOS/nixpkgs/34ca302a9572963c02e385c056be37c85ff51b77#openllm # aarch64-linux
$ nix shell github:NixOS/nixpkgs/09061f748ee21f68a089cd5d91ec1859cd93d0be#openllm # x86_64-darwin
$ nix shell github:NixOS/nixpkgs/34ca302a9572963c02e385c056be37c85ff51b77#openllm # x86_64-linux
Releases
newest first, as/v2/pkg orders them
| Version | arm mac | arm linux | x86 mac | x86 linux | Attribute | Commit | Date | Outputs |
|---|---|---|---|---|---|---|---|---|
| 0.6.30resolved | ✓ | ✓ | ✓ | ✓ | openllm |
varies | out, dist | |
| 0.6.10 | ✓ | ✓ | ✓ | ✓ | openllm |
be5afa0fcb | out, dist |
Prereleases are listed but latest never picks one. “varies” means each system last changed at a different nixpkgs commit — the release page lists them.