nixsearch / pkg / python314Packages.pytorch-tokenizers
python314Packages.pytorch-tokenizers
C++ implementations for various tokenizers (sentencepiece, tiktoken, etc.)
version1.5.0
attributepython314Packages.pytorch-tokenizers
rev8d5d270900d3fc75655ea2d9d248b234f6631439 · one commit for every system
systems✓ aarch64-darwin✓ aarch64-linuxx86_64-darwin✓ x86_64-linux
$ devbox add python314Packages.pytorch-tokenizers@1.5.0
$ nix shell github:NixOS/nixpkgs/8d5d270900d3fc75655ea2d9d248b234f6631439#python314Packages.pytorch-tokenizers
JSON: /v2/resolve?name=python314Packages.pytorch-tokenizers&version=latest
Releases
newest first, as/v2/pkg orders them
| Version | arm mac | arm linux | x86 mac | x86 linux | Attribute | Commit | Date | Outputs |
|---|---|---|---|---|---|---|---|---|
| 1.5.0resolved | ✓ | ✓ | – | ✓ | python314Packages.pytorch-tokenizers |
a32edd7654 | out, dist | |
| 1.4.1 | ✓ | ✓ | – | ✓ | python314Packages.pytorch-tokenizers |
02f5696b0e | out, dist | |
| 1.3.0 | ✓ | ✓ | – | ✓ | python314Packages.pytorch-tokenizers |
3a971fa2e6 | out, dist | |
| 1.2.0 | ✓ | ✓ | – | ✓ | python314Packages.pytorch-tokenizers |
varies | out, dist | |
| 1.1.0 | ✓ | ✓ | ✓ | ✓ | python314Packages.pytorch-tokenizers |
varies | out, dist | |
| 1.0.1 | ✓ | ✓ | ✓ | ✓ | python314Packages.pytorch-tokenizers |
a1bab9e494 | out, dist |
Prereleases are listed but latest never picks one. “varies” means each system last changed at a different nixpkgs commit — the release page lists them.