nixsearch / pkg / python313Packages.pytorch-tokenizers
python313Packages.pytorch-tokenizers
C++ implementations for various tokenizers (sentencepiece, tiktoken, etc.)
version1.5.0
attributepython313Packages.pytorch-tokenizers
revd54020a6ac3211e9f4201631bdf67678818c0cdf · one commit for every system
systems✓ aarch64-darwin✓ aarch64-linuxx86_64-darwin✓ x86_64-linux
$ devbox add python313Packages.pytorch-tokenizers@1.5.0
$ nix shell github:NixOS/nixpkgs/d54020a6ac3211e9f4201631bdf67678818c0cdf#python313Packages.pytorch-tokenizers
JSON: /v2/resolve?name=python313Packages.pytorch-tokenizers&version=latest
Releases
newest first, as/v2/pkg orders them
| Version | arm mac | arm linux | x86 mac | x86 linux | Attribute | Commit | Date | Outputs |
|---|---|---|---|---|---|---|---|---|
| 1.5.0resolved | ✓ | ✓ | – | ✓ | python313Packages.pytorch-tokenizers |
a32edd7654 | out, dist | |
| 1.4.1 | ✓ | ✓ | – | ✓ | python313Packages.pytorch-tokenizers |
02f5696b0e | out, dist | |
| 1.3.0 | ✓ | ✓ | – | ✓ | python313Packages.pytorch-tokenizers |
3a971fa2e6 | out, dist | |
| 1.2.0 | ✓ | ✓ | – | ✓ | python313Packages.pytorch-tokenizers |
varies | out, dist | |
| 1.1.0 | ✓ | ✓ | ✓ | ✓ | python313Packages.pytorch-tokenizers |
varies | out, dist | |
| 1.0.1 | ✓ | ✓ | ✓ | ✓ | python313Packages.pytorch-tokenizers |
a1bab9e494 | out, dist |
Prereleases are listed but latest never picks one. “varies” means each system last changed at a different nixpkgs commit — the release page lists them.