nixsearch / pkg / python314Packages.pytorch-tokenizers / 1.0.1
python314Packages.pytorch-tokenizers 1.0.1
C++ implementations for various tokenizers (sentencepiece, tiktoken, etc.)
Linux and macOS
last changed
outputs: out, dist
Pin this version
$ devbox add python314Packages.pytorch-tokenizers@1.0.1
systems
aarch64-darwin, aarch64-linux, x86_64-darwin, x86_64-linux
commita1bab9e494f5f4939442a57a58d0449a109593fe
$ nix shell github:NixOS/nixpkgs/a1bab9e494f5f4939442a57a58d0449a109593fe#python314Packages.pytorch-tokenizers
Per system
| System | Attribute | Commit | Date | Outputs | Flags |
|---|---|---|---|---|---|
aarch64-darwinmacOS · arm64 |
python314Packages.pytorch-tokenizers |
a1bab9e494f5 | out/nix/store/3lfdnc3njl0mmfg1klr2hczabj3c1xlk-python3.14-pytorch-tokenizers-1.0.1 dist (not default)/nix/store/cvn7sznzravgbpxj925vjicrwmid001m-python3.14-pytorch-tokenizers-1.0.1-dist |
||
aarch64-linuxLinux · arm64 |
python314Packages.pytorch-tokenizers |
a1bab9e494f5 | out/nix/store/08rj78dw56g11rb9nm1lp9z5v016pp82-python3.14-pytorch-tokenizers-1.0.1 dist (not default)/nix/store/hp18d9f1ydk8qnlbndhzv0a7s7zg376d-python3.14-pytorch-tokenizers-1.0.1-dist |
||
x86_64-darwinmacOS · x86-64 |
python314Packages.pytorch-tokenizers |
a1bab9e494f5 | out/nix/store/886fqw6nnhnf544z4msl51zwgkj9bvb2-python3.14-pytorch-tokenizers-1.0.1 dist (not default)/nix/store/vhr5p7xxdrsldb6d0cp22hqayrzrklz6-python3.14-pytorch-tokenizers-1.0.1-dist |
||
x86_64-linuxLinux · x86-64 |
python314Packages.pytorch-tokenizers |
a1bab9e494f5 | out/nix/store/xj9sai9b2hwkq8kkf2ycqafy9431rzmb-python3.14-pytorch-tokenizers-1.0.1 dist (not default)/nix/store/insgk2n7w60a2v2grhfz775xinjyjav5-python3.14-pytorch-tokenizers-1.0.1-dist |
JSON: /v2/pkg?name=python314Packages.pytorch-tokenizers · /v2/resolve?name=python314Packages.pytorch-tokenizers&version=1.0.1