nixsearch / pkg / python313Packages.pytorch-tokenizers / 1.0.1
python313Packages.pytorch-tokenizers 1.0.1
C++ implementations for various tokenizers (sentencepiece, tiktoken, etc.)
Linux and macOS
last changed
outputs: out, dist
Pin this version
$ devbox add python313Packages.pytorch-tokenizers@1.0.1
systems
aarch64-darwin, aarch64-linux, x86_64-darwin, x86_64-linux
commita1bab9e494f5f4939442a57a58d0449a109593fe
$ nix shell github:NixOS/nixpkgs/a1bab9e494f5f4939442a57a58d0449a109593fe#python313Packages.pytorch-tokenizers
Per system
| System | Attribute | Commit | Date | Outputs | Flags |
|---|---|---|---|---|---|
aarch64-darwinmacOS · arm64 |
python313Packages.pytorch-tokenizers |
a1bab9e494f5 | out/nix/store/vrczkf3fq2zrczvszmm1q8cykn6c1096-python3.13-pytorch-tokenizers-1.0.1 dist (not default)/nix/store/klh3l7jxv7v29zk151rinmbdi5xir5j2-python3.13-pytorch-tokenizers-1.0.1-dist |
||
aarch64-linuxLinux · arm64 |
python313Packages.pytorch-tokenizers |
a1bab9e494f5 | out/nix/store/jp82drhbk1j0fg8ybbb4mlcgpb8n96p2-python3.13-pytorch-tokenizers-1.0.1 dist (not default)/nix/store/w555n6z13qw5krx077m388041vhw0s8j-python3.13-pytorch-tokenizers-1.0.1-dist |
||
x86_64-darwinmacOS · x86-64 |
python313Packages.pytorch-tokenizers |
a1bab9e494f5 | out/nix/store/4wqgvypckv0h84zp90jarq62mddjf8qf-python3.13-pytorch-tokenizers-1.0.1 dist (not default)/nix/store/cz855c4aqsdsxbwx5c61jiqb04khmxl2-python3.13-pytorch-tokenizers-1.0.1-dist |
||
x86_64-linuxLinux · x86-64 |
python313Packages.pytorch-tokenizers |
a1bab9e494f5 | out/nix/store/1kynasmbga5qlqlscycz9znvkrcai4ch-python3.13-pytorch-tokenizers-1.0.1 dist (not default)/nix/store/j3h9rvx4k0hvs8hg4vh7sf1ijsnbqnrh-python3.13-pytorch-tokenizers-1.0.1-dist |
JSON: /v2/pkg?name=python313Packages.pytorch-tokenizers · /v2/resolve?name=python313Packages.pytorch-tokenizers&version=1.0.1