nixsearch / pkg / python314Packages.pytorch-tokenizers / 1.5.0
python314Packages.pytorch-tokenizers 1.5.0
C++ implementations for various tokenizers (sentencepiece, tiktoken, etc.)
Linux and macOS (Apple Silicon only)
last changed
outputs: out, dist
Pin this version
$ devbox add python314Packages.pytorch-tokenizers@1.5.0
$ nix shell github:NixOS/nixpkgs/a32edd7654519351e48e80372a928df336394670#python314Packages.pytorch-tokenizers
Per system
| System | Attribute | Commit | Date | Outputs | Flags |
|---|---|---|---|---|---|
aarch64-darwinmacOS · arm64 |
python314Packages.pytorch-tokenizers |
a32edd765451 | out/nix/store/zsq9k4shyxqd5rypd2nflrir8qwbaqv6-python3.14-pytorch-tokenizers-1.5.0 dist (not default)/nix/store/nxia376m4sgs5cigrlxqi5hs2srp9nn9-python3.14-pytorch-tokenizers-1.5.0-dist |
||
aarch64-linuxLinux · arm64 |
python314Packages.pytorch-tokenizers |
a32edd765451 | out/nix/store/3br30526qngwv13naa8nlb2lfnq7a7pg-python3.14-pytorch-tokenizers-1.5.0 dist (not default)/nix/store/w7bby94dpima7qkfr0ym340a0dwhp5zi-python3.14-pytorch-tokenizers-1.5.0-dist |
||
x86_64-linuxLinux · x86-64 |
python314Packages.pytorch-tokenizers |
a32edd765451 | out/nix/store/djnm9k92fbx8snzii6p82zfgq38538wf-python3.14-pytorch-tokenizers-1.5.0 dist (not default)/nix/store/9fjsa21h83c85bykylap5sfi5ahin1w6-python3.14-pytorch-tokenizers-1.5.0-dist |
JSON: /v2/pkg?name=python314Packages.pytorch-tokenizers · /v2/resolve?name=python314Packages.pytorch-tokenizers&version=1.5.0