nixsearch
nixsearch / pkg / python313Packages.pytorch-tokenizers / 1.2.0

python313Packages.pytorch-tokenizers 1.2.0

C++ implementations for various tokenizers (sentencepiece, tiktoken, etc.)
Linux and macOS (Apple Silicon only) last changed outputs: out, dist

Pin this version

$ devbox add python313Packages.pytorch-tokenizers@1.2.0
systemsaarch64-darwin commita0991c886dc83e6e9de01d5266e4842985b1850e 
$ nix shell github:NixOS/nixpkgs/a0991c886dc83e6e9de01d5266e4842985b1850e#python313Packages.pytorch-tokenizers
systemsaarch64-linux, x86_64-linux commit4a29d733e8a7d5b824c3d8c958a946a9867b3eb2 
$ nix shell github:NixOS/nixpkgs/4a29d733e8a7d5b824c3d8c958a946a9867b3eb2#python313Packages.pytorch-tokenizers

Per system

SystemAttributeCommitDateOutputsFlags
aarch64-darwin
macOS · arm64		 python313Packages.pytorch-tokenizers a0991c886dc8
out
/nix/store/pvpvarw6bv0ncy75gsqqspclhfkl85a7-python3.13-pytorch-tokenizers-1.2.0
dist (not default)
/nix/store/jyj80snqi2jjgmfpni4cyyhxbj1g66za-python3.13-pytorch-tokenizers-1.2.0-dist
aarch64-linux
Linux · arm64		 python313Packages.pytorch-tokenizers 4a29d733e8a7
out
/nix/store/5nyqjc5amgx2i03mk0qq4c6x93sn4iky-python3.13-pytorch-tokenizers-1.2.0
dist (not default)
/nix/store/xf3a3wv16621nwdazfar1ychfpjdnhjm-python3.13-pytorch-tokenizers-1.2.0-dist
x86_64-linux
Linux · x86-64		 python313Packages.pytorch-tokenizers 4a29d733e8a7
out
/nix/store/71ycv4pllpk4r84ch5fnk17j5rnbji5f-python3.13-pytorch-tokenizers-1.2.0
dist (not default)
/nix/store/s4q43gk4cd3bbrh0k8zzv5cxdmv66vvq-python3.13-pytorch-tokenizers-1.2.0-dist
← newer: 1.3.0 all 6 releases older: 1.1.0 →

JSON: /v2/pkg?name=python313Packages.pytorch-tokenizers · /v2/resolve?name=python313Packages.pytorch-tokenizers&version=1.2.0