nixsearch
nixsearch / pkg / python313Packages.pytorch-tokenizers / 1.3.0

python313Packages.pytorch-tokenizers 1.3.0

C++ implementations for various tokenizers (sentencepiece, tiktoken, etc.)
Linux and macOS (Apple Silicon only) last changed outputs: out, dist

Pin this version

$ devbox add python313Packages.pytorch-tokenizers@1.3.0
systemsaarch64-darwin, aarch64-linux, x86_64-linux commit3a971fa2e67dcb0f2f2cfed2d37e7956567d73d1 
$ nix shell github:NixOS/nixpkgs/3a971fa2e67dcb0f2f2cfed2d37e7956567d73d1#python313Packages.pytorch-tokenizers

Per system

SystemAttributeCommitDateOutputsFlags
aarch64-darwin
macOS · arm64		 python313Packages.pytorch-tokenizers 3a971fa2e67d
out
/nix/store/93pvvfplz99kkahv5ib2kzcalm05ljfr-python3.13-pytorch-tokenizers-1.3.0
dist (not default)
/nix/store/rvbs37lys1n1kf8s1d9nfjscvfhg439y-python3.13-pytorch-tokenizers-1.3.0-dist
aarch64-linux
Linux · arm64		 python313Packages.pytorch-tokenizers 3a971fa2e67d
out
/nix/store/kpadr4vygxq17dpnnq10802xwhwnsbwd-python3.13-pytorch-tokenizers-1.3.0
dist (not default)
/nix/store/hqyj4zj59ardxamxpw2l64y5f61cga5z-python3.13-pytorch-tokenizers-1.3.0-dist
x86_64-linux
Linux · x86-64		 python313Packages.pytorch-tokenizers 3a971fa2e67d
out
/nix/store/na0dpc48gp40jw034i22l6hj3hzd6wri-python3.13-pytorch-tokenizers-1.3.0
dist (not default)
/nix/store/wrrgaz9cf95qkm3iq748rkbxk59wa6jw-python3.13-pytorch-tokenizers-1.3.0-dist
← newer: 1.4.1 all 6 releases older: 1.2.0 →

JSON: /v2/pkg?name=python313Packages.pytorch-tokenizers · /v2/resolve?name=python313Packages.pytorch-tokenizers&version=1.3.0