nixsearch
nixsearch / pkg / python313Packages.pytorch-tokenizers / 1.4.1

python313Packages.pytorch-tokenizers 1.4.1

C++ implementations for various tokenizers (sentencepiece, tiktoken, etc.)
Linux and macOS (Apple Silicon only) last changed outputs: out, dist

Pin this version

$ devbox add python313Packages.pytorch-tokenizers@1.4.1
systemsaarch64-darwin, aarch64-linux, x86_64-linux commit02f5696b0e6097e589076d886b317b83ff0437d7 
$ nix shell github:NixOS/nixpkgs/02f5696b0e6097e589076d886b317b83ff0437d7#python313Packages.pytorch-tokenizers

Per system

SystemAttributeCommitDateOutputsFlags
aarch64-darwin
macOS · arm64		 python313Packages.pytorch-tokenizers 02f5696b0e60
out
/nix/store/59c30iy07x2zpci6xccwmys29h6bgzrv-python3.13-pytorch-tokenizers-1.4.1
dist (not default)
/nix/store/fnam1kynsxlbdp6aafk7hczpywq8a9y5-python3.13-pytorch-tokenizers-1.4.1-dist
aarch64-linux
Linux · arm64		 python313Packages.pytorch-tokenizers 02f5696b0e60
out
/nix/store/31x5vqnp3sbkhabmdfmvh8kwvq6y8pp2-python3.13-pytorch-tokenizers-1.4.1
dist (not default)
/nix/store/c2d6g7g70jkjgqg3lm0z4qsnwwdf04gj-python3.13-pytorch-tokenizers-1.4.1-dist
x86_64-linux
Linux · x86-64		 python313Packages.pytorch-tokenizers 02f5696b0e60
out
/nix/store/ah1v8pl3mjabh5lq1nm6hf4bdii9aw2g-python3.13-pytorch-tokenizers-1.4.1
dist (not default)
/nix/store/ykgg9k281bnv4nz3vjr1zpkfsz1nq77z-python3.13-pytorch-tokenizers-1.4.1-dist
← newer: 1.5.0 all 6 releases older: 1.3.0 →

JSON: /v2/pkg?name=python313Packages.pytorch-tokenizers · /v2/resolve?name=python313Packages.pytorch-tokenizers&version=1.4.1