nixsearch
nixsearch / pkg / python314Packages.pytorch-tokenizers / 1.1.0

python314Packages.pytorch-tokenizers 1.1.0

C++ implementations for various tokenizers (sentencepiece, tiktoken, etc.)
Linux and macOS last changed outputs: out, dist

Pin this version

$ devbox add python314Packages.pytorch-tokenizers@1.1.0
systemsaarch64-darwin, aarch64-linux, x86_64-linux commit15c6719d8c604779cf59e03c245ea61d3d7ab69b 
$ nix shell github:NixOS/nixpkgs/15c6719d8c604779cf59e03c245ea61d3d7ab69b#python314Packages.pytorch-tokenizers
systemsx86_64-darwin commit09061f748ee21f68a089cd5d91ec1859cd93d0be 
$ nix shell github:NixOS/nixpkgs/09061f748ee21f68a089cd5d91ec1859cd93d0be#python314Packages.pytorch-tokenizers

Per system

SystemAttributeCommitDateOutputsFlags
aarch64-darwin
macOS · arm64		 python314Packages.pytorch-tokenizers 15c6719d8c60
out
/nix/store/hhg7h5vmvy30y3ppblcdz0hjd0l318x4-python3.14-pytorch-tokenizers-1.1.0
dist (not default)
/nix/store/dypylag8dhif7im989ra8aq467nbpcin-python3.14-pytorch-tokenizers-1.1.0-dist
aarch64-linux
Linux · arm64		 python314Packages.pytorch-tokenizers 15c6719d8c60
out
/nix/store/2crqp0hpf369ck1x9irk9jhiqc9widv1-python3.14-pytorch-tokenizers-1.1.0
dist (not default)
/nix/store/vrxxs1rx7bxj00pjjn20kw0rx0nkk5dl-python3.14-pytorch-tokenizers-1.1.0-dist
x86_64-darwin
macOS · x86-64		 python314Packages.pytorch-tokenizers 09061f748ee2
out
/nix/store/8lyig6ryfsq8znxavazn6lv6v2zighak-python3.14-pytorch-tokenizers-1.1.0
dist (not default)
/nix/store/fi6qz3bm3gr5jxy9k9dg1rdn0gb13351-python3.14-pytorch-tokenizers-1.1.0-dist
x86_64-linux
Linux · x86-64		 python314Packages.pytorch-tokenizers 15c6719d8c60
out
/nix/store/0d6dmfwrmaans0z8jk0rlh0l20c4alrb-python3.14-pytorch-tokenizers-1.1.0
dist (not default)
/nix/store/0qhdw7zpngn7gm8v88wws7vnp6m57zla-python3.14-pytorch-tokenizers-1.1.0-dist
← newer: 1.2.0 all 6 releases older: 1.0.1 →

JSON: /v2/pkg?name=python314Packages.pytorch-tokenizers · /v2/resolve?name=python314Packages.pytorch-tokenizers&version=1.1.0