nixsearch
nixsearch / pkg / python314Packages.pytorch-tokenizers / 1.4.1

python314Packages.pytorch-tokenizers 1.4.1

C++ implementations for various tokenizers (sentencepiece, tiktoken, etc.)
Linux and macOS (Apple Silicon only) last changed outputs: out, dist

Pin this version

$ devbox add python314Packages.pytorch-tokenizers@1.4.1
systemsaarch64-darwin, aarch64-linux, x86_64-linux commit02f5696b0e6097e589076d886b317b83ff0437d7 
$ nix shell github:NixOS/nixpkgs/02f5696b0e6097e589076d886b317b83ff0437d7#python314Packages.pytorch-tokenizers

Per system

SystemAttributeCommitDateOutputsFlags
aarch64-darwin
macOS · arm64		 python314Packages.pytorch-tokenizers 02f5696b0e60
out
/nix/store/mxg1m4m7g8s3jidkasjn958dpqgw44xz-python3.14-pytorch-tokenizers-1.4.1
dist (not default)
/nix/store/7gcm5jjsamaiirvfvy0zq768xr24nhvm-python3.14-pytorch-tokenizers-1.4.1-dist
aarch64-linux
Linux · arm64		 python314Packages.pytorch-tokenizers 02f5696b0e60
out
/nix/store/cdg2gyrhvdp0j2djrq698vqbaz6j9k8d-python3.14-pytorch-tokenizers-1.4.1
dist (not default)
/nix/store/8kdffqp3r8lllbj0h2i3d4xijzpqmab3-python3.14-pytorch-tokenizers-1.4.1-dist
x86_64-linux
Linux · x86-64		 python314Packages.pytorch-tokenizers 02f5696b0e60
out
/nix/store/ab7zp4wyyhgjgx0chgp2hirp22iah6km-python3.14-pytorch-tokenizers-1.4.1
dist (not default)
/nix/store/fy73q2a72rkhim82i5xcxn58a3rb66c2-python3.14-pytorch-tokenizers-1.4.1-dist
← newer: 1.5.0 all 6 releases older: 1.3.0 →

JSON: /v2/pkg?name=python314Packages.pytorch-tokenizers · /v2/resolve?name=python314Packages.pytorch-tokenizers&version=1.4.1