nixsearch
nixsearch / pkg / python313Packages.pytorch-tokenizers / 1.1.0

python313Packages.pytorch-tokenizers 1.1.0

C++ implementations for various tokenizers (sentencepiece, tiktoken, etc.)
Linux and macOS last changed outputs: out, dist

Pin this version

$ devbox add python313Packages.pytorch-tokenizers@1.1.0
systemsaarch64-darwin, aarch64-linux, x86_64-linux commit15c6719d8c604779cf59e03c245ea61d3d7ab69b 
$ nix shell github:NixOS/nixpkgs/15c6719d8c604779cf59e03c245ea61d3d7ab69b#python313Packages.pytorch-tokenizers
systemsx86_64-darwin commit09061f748ee21f68a089cd5d91ec1859cd93d0be 
$ nix shell github:NixOS/nixpkgs/09061f748ee21f68a089cd5d91ec1859cd93d0be#python313Packages.pytorch-tokenizers

Per system

SystemAttributeCommitDateOutputsFlags
aarch64-darwin
macOS · arm64		 python313Packages.pytorch-tokenizers 15c6719d8c60
out
/nix/store/gwbirv8qblhrn72f1ai7i1cm1cx9jwsq-python3.13-pytorch-tokenizers-1.1.0
dist (not default)
/nix/store/ay14xp383miqj0vpdry35qrzx23j3b1s-python3.13-pytorch-tokenizers-1.1.0-dist
aarch64-linux
Linux · arm64		 python313Packages.pytorch-tokenizers 15c6719d8c60
out
/nix/store/6j10l6zakhbvgqzvb4cfsx3wvbx5d9c5-python3.13-pytorch-tokenizers-1.1.0
dist (not default)
/nix/store/f48413ljnqh0wpl4c5rrirzng03nzgsz-python3.13-pytorch-tokenizers-1.1.0-dist
x86_64-darwin
macOS · x86-64		 python313Packages.pytorch-tokenizers 09061f748ee2
out
/nix/store/inda2988s0d9k4arkdvvrydmy5z8hmyg-python3.13-pytorch-tokenizers-1.1.0
dist (not default)
/nix/store/0mhb26hm8kgws2vfyicddfnb25zk64x8-python3.13-pytorch-tokenizers-1.1.0-dist
x86_64-linux
Linux · x86-64		 python313Packages.pytorch-tokenizers 15c6719d8c60
out
/nix/store/490bgqfwvyrq22vjv97jpy8ybn474v20-python3.13-pytorch-tokenizers-1.1.0
dist (not default)
/nix/store/229hm0afxjalqwvgr5m1lxk6mgzcwd78-python3.13-pytorch-tokenizers-1.1.0-dist
← newer: 1.2.0 all 6 releases older: 1.0.1 →

JSON: /v2/pkg?name=python313Packages.pytorch-tokenizers · /v2/resolve?name=python313Packages.pytorch-tokenizers&version=1.1.0