nixsearch
nixsearch / pkg / python313Packages.pytorch-tokenizers / 1.5.0

python313Packages.pytorch-tokenizers 1.5.0

C++ implementations for various tokenizers (sentencepiece, tiktoken, etc.)
Linux and macOS (Apple Silicon only) last changed outputs: out, dist

Pin this version

$ devbox add python313Packages.pytorch-tokenizers@1.5.0
systemsaarch64-darwin, aarch64-linux, x86_64-linux commita32edd7654519351e48e80372a928df336394670
$ nix shell github:NixOS/nixpkgs/a32edd7654519351e48e80372a928df336394670#python313Packages.pytorch-tokenizers

Per system

SystemAttributeCommitDateOutputsFlags
aarch64-darwin
macOS · arm64
python313Packages.pytorch-tokenizers a32edd765451
out
/nix/store/sqnlman32919a99dcqsmqrnnczqb1cnn-python3.13-pytorch-tokenizers-1.5.0
dist (not default)
/nix/store/m6zykfsbizk2k7yc8vndnbcysifvsl6m-python3.13-pytorch-tokenizers-1.5.0-dist
aarch64-linux
Linux · arm64
python313Packages.pytorch-tokenizers a32edd765451
out
/nix/store/bqv81hy5g8gcz3z11rv6yvrnb9fpqhs9-python3.13-pytorch-tokenizers-1.5.0
dist (not default)
/nix/store/azx40dp0v2jb6c53ki5wj3m5q20w7ws5-python3.13-pytorch-tokenizers-1.5.0-dist
x86_64-linux
Linux · x86-64
python313Packages.pytorch-tokenizers a32edd765451
out
/nix/store/rxx94567vx3b5mxjaz58yyyip9mwwzpn-python3.13-pytorch-tokenizers-1.5.0
dist (not default)
/nix/store/y5ws4x8lcamgg2sqj3yasp09v8qrm8yc-python3.13-pytorch-tokenizers-1.5.0-dist
all 6 releases older: 1.4.1 →

JSON: /v2/pkg?name=python313Packages.pytorch-tokenizers · /v2/resolve?name=python313Packages.pytorch-tokenizers&version=1.5.0