nixsearch
nixsearch / pkg / python314Packages.pytorch-tokenizers / 1.3.0

python314Packages.pytorch-tokenizers 1.3.0

C++ implementations for various tokenizers (sentencepiece, tiktoken, etc.)
Linux and macOS (Apple Silicon only) last changed outputs: out, dist

Pin this version

$ devbox add python314Packages.pytorch-tokenizers@1.3.0
systemsaarch64-darwin, aarch64-linux, x86_64-linux commit3a971fa2e67dcb0f2f2cfed2d37e7956567d73d1 
$ nix shell github:NixOS/nixpkgs/3a971fa2e67dcb0f2f2cfed2d37e7956567d73d1#python314Packages.pytorch-tokenizers

Per system

SystemAttributeCommitDateOutputsFlags
aarch64-darwin
macOS · arm64		 python314Packages.pytorch-tokenizers 3a971fa2e67d
out
/nix/store/fqw34f762qjwzzia4jzfyr28f8hskkf8-python3.14-pytorch-tokenizers-1.3.0
dist (not default)
/nix/store/g85ipx116cd229m3rq6nadmdif8lr1c8-python3.14-pytorch-tokenizers-1.3.0-dist
aarch64-linux
Linux · arm64		 python314Packages.pytorch-tokenizers 3a971fa2e67d
out
/nix/store/x4nvzr33xa7g20jyhr78nj6p7yi84y9h-python3.14-pytorch-tokenizers-1.3.0
dist (not default)
/nix/store/0vb9aihklz9jx10qkc0fnjx672y7h7p3-python3.14-pytorch-tokenizers-1.3.0-dist
x86_64-linux
Linux · x86-64		 python314Packages.pytorch-tokenizers 3a971fa2e67d
out
/nix/store/857kaw2mqlz56ji7ld71094m86ra8lk0-python3.14-pytorch-tokenizers-1.3.0
dist (not default)
/nix/store/vk58dlrb3jqld6qawa6mbgaaqblpf4kk-python3.14-pytorch-tokenizers-1.3.0-dist
← newer: 1.4.1 all 6 releases older: 1.2.0 →

JSON: /v2/pkg?name=python314Packages.pytorch-tokenizers · /v2/resolve?name=python314Packages.pytorch-tokenizers&version=1.3.0