python313Packages.tiktoken 0.8.0

Fast BPE tokeniser for use with OpenAI's models

Linux and macOS last changed 2025-04-01 outputs: out, dist

Pin this version

$ devbox add python313Packages.tiktoken@0.8.0

systemsaarch64-darwin commit88e992074d86ad50249de12b7fb8dbaadf8dc0c5

$ nix shell github:NixOS/nixpkgs/88e992074d86ad50249de12b7fb8dbaadf8dc0c5#python313Packages.tiktoken

systemsaarch64-linux, x86_64-darwin commit0d534853a55b5d02a4ababa1d71921ce8f0aee4c

$ nix shell github:NixOS/nixpkgs/0d534853a55b5d02a4ababa1d71921ce8f0aee4c#python313Packages.tiktoken

systemsx86_64-linux commitdd613136ee91f67e5dba3f3f41ac99ae89c5406b

$ nix shell github:NixOS/nixpkgs/dd613136ee91f67e5dba3f3f41ac99ae89c5406b#python313Packages.tiktoken

System	Attribute	Commit	Date	Outputs
`aarch64-darwin` macOS · arm64	`python313Packages.tiktoken`	88e992074d86	2025-04-01	`out` /nix/store/qlrldgl6r9zcpw6f8samq4f591ld85x6-python3.13-tiktoken-0.8.0 `dist` (not default) /nix/store/kn39psfrd8a5nszcd1rc569wsllnfis7-python3.13-tiktoken-0.8.0-dist
`aarch64-linux` Linux · arm64	`python313Packages.tiktoken`	0d534853a55b	2025-03-11	`out` /nix/store/d7wawghxgbn3b07lis2k45npyync7a2x-python3.13-tiktoken-0.8.0 `dist` (not default) /nix/store/nrx3lcs61sk4hz7q3gvnzz0rb22n1rwg-python3.13-tiktoken-0.8.0-dist
`x86_64-darwin` macOS · x86-64	`python313Packages.tiktoken`	0d534853a55b	2025-03-11	`out` /nix/store/03mi2n9m1r0wmn4nfnkkcrn4cwnk5kkd-python3.13-tiktoken-0.8.0 `dist` (not default) /nix/store/86q9ryl04g6yw2xggschcqqbya2nrp67-python3.13-tiktoken-0.8.0-dist
`x86_64-linux` Linux · x86-64	`python313Packages.tiktoken`	dd613136ee91	2025-03-23	`out` /nix/store/841gimzxfjs63ahnzpikbsfi2i83ivvk-python3.13-tiktoken-0.8.0 `dist` (not default) /nix/store/6sxksm51gb2jzjkkbpm7fglwqa8hnfyh-python3.13-tiktoken-0.8.0-dist