ttok 0.4
Release: ttok 0.4
ttok is my CLI tool for counting tokens, using OpenAI's open source tiktoken library.
It hasn't been in updated in a couple of years, but I finally fixed a Click warning, updated CI, and added a --list-models command to list available models.
It works with uvx, so you can count tokens in anything like this:
cat file.txt | uvx ttok
Tags: projects, ai, openai, generative-ai, llms, tokenization
评论
?
参与讨论