Tokens
Tokens can be introductory text or file units that LLMs use for processing and generating language. On StackSpot AI, a token is the words you type on the prompt or files you add to create Knowledge Sources. It is used to optimize the platform's performance and provide a transparent experience for our users.
Token LLM
These are units of text (words, parts of words, or characters) that language models (LLMs, such as GPT-4) use to process and generate responses. Each message sent to or received from the LLM is counted in tokens.
Token Embedding
These are units of text that are converted into numerical vectors so the model can understand and compare meanings. The embedding process transforms tokens into mathematical representations for semantic search and context analysis.
Token Usage
StackSpot AI has tokens to help control the user's activities within the platform. It tracks each user interaction according to the account. When your token usage reaches the defined limits:
- It prevents further interactions that require token consumption.
- You will see a notification informing you the token has reached the limit.
Token limits
The account has a 1 million token limit per month. This number includes the words on your questions to AI and the Knowledge Source files you add within the platform. About the token limit:
- If you reach the 1 million limit, you get a warning that your limit will end.
- You will get another 1 million tokens after the end of the month.
- Can I have another limit? It would be best if you got the StackSpot AI Enterprise plan. For more information, you can send an email to the support team.
Monitor token usage
To access the Analytics section:
- Go to the StackSpot AI Portal;
- Click 'Analytics' button.