Llama Guard 3 8B via Groq
Specifications
Context Window
8,192 tokens
Release Date
2024-07-23
Capabilities
Temperature
Availability
Open Weights
Model Overview
Groq provides ultra-fast AI inference powered by their custom LPU (Language Processing Unit) hardware. They host popular open-source models like LLaMA and Mixtral with industry-leading speed and low latency.
Llama Guard 3 8B is a llama-family model by Groq with a 8k token context window and up to 8k output tokens. It is priced at $0.2000/1M input tokens and $0.2000/1M output tokens.
Key capabilities include: temperature.
Details
ProviderGroq
Model IDllama-guard-3-8b
Familyllama
Release Date2024-07-23
Last Updated2024-07-23
Knowledge CutoffN/A
Context Window8,192 tokens
Max Output8,192 tokens
Input Cost / 1M$0.2000
Output Cost / 1M$0.2000
Developer Resources
More models from Groq
Frequently Asked Questions
How much does Llama Guard 3 8B cost to use?
Llama Guard 3 8B is priced at $0.2000/1M input tokens and $0.2000/1M output tokens. Use the cost estimator on this page to calculate your expected spend based on your usage pattern.
What is a token and how does it relate to pricing?
A token is a chunk of text — roughly ¾ of a word in English. For example, "chatbot" is two tokens. LLM API pricing is based on the number of tokens you send (input) and receive (output). Input tokens include your prompts, uploaded documents, and images, while output tokens are the model's generated responses.
Why are input and output tokens priced differently?
LLM providers charge separately for input and output tokens. Output tokens are typically more expensive because generating each token requires more compute — the model must run a full forward pass for every token it produces, while input tokens are processed in parallel.
What is the context window of Llama Guard 3 8B?
Llama Guard 3 8B supports a context window of 8,192 tokens. This is the maximum number of tokens (input + output combined) the model can process in a single request. Larger context windows let you send longer documents or maintain longer conversation histories.
How accurate is this cost estimation?
This tool provides a ballpark estimate based on per-token pricing. Actual costs may differ due to prompt caching, batched API calls, volume discounts, reasoning token overhead, and provider-specific billing rules. Use it for budgeting and comparison, not as an invoice prediction.
How does Llama Guard 3 8B pricing compare to other models?
You can compare Llama Guard 3 8B with other models on our LLM API pricing calculator. Use the cost estimator to see side-by-side cost breakdowns across different providers and models to find the best fit for your budget and requirements.
What factors affect my total API cost?
Your total cost depends on several factors: the number of API calls you make, the length of your prompts (input tokens), the length of generated responses (output tokens), whether you use features like image or document uploads (which add input tokens), and any provider-specific charges for caching or batch processing.
How can my team use Llama Guard 3 8B via API?
You can connect your own Groq API key and give your entire team access to Llama Guard 3 8B through TypingMind Teams. It lets you build a unified AI workspace where team members can use Llama Guard 3 8B and other models — without needing their own API keys. You stay in control of usage limits, costs, and permissions, all from a single dashboard.
