Llama 3.1 8B via STACKIT
Specifications
Context Window
128,000 tokens
Release Date
2024-07-23
Capabilities
Tool callingStructured outputTemperature
Availability
Open Weights
Model Overview
STACKIT is the cloud platform of the Schwarz Group (Lidl/Kaufland), offering AI model inference with European data sovereignty and enterprise-grade security.
Llama 3.1 8B is a llama-family model by STACKIT with a 128k token context window and up to 8k output tokens. It is priced at $0.1600/1M input tokens and $0.2700/1M output tokens.
Key capabilities include: tool calling, structured output, temperature. It can call external tools and functions for agentic workflows.
Details
ProviderSTACKIT
Model IDneuralmagic/Meta-Llama-3.1-8B-Instruct-FP8
Familyllama
Release Date2024-07-23
Last Updated2024-07-23
Knowledge CutoffN/A
Context Window128,000 tokens
Max Output8,192 tokens
Input Cost / 1M$0.1600
Output Cost / 1M$0.2700
More models from STACKIT
Frequently Asked Questions
How much does Llama 3.1 8B cost to use?
Llama 3.1 8B is priced at $0.1600/1M input tokens and $0.2700/1M output tokens. Use the cost estimator on this page to calculate your expected spend based on your usage pattern.
What is a token and how does it relate to pricing?
A token is a chunk of text — roughly ¾ of a word in English. For example, "chatbot" is two tokens. LLM API pricing is based on the number of tokens you send (input) and receive (output). Input tokens include your prompts, uploaded documents, and images, while output tokens are the model's generated responses.
Why are input and output tokens priced differently?
LLM providers charge separately for input and output tokens. Output tokens are typically more expensive because generating each token requires more compute — the model must run a full forward pass for every token it produces, while input tokens are processed in parallel.
What is the context window of Llama 3.1 8B?
Llama 3.1 8B supports a context window of 128,000 tokens. This is the maximum number of tokens (input + output combined) the model can process in a single request. Larger context windows let you send longer documents or maintain longer conversation histories.
How accurate is this cost estimation?
This tool provides a ballpark estimate based on per-token pricing. Actual costs may differ due to prompt caching, batched API calls, volume discounts, reasoning token overhead, and provider-specific billing rules. Use it for budgeting and comparison, not as an invoice prediction.
How does Llama 3.1 8B pricing compare to other models?
You can compare Llama 3.1 8B with other models on our LLM API pricing calculator. Use the cost estimator to see side-by-side cost breakdowns across different providers and models to find the best fit for your budget and requirements.
What factors affect my total API cost?
Your total cost depends on several factors: the number of API calls you make, the length of your prompts (input tokens), the length of generated responses (output tokens), whether you use features like image or document uploads (which add input tokens), and any provider-specific charges for caching or batch processing.
How can my team use Llama 3.1 8B via API?
You can connect your own STACKIT API key and give your entire team access to Llama 3.1 8B through TypingMind Teams. It lets you build a unified AI workspace where team members can use Llama 3.1 8B and other models — without needing their own API keys. You stay in control of usage limits, costs, and permissions, all from a single dashboard.
