Loading...
Loading...
Llama-3.1-Nemotron-Ultra-253B-v1 is a large language model (LLM) optimized for advanced reasoning, human-interactive chat, retrieval-augmented generation (RAG), and tool-calling tasks. Derived from Meta’s Llama-3.1-405B-Instruct, it has been significantly customized using Neural Architecture Search (NAS), resulting in enhanced efficiency, reduced memory usage, and improved inference latency. The model supports a context length of up to 128K tokens and can operate efficiently on an 8x NVIDIA H100 node. Note: you must include `detailed thinking on` in the system prompt to enable reasoning. Please see [Usage Recommendations](https://huggingface.co/nvidia/Llama-3_1-Nemotron-Ultra-253B-v1#quick-start-and-usage-recommendations) for more.
Price/1M
$0.90
469th cheapest
190% above median
Top 70%
Context Window
131K
145th largest
Top 63%
Input
$0.60
per 1M tokens
Output
$1.80
per 1M tokens
Blended
$0.90
per 1M tokens
Cheaper than 30% of models. Median price is $0.31/1M tokens.
Daily
$0.90
Monthly
$27.00
Context Window
131K
tokens
Larger than 37% of models
Context Window Comparison