Llama 3.2 1B Instruct FP8 dynamic

RedHatAI·Released 2024-09-25

Open Source1BLlama 3.2

Open Source

1.6M

Downloads (30d)

3

Likes

llama3.2

Meta's license allowing commercial use with restrictions for large-scale deployments.

Hardware Requirements

Parameters1B

Est. VRAM (FP16)4-8 GB

Example GPURTX 3060 / M1

Qwen2.5 1.5B quantized.w8a8

RedHatAI

Llama 3.2 1B Instruct FP8

RedHatAI

GPT-5.4 (xhigh)

OpenAI

Gemini 3.1 Pro Preview

Google

GPT-5.3 Codex (xhigh)

OpenAI

Claude Opus 4.6 (Adaptive Reasoning, Max Effort)

Anthropic