Model library

Model GPU requirements, cost, and remote deployment guides

Browse model-specific pages for GPU requirements, cost estimates, and how to run popular open models without owning local GPU hardware.

Estimate a routeRead the guides
Templates
3 per model
Each model includes requirements, cost, and remote-execution pages.
Best for
Concrete planning
Use these pages when you already know which model you want to run.
Next step
Price the route
Move from model research into a real workload estimate.

How to use this library

Start with the model and the route question you actually have

Most teams start with one of three questions: what GPU does this model need, what will it cost to run, or can I test it without buying hardware. This library is organized around those three questions for each model.

Use the requirements page first if you need to size the route, the cost page if you are budgeting, and the run-without-GPU page if you want the fastest path to testing.

Related pages

Model families and starting pages

Choose a model to review its GPU requirements, then continue to cost or remote-execution guidance.

LLaMALLaMA 3.1 8BA common open-weight baseline for chat, agents, and lightweight application inference. Start with requirements, then branch into cost or remote execution.LLaMALLaMA 3.1 70BA heavyweight route that usually forces buyers to think hard about fit, price, and deployment strategy. Start with requirements, then branch into cost or remote execution.LLaMALLaMA 3.2 3BA smaller general-purpose model that opens up cheaper deployment routes and lighter-edge patterns. Start with requirements, then branch into cost or remote execution.MistralMistral 7BA widely used compact model family for cost-aware production inference. Start with requirements, then branch into cost or remote execution.MistralMixtral 8x7BA more demanding route that often pushes teams into multi-GPU or premium-capacity decisions. Start with requirements, then branch into cost or remote execution.QwenQwen 2.5 7BA strong open-model candidate for teams evaluating multilingual or general-purpose workloads. Start with requirements, then branch into cost or remote execution.QwenQwen 2.5 72BA premium route where placement quality and cost estimation matter more than ever. Start with requirements, then branch into cost or remote execution.DeepSeekDeepSeek-R1-Distill-Llama-8BA reasoning-focused open model that teams often evaluate for agent and workflow-heavy use cases. Start with requirements, then branch into cost or remote execution.WhisperWhisper Large v3A practical speech model for transcription pipelines, batch audio jobs, and speech features. Start with requirements, then branch into cost or remote execution.FLUXFLUX.1-devA creative-model route for image generation teams comparing throughput, VRAM, and cost. Start with requirements, then branch into cost or remote execution.GemmaGemma 2 9BA practical open model for teams that want solid quality on 24GB-class routes without jumping to premium 70B economics. Start with requirements, then branch into cost or remote execution.GemmaGemma 2 27BA stronger open model for teams that want better quality than compact routes while staying below the operational weight of top-end giant models. Start with requirements, then branch into cost or remote execution.PhiPhi-3 Mini 4K InstructA small open model that is attractive when teams want low-cost experimentation, fast feedback loops, and broad deployability. Start with requirements, then branch into cost or remote execution.QwenQwen 2.5 32BA strong multilingual route for teams that want more capability than 7B and 8B models without fully stepping into the heaviest giant-model tier. Start with requirements, then branch into cost or remote execution.
About the author and sourcing