Mistral 7B

Mistral 7B is a 7.3B parameter language model celebrated for its efficiency, outperforming larger models on many benchmarks. The v0.3 instruct version is specifically fine-tuned for chat and instruction-following tasks.

MistralAI Chat 32K Tokens
Get API Key
Try in Playground
Free Trial Credit No Credit Card Required
$1.00

api_example.sh

curl -X POST "https://platform.qubrid.com/chat/completions" \
  -H "Authorization: Bearer $QUBRID_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
  "model": "mistralai/Mistral-7B-Instruct-v0.3",
  "messages": [
    {
      "role": "user",
      "content": "Explain quantum computing in simple terms"
    }
  ],
  "temperature": 0.7,
  "max_tokens": 500
}'

Technical Specifications

Model Architecture & Performance

Model Size 7.3B params
Context Length 32K Tokens
Quantization fp16
Tokens/Second 386
License Apache 2.0
Release Date July 2024
Developers Mistral AI

Pricing

Pay-per-use, no commitments

Input Tokens $0.00021/1K Tokens
Output Tokens $0.00025/1K Tokens

API Reference

Complete parameter documentation

ParameterTypeDefaultDescription
streambooleantrueEnable streaming responses for real-time output.
temperaturenumber0.7Controls randomness. Higher values mean more creative but less predictable output.
max_tokensnumber4096Maximum number of tokens to generate in the response.
top_pnumber1Nucleus sampling: considers tokens with top_p probability mass.

Explore the full request and response schema in our external API documentation

Performance

Strengths & considerations

StrengthsConsiderations
Fast inference speed
Low memory footprint
Excellent instruction following
High performance for its size
Smaller context window compared to largest models
Can struggle with highly complex, multi-step reasoning

Enterprise
Platform Integration

Docker

Docker Support

Official Docker images for containerized deployments

Kubernetes

Kubernetes Ready

Production-grade KBS manifests and Helm charts

SDK

SDK Libraries

Official SDKs for Python, Javascript, Go, and Java

Don't let your AI control you. Control your AI the Qubrid way!

Have questions? Want to Partner with us? Looking for larger deployments or custom fine-tuning? Let's collaborate on the right setup for your workloads.

"Qubrid's medical OCR and research parsing cut our document extraction time in half. We now have traceable pipelines and reproducible outputs that meet our compliance requirements."

Clinical AI Team

Research & Clinical Intelligence