Developers
Learn
Company
Sign in
Chat
Chat with and directly compare LLM endpoints
Benchmarks
Compare LLM endpoints with live performance benchmarks
Documentation
Learn how to use the Unify API
Blog
Read about LLM deployment infrastructure
Newsletter
Stay up to date with the latest in AI
Paper Readings
Join our discussions around cuttin-edge AI research
Talks
Dive deep with us into the AI landscape
Careers
Join our team and let’s Unify AI!
Contact
Reach out to our team
Privacy & Cookies
How we treat your navigation data
Terms Of Service
General requirements for using our Service
Socials
Follow us through our social accounts:
Sign in
Chat
Chat with and directly compare LLM endpoints
Benchmarks
Compare LLM endpoints with live performance benchmarks
Documentation
Learn how to use the Unify API
Blog
Read about LLM deployment infrastructure
Newsletter
Stay up to date with the latest in AI
Paper Readings
Join our discussions around cuttin-edge AI research
Talks
Dive deep with us into the AI landscape
Careers
Join our team and let’s Unify AI!
Contact
Reach out to our team
Privacy & Cookies
How we treat your navigation data
Terms Of Service
General requirements for using our Service
Socials
Follow us through our social accounts:
Back to Benchmarks
mixtral-8x7b-instruct-v0.1
text-generation
Uploaded: 09.01.2024
⏱️ Benchmarks
📑 API Docs
✨ Query this model
Region:
Hong Kong
Belgium
Iowa
Seq Length:
Short
Long
Providers
together-ai
octoai
replicate
mistral-ai
perplexity-ai
anyscale
fireworks-ai
lepton-ai
deepinfra
aws-bedrock
Learn more about how we are collecting this data
here
Input Cost
Output Cost
Output Tks / Sec
P
90
_{P90}
P
9
0
TTFT
P
90
_{P90}
P
9
0
ITL
P
90
_{P90}
P
9
0
E2E Latency
P
90
_{P90}
P
9
0
Cold Start
0.6 $/1M tks
0.6 $/1M tks
231.95 tks/sec
358.21 ms
4.31 ms
1203.21 ms
0 sec
0.3 $/1M tks
0.5 $/1M tks
83.5 tks/sec
687.88 ms
11.98 ms
2675.99 ms
0 sec
0.3 $/1M tks
1 $/1M tks
63.43 tks/sec
868.36 ms
15.77 ms
3217.5 ms
0 sec
0.7 $/1M tks
0.7 $/1M tks
106.98 tks/sec
362.77 ms
9.35 ms
1877.11 ms
0 sec
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
Not computed
0.5 $/1M tks
0.5 $/1M tks
53.45 tks/sec
1320.13 ms
18.71 ms
4444.76 ms
0 sec
0.5 $/1M tks
0.5 $/1M tks
289.09 tks/sec
316.5 ms
3.46 ms
908.01 ms
0 sec
0.5 $/1M tks
0.5 $/1M tks
108 tks/sec
2949.53 ms
9.26 ms
4440.25 ms
0 sec
0.27 $/1M tks
0.27 $/1M tks
58.96 tks/sec
660.45 ms
16.96 ms
3543.55 ms
0 sec
0.45 $/1M tks
0.7 $/1M tks
66.51 tks/sec
713.96 ms
15.03 ms
3435.29 ms
0 sec