theserverless.dev InferenceList

Compare

Add up to four models. The bill starts at 1M input tokens, 1M output tokens, and 1,000 units.

Monthly bill

Token models use the token counts. Other models use units times the flat rate.

Meta: Llama 3.1 70B Instruct$0.80
Beam 1.0 501B A23B$1.60

Lowest bill: Meta: Llama 3.1 70B Instruct · $0.80

Add another

Search by name, then add up to four.

Meta: Llama 3.1 70B InstructBeam 1.0 501B A23B
ProviderMetaTogether
Modalitytexttext
Context131K1.0M
Input$0.4/1M$0.4/1M
Output$0.4/1M$1.2/1M
Cache readNot published—$0.04/1M