theserverless.dev InferenceList

Compare

Add up to four models. The bill starts at 1M input tokens, 1M output tokens, and 1,000 units.

Monthly bill

Token models use the token counts. Other models use units times the flat rate.

Tencent: Hy3 preview$0.78
Meta Llama 3.1 8B Instruct Turbo$0.36

Lowest bill: Meta Llama 3.1 8B Instruct Turbo · $0.36

Add another

Search by name, then add up to four.

Tencent: Hy3 previewMeta Llama 3.1 8B Instruct Turbo
ProviderTencentTogether
Modalitytexttext
Context262K131K
Input$0.18/1M$0.18/1M
Output$0.6/1M$0.18/1M
Cache read$0.06/1MNot published—