theserverless.dev InferenceList

Compare

Add up to four models. The bill starts at 1M input tokens, 1M output tokens, and 1,000 units.

Monthly bill

Token models use the token counts. Other models use units times the flat rate.

Meta Llama 3.1 8B Instruct Awq Int4No published price
Fish Audio: S2.1 Pro Free (free)$0.00

Lowest bill: Fish Audio: S2.1 Pro Free (free) · $0.00

Add another

Search by name, then add up to four.

Meta Llama 3.1 8B Instruct Awq Int4Fish Audio: S2.1 Pro Free (free)
ProviderTogetherFish Audio
Modalitytexttext, audio
Context131K—
InputNot published—$0/1M
OutputNot published—$0/1M