跳到正文
Mistral AI·· 2024-11-07精選AI 評分62

Mistral AI 推出 Batch API,批次請求成本較同步 API 呼叫低 50%

Mistral Batch API

AI 導讀

Mistral AI 推出 Batch API,讓 La Plateforme 上的 Mistral 模型以批次方式處理高流量請求,成本比同步 API 呼叫低 50%。

推薦理由

Batch API 將高流量請求的成本降至同步 API 呼叫的一半,並以檔案提交、處理後下載的流程,適合不要求同步回覆的批量任務。

正文 · 原文

This could've been a tweet, but... While the AI developer community was faced with several API price hikes in the past few weeks, we’re trying to make sure to continue bringing frontier AI to you at affordable price points. To that end, we’re introducing the batch API, available today on La Plateforme.

The batch API introduces a more efficient way to process high-volume requests to Mistral models at 50% lower cost than that of a synchronous API call. If you’re building AI applications where you prioritize volume of data over synchronous responses, the batch API can be an ideal solution. You simply upload your batch file, and once the requests have been processed, download and use the output file. For detailed instructions, check out our batch API documentation.

Popular applications for the batch API include customer feedback and sentiment analysis, document summarization and translation in bulk, vector embedding to prepare search indexes, and data labeling.

The batch API is available for all models served on la Plateforme, and coming soon to our cloud provider partners. Rate of usage is limited to 1 million ongoing requests per workspace.

Please be sure to let us know what you think, and contact us for custom or private deployments.

來源:Mistral AI · mistral.ai