跳到正文
DEV Community· Jem·· 2 天前AI 評分28

Prompt Pad:甚麼是上下文窗口?

Prompt Pad: What Is a Context Window?

AI 導讀

Prompt Pad 解釋上下文窗口是模型一次可讀取、處理和記住的文字上限,以模型 token 計量。對話超出上限時,最早的內容會被移出窗口;窗口越大,模型單次對話可處理的內容越多。

正文

Cover image for Prompt Pad: What Is a Context Window?

Major League Hacking (MLH) profile image Jem

Ever had an AI forget something you told it earlier in the same conversation? There's a reason for that.

In this episode of Prompt Pad, @rosendo_pili explains context windows, the short-term working memory behind every AI conversation.

The video in a nutshell

A context window is the maximum amount of text a model can read, process, and remember at one time. It's measured in tokens, which are chunks of words. A model with a 128k context window can take in a full book at once. But once your conversation goes past that limit, the earliest details get pushed out of the window. The larger the context window, the more a model can work with in a single session.

Try it yourself

Check the context window size of the model you use most. Then tell us in the comments: have you ever hit the limit in a long conversation? 👇


📣 Help us spread the word

Know someone who's confused about why their AI "forgets"? Send them this video. And subscribe so you don't miss the next Prompt Pad tip:

來源:DEV Community · dev.to