跳到正文
TechPowerUp· DrUsmanSaleem·· 12 天前AI 評分63

Microsoft 副總裁 Scott Hanselman 開發 gputaskman,追蹤各程序的 GPU 記憶體佔用

Microsoft Developer Builds a GPU Task Manager to Show Which Apps Are Eating Your VRAM

AI 導讀

Microsoft 副總裁 Scott Hanselman 開發並開放試用 gputaskman,這款免費開源終端工具會列出使用 GPU 的程序及其記憶體佔用。

正文

Anyone wondering what is filling up their GPU's VRAM can now try gputaskman, a free, open-source tool from Microsoft VP Scott Hanselman. It runs in a terminal window with an htop-style layout and lists every process using the GPU with its memory footprint, engine activity, and loaded runtime, such as CUDA or Vulkan. A panel up top tracks utilization, clocks, temperature, and power. Hanselman shared the project on X last week and asked for pull requests.

Task Manager has shown GPU usage since 2017, and it will happily tell you that 15 GB of video memory is in use. It just won't say what is using it. gputaskman goes after that gap with a heavy focus on local AI. Its model inspector can identify the LLM a process has loaded and report its quantization, weights, and estimated KV cache cost, while Ollama and LM Studio users also get context size and proper model names. Hanselman calls it early, experimental software, and the AI breakdowns are estimates for now.

On Windows, only NVIDIA and AMD GPUs are supported currently, and Intel support is limited to native Linux as of v0.3.5. There's also a native Windows ARM64 build, though it's unclear whether anyone has tested it on RTX Spark machines like the Surface Laptop Ultra. When a user said they want this detail in the built-in Task Manager, Hanselman replied "step one...;)", which is a hint at best. The portable Windows builds are also unsigned.

來源:TechPowerUp · techpowerup.com