Bump nnsight from 0.5.12 to 0.5.13

[dependabot]

Bumps nnsight from 0.5.12 to 0.5.13.

Release notes

Sourced from nnsight's releases.

v0.5.13

Release Notes:

v0.5.13

1. nnsight support for vLLM inference has been complexly refactored and works with the latest version of vLLM, including tensor parallelism. Enabling fast inference on multi-GPU models with NNsight interventions!

if __name__ == "__main__":
    from nnsight.modeling.vllm import VLLM
model = VLLM("meta-llama/Llama-3.1-8B", dispatch=True, tensor_parallel_size=2)
with model.trace(
"The Eiffel Tower is located in the city of",
temperatur=0.8,
max_tokens=30,
) as tracer:
activations = list().save()
logits = list().save()
samples = list().save()

with tracer.iter[:30]:
    activations.append(model.model.layers[16].mlp.down_proj.output[0].cpu())
    logits = logits.append(model.logits.output)
    samples.append(model.samples.output)

output = tracer.result.save()

Feedback on our vLLM integration would be much appreciated.

Works with vLLM>=0.12

2. Optimizations to interleaving induced performance improvements across the board. Noticeable when doing a significant amount of interventions.

In addition, there are three config flags you can set which see a much greater improvement but require code changes or are more experimental.

from nnsight import CONFIG as NNSIGHT_CONFIG
NNSIGHT_CONFIG.APP.PYMOUNT = False
NNSIGHT_CONFIG.APP.CROSS_INVOKER = False
NNSIGHT_CONFIG.APP.TRACE_CACHING = True

• PYMOUNT: Turning this flag off removes the ability to call .save() on arbitrary objects and instead will require you to call nnsight.save

</tr></table> 

... (truncated)

Commits

• cc4161d Merge pull request #565 from ndif-team/dev
• bb50efd Merge pull request #564 from ndif-team/performance
• 400fc5d Add user cache back
• 32548c4 Directly patch the model runner class as a change from vllm 0.12 -> 0.13 dyna...
• 2949d53 More performance updates in interleaver.
• da99ce6 Trace caching
• d81c0f1 remove totalbatchsize caching in bacther. dont need
• 05115a6 Dont wrap decorators in nnsight inject for .source
• 2cbc36f Merge pull request #558 from ndif-team/vllmv1
• 342d019 bug
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[vercel]

The latest updates on your projects. Learn more about Vercel for GitHub.

Project	Deployment	Review	Updated (UTC)
workbench	Error		Dec 22, 2025 3:28pm

[dependabot]

Looks like nnsight is up-to-date now, so this is no longer needed.