Import extremely slow

[raffaelemancuso]

NBI takes 80 seconds to import.

That's extremely slow.

How can I speed it up?

I don't have Github copilot, Amazon BedRock or the like. Only Claude Code.

Here is the full log:

2026-06-08 08:04:54,498 - traitlets - utils.py - INFO - Extension package notebook_intelligence took 80.5213s to import
[I 2026-06-08 08:04:54.535 ServerApp] jupyter_lsp | extension was successfully linked.
[I 2026-06-08 08:04:54.536 ServerApp] jupyter_resource_usage | extension was successfully linked.
[I 2026-06-08 08:04:54.546 ServerApp] jupyter_server_terminals | extension was successfully linked.
[I 2026-06-08 08:04:54.554 ServerApp] jupyterlab | extension was successfully linked.
[I 2026-06-08 08:04:54.554 ServerApp] jupyterlab_git | extension was successfully linked.
[I 2026-06-08 08:04:54.554 ServerApp] jupyterlab_jupytext | extension was successfully linked.
[I 2026-06-08 08:04:54.554 ServerApp] jupyterlab_latex | extension was successfully linked.
[I 2026-06-08 08:04:54.554 ServerApp] jupyterlab_tabular_data_viewer_extension | extension was successfully linked.
[I 2026-06-08 08:04:54.555 ServerApp] jupyterlab_vscode_icons_extension | extension was successfully linked.
[I 2026-06-08 08:04:54.555 ServerApp] nbdime | extension was successfully linked.
[I 2026-06-08 08:04:54.561 ServerApp] notebook_intelligence | extension was successfully linked.
[I 2026-06-08 08:05:07.199 ServerApp] notebook_shim | extension was successfully linked.
[I 2026-06-08 08:05:07.835 ServerApp] notebook_shim | extension was successfully loaded.
[I 2026-06-08 08:05:07.838 ServerApp] jupyter_lsp | extension was successfully loaded.
[I 2026-06-08 08:05:07.840 ServerApp] jupyter_resource_usage | extension was successfully loaded.
[I 2026-06-08 08:05:07.841 ServerApp] jupyter_server_terminals | extension was successfully loaded.
[I 2026-06-08 08:05:07.868 LabApp] JupyterLab extension loaded from my-jupyterlab\.venv\Lib\site-packages\jupyterlab
[I 2026-06-08 08:05:07.868 LabApp] JupyterLab application directory is my-jupyterlab\.venv\share\jupyter\lab
[I 2026-06-08 08:05:07.869 LabApp] Extension Manager is 'pypi'.
[I 2026-06-08 08:05:07.898 ServerApp] jupyterlab | extension was successfully loaded.
[I 2026-06-08 08:05:08.014 ServerApp] jupyterlab_git | extension was successfully loaded.
[I 2026-06-08 08:05:08.015 ServerApp] [Jupytext Server Extension] Deriving an AsyncTextFileContentsManager from AsyncLargeFileManager
[I 2026-06-08 08:05:08.018 ServerApp] jupyterlab_jupytext | extension was successfully loaded.
[I 2026-06-08 08:05:08.156 ServerApp] jupyterlab_latex | extension was successfully loaded.
[I 2026-06-08 08:05:08.158 ServerApp] Registered jupyterlab_tabular_data_viewer_extension server extension
[I 2026-06-08 08:05:08.159 ServerApp] jupyterlab_tabular_data_viewer_extension | extension was successfully loaded.
[I 2026-06-08 08:05:08.180 ServerApp] jupyterlab_vscode_icons_extension server extension loaded
[I 2026-06-08 08:05:08.180 ServerApp] jupyterlab_vscode_icons_extension | extension was successfully loaded.
[I 2026-06-08 08:05:10.805 ServerApp] nbdime | extension was successfully loaded.
2026-06-08 08:05:12,829 - notebook_intelligence.llm_providers.ollama_llm_provider - ollama_llm_provider.py - WARNING - Failed to update supported Ollama models: Failed to connect to Ollama. Please check that Ollama is downloaded, running and accessible. https://ollama.com/download
2026-06-08 08:05:13,751 - notebook_intelligence.github_copilot - github_copilot.py - INFO - Using existing GitHub access token
2026-06-08 08:05:13,751 - notebook_intelligence.github_copilot - github_copilot.py - INFO - Refreshing GitHub token
[I 2026-06-08 08:05:13.777 ServerApp] Registered notebook_intelligence server extension
[I 2026-06-08 08:05:13.777 ServerApp] notebook_intelligence | extension was successfully loaded.
[I 2026-06-08 08:05:13.783 ServerApp] Serving notebooks from local directory: [ABRIDGED]
[I 2026-06-08 08:05:13.784 ServerApp] Jupyter Server 2.19.0 is running at:
[I 2026-06-08 08:05:13.784 ServerApp] http://localhost:8888/lab?token=[ABRIDGED]
[I 2026-06-08 08:05:13.784 ServerApp]     http://127.0.0.1:8888/lab?token=[ABRIDGED]
[I 2026-06-08 08:05:13.784 ServerApp] Use Control-C to stop this server and shut down all kernels (twice to skip confirmation).
2026-06-08 08:05:13,798 - notebook_intelligence.claude - claude.py - WARNING - Failed to fetch Claude models: "Could not resolve authentication method. Expected one of api_key, auth_token, or credentials to be set. Or for one of the `X-Api-Key` or `Authorization` headers to be explicitly omitted"
[C 2026-06-08 08:05:13.877 ServerApp]

    To access the server, open this file in a browser:
        file:[ABRIDGED]/jupyter/runtime/jpserver-11700-open.html
    Or copy and paste one of these URLs:
        http://localhost:8888/lab?token=[ABRIDGED]
        http://127.0.0.1:8888/lab?token=[ABRIDGED]
[I 2026-06-08 08:05:14.727 ServerApp] Skipped non-installed server(s): basedpyright, bash-language-server, dockerfile-language-server-nodejs, javascript-typescript-langserver, jedi-language-server, julia-language-server, pyrefly, pyright, python-language-server, sql-language-server, texlab, typescript-language-server, unified-language-server, vscode-css-languageserver-bin, vscode-html-languageserver-bin, vscode-json-languageserver-bin, yaml-language-server
2026-06-08 08:05:19,227 - notebook_intelligence.claude - claude.py - WARNING - Failed to fetch Claude models: "Could not resolve authentication method. Expected one of api_key, auth_token, or credentials to be set. Or for one of the `X-Api-Key` or `Authorization` headers to be explicitly omitted"
2026-06-08 08:05:19,345 - notebook_intelligence.extension - extension.py - INFO - Copilot WS upgrade accepted user='[ABRIDGED]' origin='http://localhost:[ABRIDGED]'
[W 2026-06-08 08:05:19.345 ServerApp] The websocket_ping_timeout (90000) cannot be longer than the websocket_ping_interval (30000).
    Setting websocket_ping_timeout=30000
[I 2026-06-08 08:05:19.504 LabApp] Build is up to date
2026-06-08 08:05:27,877 - notebook_intelligence.claude - claude.py - WARNING - Claude agent did not reach a terminal connect state within 15.0s
2026-06-08 08:05:27,909 - notebook_intelligence.claude - claude.py - WARNING - Failed to fetch Claude models: "Could not resolve authentication method. Expected one of api_key, auth_token, or credentials to be set. Or for one of the `X-Api-Key` or `Authorization` headers to be explicitly omitted"

[pjdoland]

Thanks for the detailed log, that helps a lot. The slow line is the one-time Python import of NBI at server startup:

Extension package notebook_intelligence took 80.5213s to import

The underlying reason is that NBI currently imports every provider backend at startup, including litellm (a very heavy package, roughly 3,400 files), even though you only use Claude. On macOS/Linux that whole import is a few seconds; on Windows a couple of things can blow it up to what you're seeing. Here is how to pin it down and improve it on your side.

1. Find the actual bottleneck (2 minutes)

Run this in the same environment and look at the largest entries:

python -X importtime -c "import notebook_intelligence" 2> importtime.log

Then run it a second time (warm vs cold makes a big difference). If one entry near litellm / get_model_cost_map / httpx dominates, it's a network stall (step 2). If the time is spread across thousands of small submodule imports, it's filesystem/antivirus/OneDrive (steps 3 and 4).

2. Stop litellm's network call at import (easy, safe)

litellm fetches a model-cost file over HTTP when it is imported (with a 5s timeout), which can stall badly behind a corporate proxy or TLS inspection. Set this before launching Jupyter:

# Windows (PowerShell)
$env:LITELLM_LOCAL_MODEL_COST_MAP = "true"

I measured litellm's import dropping from ~2.0s to ~1.0s with this even on a fast machine with good network, so the win is larger when the network is the problem.

3. Make sure the environment is not under OneDrive

On Windows 11, OneDrive often backs up your Desktop and Documents automatically, and a .venv living there gets intercepted on every file read, which is brutal for a 7,000-file import. Check the real path of my-jupyterlab: if it resolves under a ...\OneDrive\... folder, recreate the environment on a plain local path like C:\dev\my-jupyterlab and it should speed up significantly.

4. If antivirus is the cause, exclude the env folder

Real-time scanning checks each file as it is opened. Adding a Microsoft Defender folder exclusion for your environment (Windows Security > Virus & threat protection > Manage settings > Exclusions > Add folder) usually helps. One caveat: an excluded folder is no longer scanned, so apply it knowingly to just the env folder. Microsoft's "Dev Drive" performance mode is a safer alternative if you prefer to keep scanning on.

On our side

You shouldn't have to import litellm at all when you only use Claude. I opened #370 to make NBI lazy-load provider backends so single-provider users skip that cost entirely. We'll look into it.

One unrelated thing in your log

Your Claude requests are failing auth, separate from the speed issue:

Failed to fetch Claude models: "Could not resolve authentication method..."
Claude agent did not reach a terminal connect state within 15.0s

That means Claude isn't authenticated in NBI yet (no Anthropic API key, or the Claude CLI isn't logged in). Worth sorting out separately so Claude mode actually works once startup is faster. The Ollama warning is harmless (it's just that no local Ollama is running).

[raffaelemancuso]

@pjdoland

Hi!

Is this answer AI-generated?

Because I see no reason why my environment should be under OneDrive and I use another antivirus, not Microsoft Defender

[raffaelemancuso]

Also, please be assured that claude CLI is logged in

[pjdoland]

Hey @raffaelemancuso, fair question!

Honest answer: yeah, I used Claude to help brainstorm the likely causes, then did my own digging to narrow it down. So the list of suspects was AI-assisted, but here's where I landed: my prime suspect is your antivirus scanning a big pile of small files as they load, not Defender or OneDrive specifically. Let's confirm it rather than assume, though (the importtime step below settles it).

Quick course-corrections based on what you said:

• OneDrive: not under it? Then ignore that one. Just a common Windows gotcha worth checking, not an assumption about your setup.
• Antivirus: doesn't matter that it's not Defender. Pretty much every real-time AV (Norton, McAfee, Kaspersky, Bitdefender, etc.) scans each file as it's opened. NBI currently imports the whole provider stack at startup, and litellm alone ships ~3,400 files, so a lot of small files get opened on import. In bad cases, scanning all of those on open is enough to stretch a few-second import into something much slower. I can't promise it's the entire 80s, which is exactly why the check below matters.

Two things worth trying no matter what:

1. python -X importtime -c "import notebook_intelligence" 2> importtime.log (run it twice). This basically settles it: if the time is spread across thousands of tiny imports, it's filesystem/AV; if it's concentrated in litellm, it's a network stall. Paste the file here and I'll tell you which.
2. LITELLM_LOCAL_MODEL_COST_MAP=true to stop litellm's network call at import. I checked, it cuts litellm's load time by about a third on a good connection, and more if the network is the bottleneck.

To confirm the AV theory directly: add an exclusion for your environment folder in whatever AV you use, or briefly turn off real-time protection, and re-time the import. Just scope the exclusion to that folder, flip protection back on after, and if it's a work machine check with IT first.

And honestly, you shouldn't be importing litellm at all when you only use Claude. That's the real fix and it's on us, tracked in #370.

On the Claude auth thing, you're right and I jumped the gun, sorry. That Failed to fetch Claude models: Could not resolve authentication method line is a separate, direct Anthropic API call NBI makes just to fill the model dropdown (it needs an Anthropic API key in NBI's settings, or the ANTHROPIC_API_KEY env var). It doesn't mean your CLI login is broken or that Claude mode won't work, those run off your logged-in CLI. The did not reach a terminal connect state within 15.0s is a separate agent-startup timeout, not auth. Could be the same slowness, could be the CLI taking too long to come up; if it keeps happening it's worth a closer look.

[raffaelemancuso]

Do I have to delete something before calling python -X importtime -c "import notebook_intelligence" 2> importtime.log for a true cold start?

[pjdoland]

Good question, and no, you don't need to delete anything.

Deleting __pycache__ would only reset Python's bytecode compilation, which is a one-time cost after install and doesn't repeat on every launch, so it's very unlikely to be your 80s. Skip it.

The thing that actually makes a repeat run faster is the OS file cache (the files are still in RAM from the last run), and partly your AV's scan cache. Those live in memory and clear on a reboot, not by deleting files. (Heads up: some AVs also keep a known-good list on disk that survives reboots, so a reboot resets the OS cache cleanly but only part of the AV side.)

So for the closest thing to a true cold start: reboot, then run the command a few times in a row as the very first thing you do, before opening Jupyter or anything else. The first run is your cold start; the repeats are warm.

How to read it:

• If that first (cold) run is much slower than the warm repeats, the cost is some cold-cache layer (OS file cache, AV scanning, etc.), which fits the "lots of small files getting scanned/read" theory.
• If every run is slow by about the same amount, it's a per-process cost instead, like litellm re-fetching its model-cost map (it does that on every fresh python process, there's no cross-process cache) or just CPU.

To actually pin it on the AV (and fix it at the same time): add an exclusion for your environment folder, or briefly turn off real-time scanning, then re-run. If the cold run speeds up, that's your culprit.

Paste the logs from a couple of runs and I'll tell you which it is.

[raffaelemancuso]

Here it is.

I hope it helps.

importtime_run1.log
importtime_run2.log

[pjdoland]

Thanks, that's exactly what I needed. Two things jump out.

First, the good news: your two runs came in at about 6.5s and 4.25s, not 80s. That points to the original 80s being a one-off cold start, very likely the first import right after install, when bytecode gets compiled across the whole dependency tree, files are read cold off disk, and your AV possibly scans everything freshly written, all of which later runs skip. We never caught an importtime during the actual 80s, so I can't say for certain, but if it ever recurs at anything like that, grab an importtime during the slow start and we'll compare.

Where the time actually goes (warm run, ~4.25s):

• litellm and its submodules: ~1.3s, the single biggest piece, plus openai ~0.4s. You use neither, so that ~1.7s is all overhead you don't need. That's the lazy-load fix I filed in perf(startup): lazy-import provider SDKs to cut server-extension import time #370.
• Your first run is ~2.3s slower than the second, spread across the dependency tree (litellm, pywin32, mcp, anthropic, and so on). That gap is cold-disk reads plus AV possibly scanning of freshly-touched files, which is why a cold start genuinely costs more; an AV exclusion for the env folder should trim it.
• anthropic ~0.5s, plus claude_agent_sdk and mcp, are the parts you actually need.
• About 0.6s is rfc3987_syntax, a grammar-building import that comes in via jsonschema (pulled by jupyter_events and mcp), not litellm. It's a Jupyter-stack cost, so it's not really ours to remove.

You can set LITELLM_LOCAL_MODEL_COST_MAP=true to skip a network call litellm makes on every import. It's a small, free win; the fetch is bundled into litellm's own startup time, so you can't read an exact savings off these logs. The bigger win, ~1.7s, is #370 on our side.

Short version: the steady-state import is heavy but not crazy (your runs were ~4 to 6.5s), the 80s looks like a cold-start outlier, and the most impactful fix is us not loading litellm for Claude-only users.

[raffaelemancuso]

Any news on this?