no plugin available nodes found

[fatelei]

Self Checks

To make sure we get to you in time, please check the following :)

• I have searched for existing issues search for existing issues, including closed ones.
• I confirm that I am using English to submit this report (我已阅读并同意 Language Policy).
• [FOR CHINESE USERS] 请务必使用英文提交 Issue，否则会被关闭。谢谢！:)
• "Please do not modify this template :) and fill in all the required fields."

Versions

1. dify-plugin-daemon Version
2. dify-api Version

Describe the bug

2026-03-16T09:10:03.084964Z WARN dify-plugin-daemon node.go:147 no plugin states found in redis scan_pattern=*:103a0b16381bfea92fef8b7e5c71946c6c67b4e877c381ffc5bd444f20a01468 hashed_plugin_id=103a0b16381bfea92fef8b7e5c71946c6c67b4e877c381ffc5bd444f20a01468
2026-03-16T09:10:03.084981Z WARN dify-plugin-daemon middleware.go:132 no plugin available nodes found, attempting lazy initialization plugin=8386ee39-663e-4e68-9a0b-af0deb6e41ca/openai_api_compatible:0.0.39@00c96519c8d8ff5314a716cdc83a3987eb89ad23df10e1283c824ac02e8d1c98
2026-03-16T09:10:03.084988Z ERROR dify-plugin-daemon middleware.go:138 lazy initialization failed error="lazy initialization not supported for remote debugging plugins" plugin=8386ee39-663e-4e68-9a0b-af0deb6e41ca/openai_api_compatible:0.0.39@00c96519c8d8ff5314a716cdc83a3987eb89ad23df10e1283c824ac02e8d1c98
github.com/langgenius/dify-plugin-daemon/internal/server.(*App).redirectPluginInvokeByPluginIdentifier
	/Users/fatelei/go/src/github.com/fatelei/dify-plugin-daemon/internal/server/middleware.go:138
github.com/langgenius/dify-plugin-daemon/internal/server.(*App).pluginDispatchGroup.(*App).RedirectPluginInvoke.func3
	/Users/fatelei/go/src/github.com/fatelei/dify-plugin-daemon/internal/server/middleware.go:107
github.com/gin-gonic/gin.(*Context).Next
	/Users/fatelei/go/pkg/mod/github.com/gin-gonic/gin@v1.11.0/context.go:192
github.com/langgenius/dify-plugin-daemon/internal/server.(*App).pluginDispatchGroup.(*App).FetchPluginInstallation.func2
	/Users/fatelei/go/src/github.com/fatelei/dify-plugin-daemon/internal/server/middleware.go:79
github.com/gin-gonic/gin.(*Context).Next
	/Users/fatelei/go/pkg/mod/github.com/gin-gonic/gin@v1.11.0/context.go:192
github.com/langgenius/dify-plugin-daemon/internal/server.(*App).pluginDispatchGroup.CollectActiveDispatchRequests.func1
	/Users/fatelei/go/src/github.com/fatelei/dify-plugin-daemon/internal/server/controllers/health_check.go:28
github.com/gin-gonic/gin.(*Context).Next
	/Users/fatelei/go/pkg/mod/github.com/gin-gonic/gin@v1.11.0/context.go:192
github.com/langgenius/dify-plugin-daemon/internal/server.(*App).pluginGroup.CheckingKey.func1
	/Users/fatelei/go/src/github.com/fatelei/dify-plugin-daemon/internal/server/middleware.go:27
github.com/gin-gonic/gin.(*Context).Next
	/Users/fatelei/go/pkg/mod/github.com/gin-gonic/gin@v1.11.0/context.go:192
github.com/langgenius/dify-plugin-daemon/internal/server.(*App).server.CollectActiveRequests.func7
	/Users/fatelei/go/src/github.com/fatelei/dify-plugin-daemon/internal/server/controllers/health_check.go:20
github.com/gin-gonic/gin.(*Context).Next
	/Users/fatelei/go/pkg/mod/github.com/gin-gonic/gin@v1.11.0/context.go:192
github.com/langgenius/dify-plugin-daemon/internal/server.(*App).server.LoggerMiddleware.LoggerMiddlewareWithConfig.func10
	/Users/fatelei/go/src/github.com/fatelei/dify-plugin-daemon/pkg/utils/log/middleware.go:64
github.com/gin-gonic/gin.(*Context).Next
	/Users/fatelei/go/pkg/mod/github.com/gin-gonic/gin@v1.11.0/context.go:192
github.com/langgenius/dify-plugin-daemon/internal/server.(*App).server.TraceMiddleware.func5
	/Users/fatelei/go/src/github.com/fatelei/dify-plugin-daemon/pkg/utils/log/middleware.go:36
github.com/gin-gonic/gin.(*Context).Next
	/Users/fatelei/go/pkg/mod/github.com/gin-gonic/gin@v1.11.0/context.go:192
github.com/langgenius/dify-plugin-daemon/internal/server.(*App).server.RecoveryMiddleware.func4
	/Users/fatelei/go/src/github.com/fatelei/dify-plugin-daemon/pkg/utils/log/middleware.go:108
github.com/gin-gonic/gin.(*Context).Next
	/Users/fatelei/go/pkg/mod/github.com/gin-gonic/gin@v1.11.0/context.go:192
github.com/gin-gonic/gin.(*Engine).handleHTTPRequest
	/Users/fatelei/go/pkg/mod/github.com/gin-gonic/gin@v1.11.0/gin.go:689
github.com/gin-gonic/gin.(*Engine).ServeHTTP
	/Users/fatelei/go/pkg/mod/github.com/gin-gonic/gin@v1.11.0/gin.go:643
net/http.serverHandler.ServeHTTP
	/opt/homebrew/Cellar/go/1.25.4/libexec/src/net/http/server.go:3340
net/http.(*conn).serve
	/opt/homebrew/Cellar/go/1.25.4/libexec/src/net/http/server.go:2109

2026-03-16T09:10:03.085179Z ERROR dify-plugin-daemon factory.go:28 PluginDaemonInternalServerError error="no available node, plugin runtime not found" traceback="goroutine 116 [running]:\nruntime/debug.Stack()\n\t/opt/homebrew/Cellar/go/1.25.4/libexec/src/runtime/debug/stack.go:26 +0x64\ngithub.com/langgenius/dify-plugin-daemon/internal/types/exception.InternalServerError({0x10375e5b8, 0x14000e087d0})\n\t/Users/fatelei/go/src/github.com/fatelei/dify-plugin-daemon/internal/types/exception/factory.go:27 +0x28\ngithub.com/langgenius/dify-plugin-daemon/internal/server.(*App).redirectPluginInvokeByPluginIdentifier(0x1400011ce60, 0x1400058eb00, {0x14000871710, 0x82}, {0x10375e5b8, 0x1050e5520})\n\t/Users/fatelei/go/src/github.com/fatelei/dify-plugin-daemon/internal/server/middleware.go:144 +0x39c\ngithub.com/langgenius/dify-plugin-daemon/internal/server.(*App).pluginDispatchGroup.(*App).RedirectPluginInvoke.func3(0x1400058eb00)\n\t/Users/fatelei/go/src/github.com/fatelei/dify-plugin-daemon/internal/server/middleware.go:107 +0x84\ngithub.com/gin-gonic/gin.(*Context).Next(0x1400058eb00)\n\t/Users/fatelei/go/pkg/mod/github.com/gin-gonic/gin@v1.11.0/context.go:192 +0x68\ngithub.com/langgenius/dify-plugin-daemon/internal/server.(*App).pluginDispatchGroup.(*App).FetchPluginInstallation.func2(0x1400058eb00)\n\t/Users/fatelei/go/src/github.com/fatelei/dify-plugin-daemon/internal/server/middleware.go:79 +0x1c0\ngithub.com/gin-gonic/gin.(*Context).Next(0x1400058eb00)\n\t/Users/fatelei/go/pkg/mod/github.com/gin-gonic/gin@v1.11.0/context.go:192 +0x68\ngithub.com/langgenius/dify-plugin-daemon/internal/server.(*App).pluginDispatchGroup.CollectActiveDispatchRequests.func1(0x140009655e8?)\n\t/Users/fatelei/go/src/github.com/fatelei/dify-plugin-daemon/internal/server/controllers/health_check.go:28 +0x5c\ngithub.com/gin-gonic/gin.(*Context).Next(0x1400058eb00)\n\t/Users/fatelei/go/pkg/mod/github.com/gin-gonic/gin@v1.11.0/context.go:192 +0x68\ngithub.com/langgenius/dify-plugin-daemon/internal/server.(*App).pluginGroup.CheckingKey.func1(0x1400058eb00)\n\t/Users/fatelei/go/src/github.com/fatelei/dify-plugin-daemon/internal/server/middleware.go:27 +0x94\ngithub.com/gin-gonic/gin.(*Context).Next(0x1400058eb00)\n\t/Users/fatelei/go/pkg/mod/github.com/gin-gonic/gin@v1.11.0/context.go:192 +0x68\ngithub.com/langgenius/dify-plugin-daemon/internal/server.(*App).server.CollectActiveRequests.func7(0x14000965668?)\n\t/Users/fatelei/go/src/github.com/fatelei/dify-plugin-daemon/internal/server/controllers/health_check.go:20 +0x5c\ngithub.com/gin-gonic/gin.(*Context).Next(0x1400058eb00)\n\t/Users/fatelei/go/pkg/mod/github.com/gin-gonic/gin@v1.11.0/context.go:192 +0x68\ngithub.com/langgenius/dify-plugin-daemon/internal/server.(*App).server.LoggerMiddleware.LoggerMiddlewareWithConfig.func10(0x1400058eb00)\n\t/Users/fatelei/go/src/github.com/fatelei/dify-plugin-daemon/pkg/utils/log/middleware.go:64 +0x80\ngithub.com/gin-gonic/gin.(*Context).Next(0x1400058eb00)\n\t/Users/fatelei/go/pkg/mod/github.com/gin-gonic/gin@v1.11.0/context.go:192 +0x68\ngithub.com/langgenius/dify-plugin-daemon/internal/server.(*App).server.TraceMiddleware.func5(0x1400058eb00)\n\t/Users/fatelei/go/src/github.com/fatelei/dify-plugin-daemon/pkg/utils/log/middleware.go:36 +0x158\ngithub.com/gin-gonic/gin.(*Context).Next(0x1400058eb00)\n\t/Users/fatelei/go/pkg/mod/github.com/gin-gonic/gin@v1.11.0/context.go:192 +0x68\ngithub.com/langgenius/dify-plugin-daemon/internal/server.(*App).server.RecoveryMiddleware.func4(0x14000965948?)\n\t/Users/fatelei/go/src/github.com/fatelei/dify-plugin-daemon/pkg/utils/log/middleware.go:108 +0x44\ngithub.com/gin-gonic/gin.(*Context).Next(0x1400058eb00)\n\t/Users/fatelei/go/pkg/mod/github.com/gin-gonic/gin@v1.11.0/context.go:192 +0x68\ngithub.com/gin-gonic/gin.(*Engine).handleHTTPRequest(0x14000140d00, 0x1400058eb00)\n\t/Users/fatelei/go/pkg/mod/github.com/gin-gonic/gin@v1.11.0/gin.go:689 +0x314\ngithub.com/gin-gonic/gin.(*Engine).ServeHTTP(0x14000140d00, {0x103791e50, 0x140007ae0f0}, 0x14000464dc0)\n\t/Users/fatelei/go/pkg/mod/github.com/gin-gonic/gin@v1.11.0/gin.go:643 +0x154\nnet/http.serverHandler.ServeHTTP({0x1037833d8?}, {0x103791e50?, 0x140007ae0f0?}, 0x6?)\n\t/opt/homebrew/Cellar/go/1.25.4/libexec/src/net/http/server.go:3340 +0xb0\nnet/http.(*conn).serve(0x140008de480, {0x1037969e8, 0x14000922060})\n\t/opt/homebrew/Cellar/go/1.25.4/libexec/src/net/http/server.go:2109 +0x528\ncreated by net/http.(*Server).Serve in goroutine 86\n\t/opt/homebrew/Cellar/go/1.25.4/libexec/src/net/http/server.go:3493 +0x384\n"
github.com/langgenius/dify-plugin-daemon/internal/types/exception.InternalServerError
	/Users/fatelei/go/src/github.com/fatelei/dify-plugin-daemon/internal/types/exception/factory.go:28
github.com/langgenius/dify-plugin-daemon/internal/server.(*App).redirectPluginInvokeByPluginIdentifier
	/Users/fatelei/go/src/github.com/fatelei/dify-plugin-daemon/internal/server/middleware.go:144
github.com/langgenius/dify-plugin-daemon/internal/server.(*App).pluginDispatchGroup.(*App).RedirectPluginInvoke.func3
	/Users/fatelei/go/src/github.com/fatelei/dify-plugin-daemon/internal/server/middleware.go:107
github.com/gin-gonic/gin.(*Context).Next
	/Users/fatelei/go/pkg/mod/github.com/gin-gonic/gin@v1.11.0/context.go:192
github.com/langgenius/dify-plugin-daemon/internal/server.(*App).pluginDispatchGroup.(*App).FetchPluginInstallation.func2
	/Users/fatelei/go/src/github.com/fatelei/dify-plugin-daemon/internal/server/middleware.go:79
github.com/gin-gonic/gin.(*Context).Next
	/Users/fatelei/go/pkg/mod/github.com/gin-gonic/gin@v1.11.0/context.go:192
github.com/langgenius/dify-plugin-daemon/internal/server.(*App).pluginDispatchGroup.CollectActiveDispatchRequests.func1
	/Users/fatelei/go/src/github.com/fatelei/dify-plugin-daemon/internal/server/controllers/health_check.go:28
github.com/gin-gonic/gin.(*Context).Next
	/Users/fatelei/go/pkg/mod/github.com/gin-gonic/gin@v1.11.0/context.go:192
github.com/langgenius/dify-plugin-daemon/internal/server.(*App).pluginGroup.CheckingKey.func1
	/Users/fatelei/go/src/github.com/fatelei/dify-plugin-daemon/internal/server/middleware.go:27
github.com/gin-gonic/gin.(*Context).Next
	/Users/fatelei/go/pkg/mod/github.com/gin-gonic/gin@v1.11.0/context.go:192
github.com/langgenius/dify-plugin-daemon/internal/server.(*App).server.CollectActiveRequests.func7
	/Users/fatelei/go/src/github.com/fatelei/dify-plugin-daemon/internal/server/controllers/health_check.go:20
github.com/gin-gonic/gin.(*Context).Next
	/Users/fatelei/go/pkg/mod/github.com/gin-gonic/gin@v1.11.0/context.go:192
github.com/langgenius/dify-plugin-daemon/internal/server.(*App).server.LoggerMiddleware.LoggerMiddlewareWithConfig.func10
	/Users/fatelei/go/src/github.com/fatelei/dify-plugin-daemon/pkg/utils/log/middleware.go:64
github.com/gin-gonic/gin.(*Context).Next
	/Users/fatelei/go/pkg/mod/github.com/gin-gonic/gin@v1.11.0/context.go:192
github.com/langgenius/dify-plugin-daemon/internal/server.(*App).server.TraceMiddleware.func5
	/Users/fatelei/go/src/github.com/fatelei/dify-plugin-daemon/pkg/utils/log/middleware.go:36
github.com/gin-gonic/gin.(*Context).Next
	/Users/fatelei/go/pkg/mod/github.com/gin-gonic/gin@v1.11.0/context.go:192
github.com/langgenius/dify-plugin-daemon/internal/server.(*App).server.RecoveryMiddleware.func4
	/Users/fatelei/go/src/github.com/fatelei/dify-plugin-daemon/pkg/utils/log/middleware.go:108
github.com/gin-gonic/gin.(*Context).Next
	/Users/fatelei/go/pkg/mod/github.com/gin-gonic/gin@v1.11.0/context.go:192
github.com/gin-gonic/gin.(*Engine).handleHTTPRequest
	/Users/fatelei/go/pkg/mod/github.com/gin-gonic/gin@v1.11.0/gin.go:689
github.com/gin-gonic/gin.(*Engine).ServeHTTP
	/Users/fatelei/go/pkg/mod/github.com/gin-gonic/gin@v1.11.0/gin.go:643
net/http.serverHandler.ServeHTTP
	/opt/homebrew/Cellar/go/1.25.4/libexec/src/net/http/server.go:3340
net/http.(*conn).serve
	/opt/homebrew/Cellar/go/1.25.4/libexec/src/net/http/server.go:2109

2026-03-16T09:10:03.085397Z WARN dify-plugin-daemon middleware.go:83 trace_id=14947c3f2bdd8b23d032d3fb02b3ae30 tenant_id=8386ee39-663e-4e68-9a0b-af0deb6e41ca HTTP request method=POST path=/plugin/8386ee39-663e-4e68-9a0b-af0deb6e41ca/dispatch/model/schema status=404 latency_ms=1 client_ip=127.0.0.1
2026-03-16T09:10:03.08787Z INFO dify-plugin-daemon middleware.go:83 trace_id=9450a81ae6712e841af52eced313ff5d tenant_id=8386ee39-663e-4e68-9a0b-af0deb6e41ca HTTP request client_ip=127.0.0.1 method=POST path=/plugin/8386ee39-663e-4e68-9a0b-af0deb6e41ca/debugging/key status=200 latency_ms=3
2026-03-16T09:10:03.112113Z INFO dify-plugin-daemon middleware.go:83 trace

To Reproduce
Steps to reproduce the behavior:

1. Go to '...'
2. Click on '....'
3. Scroll down to '....'
4. See error

Expected behavior
A clear and concise description of what you expected to happen.

Screenshots
If applicable, add screenshots to help explain your problem.

Additional context
Add any other context about the problem here.

[dosubot]

This is a known issue related to plugin cluster state synchronization, particularly with remote debugging plugins. Here's what's happening:

Root Cause: The plugin runtime state isn't being found in Redis when the daemon tries to route requests. This is tracked in issue #631 and related issues (#588, #577, #574).

Common causes:

1. Kubernetes multi-pod deployments: Plugin runtimes are stored in local in-memory maps per pod, not synchronized across the cluster
2. Version 0.5.2+ configuration requirements: Stricter configuration value consistency is now required
3. Remote plugin connect/disconnect timing: The plugin may disconnect before state is properly persisted

Potential workarounds:

• If running in Kubernetes with multiple pods, ensure cluster tunnel synchronization is properly configured
• For v0.5.2+, verify your configuration values match the version requirements
• Check that Redis is properly accessible and the plugin state keys are being written

Could you share:

• Are you running in a Kubernetes/multi-pod environment?
• What version of dify-plugin-daemon are you using?
• How are you running the remote debugging plugin?

To reply, just mention @dosu.

---

^{How did I do? Good | Irrelevant | Incorrect | Verbose | Hallucination | Report 🐛 | Other}