dify - 💡(How to fix) Fix Plugin unable to add model [9 comments, 3 participants]

Official PRs (…)
ON THIS PAGE

Recommended Tools

×6

Utilities matched from this issue’s tags and category — try them while you read without losing context.

GitHub issue graph ai analysis

Paste a GitHub issue URL. We fetch that issue, discover linked issues from bodies/comments/timeline, collect linked pull requests, and produce a structured English report.

The report is written in English Markdown for sharing and archival.

Helpful · Quick feedback

Loading…
GitHub stats
langgenius/dify#35452Fetched 2026-04-22 08:04:08
View on GitHub
Comments
9
Participants
3
Timeline
12
Reactions
1
Author
Timeline (top)
commented ×9cross-referenced ×1mentioned ×1subscribed ×1

Error Message

Firstly, package the VLLM plugin offline, install the plugin locally successfully, and then add the Qwen3.5 model to report an Internal Server Error 2026-04-21 05:48:56.392 ERROR [Dummy-138] [base.py:305] 34f0b649a92b547fbc97291ed2ff37a1 - Error in stream response for plugin {'code': -500, 'message': '{"message":"no proper instance","error_type":"PluginDaemonInternalServerError","args":null}', 'data': None} 2026-04-21 05:48:56.393 ERROR [Dummy-138] [app.py:875] 34f0b649a92b547fbc97291ed2ff37a1 - Exception on /console/api/workspaces/current/model-providers/yangyaofei/vllm/vllm/models/credentials [POST] Traceback (most recent call last): self._handle_plugin_daemon_error(error.error_type, error.message) 2026-04-21 05:49:04.916 WARNING [Dummy-139] [version.py:61] 4d80edad4b3050d28aa02e76365311c8 - Check update version error: [Errno 101] Network is unreachabl

Fix Action

Fix / Workaround

2026-04-21 05:48:56.392 ERROR [Dummy-138] [base.py:305] 34f0b649a92b547fbc97291ed2ff37a1 - Error in stream response for plugin {'code': -500, 'message': '{"message":"no proper instance","error_type":"PluginDaemonInternalServerError","args":null}', 'data': None} 2026-04-21 05:48:56.393 ERROR [Dummy-138] [app.py:875] 34f0b649a92b547fbc97291ed2ff37a1 - Exception on /console/api/workspaces/current/model-providers/yangyaofei/vllm/vllm/models/credentials [POST] Traceback (most recent call last): File "/app/api/.venv/lib/python3.12/site-packages/flask/app.py", line 917, in full_dispatch_request rv = self.dispatch_request() ^^^^^^^^^^^^^^^^^^^^^^^ File "/app/api/.venv/lib/python3.12/site-packages/flask/app.py", line 902, in dispatch_request return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/api/.venv/lib/python3.12/site-packages/flask_restx/api.py", line 404, in wrapper resp = resource(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/api/.venv/lib/python3.12/site-packages/flask/views.py", line 110, in view return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/api/.venv/lib/python3.12/site-packages/flask_restx/resource.py", line 41, in dispatch_request resp = meth(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/app/api/controllers/console/wraps.py", line 227, in decorated return view(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/app/api/libs/login.py", line 97, in decorated_view return current_app.ensure_sync(func)(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/api/controllers/console/wraps.py", line 337, in decorated_function return f(*args, **kwargs) ^^^^^^^^^^^^^^^^^^ File "/app/api/controllers/console/wraps.py", line 48, in decorated return view(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/app/api/controllers/console/workspace/models.py", line 322, in post model_provider_service.create_model_credential( File "/app/api/services/model_provider_service.py", line 282, in create_model_credential provider_configuration.create_custom_model_credential( File "/app/api/core/entities/provider_configuration.py", line 944, in create_custom_model_credential credentials = self.validate_custom_model_credentials( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/api/core/entities/provider_configuration.py", line 917, in validate_custom_model_credentials return _validate(session) ^^^^^^^^^^^^^^^^^^ File "/app/api/core/entities/provider_configuration.py", line 906, in _validate validated_credentials = model_provider_factory.model_credentials_validate( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/api/dify_graph/model_runtime/model_providers/model_provider_factory.py", line 165, in model_credentials_validate self.plugin_model_manager.validate_model_credentials( File "/app/api/core/plugin/impl/model.py", line 137, in validate_model_credentials for resp in response: ^^^^^^^^ File "/app/api/core/plugin/impl/base.py", line 306, in _request_with_plugin_daemon_response_stream self._handle_plugin_daemon_error(error.error_type, error.message) File "/app/api/core/plugin/impl/base.py", line 349, in _handle_plugin_daemon_error raise PluginDaemonInternalServerError(description=message) core.plugin.impl.exc.PluginDaemonInternalServerError: req_id: bf0b212ab0 PluginDaemonInternalServerError: no proper instance 2026-04-21 05:49:04.916 WARNING [Dummy-139] [version.py:61] 4d80edad4b3050d28aa02e76365311c8 - Check update version error: [Errno 101] Network is unreachabl

RAW_BUFFERClick to expand / collapse

Self Checks

  • I have read the Contributing Guide and Language Policy.
  • This is only for bug report, if you would like to ask a question, please head to Discussions.
  • I have searched for existing issues search for existing issues, including closed ones.
  • I confirm that I am using English to submit this report, otherwise it will be closed.
  • 【中文用户 & Non English User】请使用英语提交,否则会被关闭 :)
  • Please do not modify this template :) and fill in all the required fields.

Dify version

1.13.3

Cloud or Self Hosted

Self Hosted (Docker)

Steps to reproduce

Firstly, package the VLLM plugin offline, install the plugin locally successfully, and then add the Qwen3.5 model to report an Internal Server Error

✔️ Expected Behavior

The model is installed

❌ Actual Behavior

2026-04-21 05:48:56.392 ERROR [Dummy-138] [base.py:305] 34f0b649a92b547fbc97291ed2ff37a1 - Error in stream response for plugin {'code': -500, 'message': '{"message":"no proper instance","error_type":"PluginDaemonInternalServerError","args":null}', 'data': None} 2026-04-21 05:48:56.393 ERROR [Dummy-138] [app.py:875] 34f0b649a92b547fbc97291ed2ff37a1 - Exception on /console/api/workspaces/current/model-providers/yangyaofei/vllm/vllm/models/credentials [POST] Traceback (most recent call last): File "/app/api/.venv/lib/python3.12/site-packages/flask/app.py", line 917, in full_dispatch_request rv = self.dispatch_request() ^^^^^^^^^^^^^^^^^^^^^^^ File "/app/api/.venv/lib/python3.12/site-packages/flask/app.py", line 902, in dispatch_request return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) # type: ignore[no-any-return] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/api/.venv/lib/python3.12/site-packages/flask_restx/api.py", line 404, in wrapper resp = resource(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/api/.venv/lib/python3.12/site-packages/flask/views.py", line 110, in view return current_app.ensure_sync(self.dispatch_request)(**kwargs) # type: ignore[no-any-return] ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/api/.venv/lib/python3.12/site-packages/flask_restx/resource.py", line 41, in dispatch_request resp = meth(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/app/api/controllers/console/wraps.py", line 227, in decorated return view(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/app/api/libs/login.py", line 97, in decorated_view return current_app.ensure_sync(func)(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/api/controllers/console/wraps.py", line 337, in decorated_function return f(*args, **kwargs) ^^^^^^^^^^^^^^^^^^ File "/app/api/controllers/console/wraps.py", line 48, in decorated return view(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^ File "/app/api/controllers/console/workspace/models.py", line 322, in post model_provider_service.create_model_credential( File "/app/api/services/model_provider_service.py", line 282, in create_model_credential provider_configuration.create_custom_model_credential( File "/app/api/core/entities/provider_configuration.py", line 944, in create_custom_model_credential credentials = self.validate_custom_model_credentials( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/api/core/entities/provider_configuration.py", line 917, in validate_custom_model_credentials return _validate(session) ^^^^^^^^^^^^^^^^^^ File "/app/api/core/entities/provider_configuration.py", line 906, in _validate validated_credentials = model_provider_factory.model_credentials_validate( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/api/dify_graph/model_runtime/model_providers/model_provider_factory.py", line 165, in model_credentials_validate self.plugin_model_manager.validate_model_credentials( File "/app/api/core/plugin/impl/model.py", line 137, in validate_model_credentials for resp in response: ^^^^^^^^ File "/app/api/core/plugin/impl/base.py", line 306, in _request_with_plugin_daemon_response_stream self._handle_plugin_daemon_error(error.error_type, error.message) File "/app/api/core/plugin/impl/base.py", line 349, in _handle_plugin_daemon_error raise PluginDaemonInternalServerError(description=message) core.plugin.impl.exc.PluginDaemonInternalServerError: req_id: bf0b212ab0 PluginDaemonInternalServerError: no proper instance 2026-04-21 05:49:04.916 WARNING [Dummy-139] [version.py:61] 4d80edad4b3050d28aa02e76365311c8 - Check update version error: [Errno 101] Network is unreachabl

extent analysis

TL;DR

The issue can be resolved by ensuring a proper instance of the plugin daemon is running and configured correctly for the VLLM plugin.

Guidance

  • Verify that the VLLM plugin is properly installed and configured, and that the plugin daemon is running and accessible.
  • Check the plugin daemon logs for any errors or issues that may be preventing it from functioning correctly.
  • Ensure that the model_provider_factory and plugin_model_manager are correctly configured and instantiated.
  • Review the create_custom_model_credential method in provider_configuration.py to ensure it is correctly handling the plugin daemon response.

Example

No code example is provided as the issue seems to be related to plugin configuration and daemon management, which requires more context and specific code changes.

Notes

The issue may be related to the plugin daemon not being properly instantiated or configured, or a network issue preventing the plugin daemon from being reached. Further investigation into the plugin daemon logs and configuration is necessary to determine the root cause.

Recommendation

Apply workaround: Verify and reconfigure the plugin daemon and VLLM plugin installation to ensure proper instantiation and accessibility. This may involve restarting the plugin daemon or re-installing the VLLM plugin.

Vote matrix · Quick signals

Works
Did the solution work? Tap to confirm.
Easy Fix
Was it a quick fix?
Time Saver
Did it save you time?
Blocking
Was it severely blocking?
Common Issue
Are others likely hitting this too?
Flaky / Intermittent
Is it intermittent?
Verified / Reproducible
Can you reproduce it reliably?
Loading…

Still need to ship something?

×6

Another batch ranked right after the header list — different links, same matching logic.

Back to top recommendations

TRENDING

dify - 💡(How to fix) Fix Plugin unable to add model [9 comments, 3 participants]