dify - 💡(How to fix) Fix General Chunker returns empty chunks causing embedding failure (MissingParameter: input[n].text) [1 comments, 2 participants]

Self Checks

• I have read the Contributing Guide and Language Policy.
• This is only for bug report, if you would like to ask a question, please head to Discussions.
• I have searched for existing issues search for existing issues, including closed ones.
• I confirm that I am using English to submit this report, otherwise it will be closed.
• 【中文用户 & Non English User】请使用英语提交，否则会被关闭 ：）
• Please do not modify this template :) and fill in all the required fields.

Dify version

1.13.3

Cloud or Self Hosted

Self Hosted (Source)

Steps to reproduce

langgenius / general_chunker version 0.0.11

1. Create a workflow in Dify that includes: A document input (e.g., Markdown, TXT, or parsed content) The General Chunker plugin A Knowledge Base (indexing) node

2. Prepare a document that contains multiple consecutive line breaks or sparse content, for example:

foo bar

baz

1. Configure the General Chunker with: Delimiter: \n\n (or default settings) Default chunking strategy Run the workflow and inspect the output of the General Chunker.

2. Observe that the returned result contains empty chunks, for example:

{
  "chunks": [
    "foo bar",
    "",
    "baz",
    ""
  ]
}

1. Pass the chunker output directly into the Knowledge Base node for indexing. Execute the workflow.

2. Observe that the indexing step fails with an embedding error:

3. Use pipeline to add docuement ， Error code: 400 - MissingParameter param: input[n].text

2026-04-30 07:50:22,899 ERROR [base.py:305] Error in stream response for plugin {'code': -500, 'message': '{"message":"{\\"args\\":{\\"description\\":\\"[models] Error: Error code: 400 - {\'error\': {\'code\': \'MissingParameter\', \'message\': \'The request failed because it is missing one or multiple required parameters. Request id: 02177753542296168d44c5a45de4f1e59cc8a01ee3524bc111cec\', \'param\': \'input[3].text\', \'type\': \'BadRequest\'}}, request_id: 20260430075022FxoLiGnPeCo75J4wxt76\\"},\\"error_type\\":\\"InvokeError\\",\\"message\\":\\"[models] Error: Error code: 400 - {\'error\': {\'code\': \'MissingParameter\', \'message\': \'The request failed because it is missing one or multiple required parameters. Request id: 02177753542296168d44c5a45de4f1e59cc8a01ee3524bc111cec\', \'param\': \'input[3].text\', \'type\': \'BadRequest\'}}, request_id: 20260430075022FxoLiGnPeCo75J4wxt76\\"}","error_type":"PluginInvokeError","args":null}', 'data': None} 2026-04-30 07:50:22,902 ERROR [cached_embedding.py:104] Failed to embed documents Traceback (most recent call last): File "D:\workspace-ai\dify\api\core\rag\embedding\cached_embedding.py", line 67, in embed_documents embedding_result = self._model_instance.invoke_text_embedding( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\workspace-ai\dify\api\core\model_manager.py", line 219, in invoke_text_embedding self._round_robin_invoke( File "D:\workspace-ai\dify\api\core\model_manager.py", line 420, in _round_robin_invoke return function(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\workspace-ai\dify\api\dify_graph\model_runtime\model_providers\__base\text_embedding_model.py", line 67, in invoke raise self._transform_invoke_error(e) File "D:\workspace-ai\dify\api\dify_graph\model_runtime\model_providers\__base\text_embedding_model.py", line 44, in invoke return plugin_model_manager.invoke_text_embedding( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\workspace-ai\dify\api\core\plugin\impl\model.py", line 273, in invoke_text_embedding for resp in response: ^^^^^^^^ File "D:\workspace-ai\dify\api\core\plugin\impl\base.py", line 306, in _request_with_plugin_daemon_response_stream self._handle_plugin_daemon_error(error.error_type, error.message) File "D:\workspace-ai\dify\api\core\plugin\impl\base.py", line 347, in _handle_plugin_daemon_error raise PluginInvokeError(description=message) core.plugin.impl.exc.PluginInvokeError: req_id: PluginInvokeError: {"args":{"description":"[models] Error: Error code: 400 - {'error': {'code': 'MissingParameter', 'message': 'The request failed because it is missing one or multiple required parameters. Request id: 02177753542296168d44c5a45de4f1e59cc8a01ee3524bc111cec', 'param': 'input[3].text', 'type': 'BadRequest'}}, request_id: 20260430075022FxoLiGnPeCo75J4wxt76"},"error_type":"InvokeError","message":"[models] Error: Error code: 400 - {'error': {'code': 'MissingParameter', 'message': 'The request failed because it is missing one or multiple required parameters. Request id: 02177753542296168d44c5a45de4f1e59cc8a01ee3524bc111cec', 'param': 'input[3].text', 'type': 'BadRequest'}}, request_id: 20260430075022FxoLiGnPeCo75J4wxt76"} 2026-04-30 07:50:22,905 ERROR [knowledge_index_node.py:115] req_id: PluginInvokeError: {"args":{"description":"[models] Error: Error code: 400 - {'error': {'code': 'MissingParameter', 'message': 'The request failed because it is missing one or multiple required parameters. Request id: 02177753542296168d44c5a45de4f1e59cc8a01ee3524bc111cec', 'param': 'input[3].text', 'type': 'BadRequest'}}, request_id: 20260430075022FxoLiGnPeCo75J4wxt76"},"error_type":"InvokeError","message":"[models] Error: Error code: 400 - {'error': {'code': 'MissingParameter', 'message': 'The request failed because it is missing one or multiple required parameters. Request id: 02177753542296168d44c5a45de4f1e59cc8a01ee3524bc111cec', 'param': 'input[3].text', 'type': 'BadRequest'}}, request_id: 20260430075022FxoLiGnPeCo75J4wxt76"} Traceback (most recent call last): File "D:\workspace-ai\dify\api\core\workflow\nodes\knowledge_index\knowledge_index_node.py", line 95, in _run results = self._invoke_knowledge_index( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\workspace-ai\dify\api\core\workflow\nodes\knowledge_index\knowledge_index_node.py", line 135, in _invoke_knowledge_index rst = self.index_processor.index_and_clean( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\workspace-ai\dify\api\core\rag\index_processor\index_processor.py", line 92, in index_and_clean index_processor.index(dataset, document, chunks) File "D:\workspace-ai\dify\api\core\rag\index_processor\processor\paragraph_index_processor.py", line 258, in index vector.create(documents) File "D:\workspace-ai\dify\api\core\rag\datasource\vdb\vector_factory.py", line 211, in create batch_embeddings = self._embeddings.embed_documents([document.page_content for document in batch]) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\workspace-ai\dify\api\core\rag\embedding\cached_embedding.py", line 105, in embed_documents raise ex File "D:\workspace-ai\dify\api\core\rag\embedding\cached_embedding.py", line 67, in embed_documents embedding_result = self._model_instance.invoke_text_embedding( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\workspace-ai\dify\api\core\model_manager.py", line 219, in invoke_text_embedding self._round_robin_invoke( File "D:\workspace-ai\dify\api\core\model_manager.py", line 420, in _round_robin_invoke return function(*args, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\workspace-ai\dify\api\dify_graph\model_runtime\model_providers\__base\text_embedding_model.py", line 67, in invoke raise self._transform_invoke_error(e) File "D:\workspace-ai\dify\api\dify_graph\model_runtime\model_providers\__base\text_embedding_model.py", line 44, in invoke return plugin_model_manager.invoke_text_embedding( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\workspace-ai\dify\api\core\plugin\impl\model.py", line 273, in invoke_text_embedding for resp in response: ^^^^^^^^ File "D:\workspace-ai\dify\api\core\plugin\impl\base.py", line 306, in _request_with_plugin_daemon_response_stream self._handle_plugin_daemon_error(error.error_type, error.message) File "D:\workspace-ai\dify\api\core\plugin\impl\base.py", line 347, in _handle_plugin_daemon_error raise PluginInvokeError(description=message) core.plugin.impl.exc.PluginInvokeError: req_id: PluginInvokeError: {"args":{"description":"[models] Error: Error code: 400 - {'error': {'code': 'MissingParameter', 'message': 'The request failed because it is missing one or multiple required parameters. Request id: 02177753542296168d44c5a45de4f1e59cc8a01ee3524bc111cec', 'param': 'input[3].text', 'type': 'BadRequest'}}, request_id: 20260430075022FxoLiGnPeCo75J4wxt76"},"error_type":"InvokeError","message":"[models] Error: Error code: 400 - {'error': {'code': 'MissingParameter', 'message': 'The request failed because it is missing one or multiple required parameters. Request id: 02177753542296168d44c5a45de4f1e59cc8a01ee3524bc111cec', 'param': 'input[3].text', 'type': 'BadRequest'}}, request_id: 20260430075022FxoLiGnPeCo75J4wxt76"} 2026-04-30 07:50:22,911 ERROR [error_handler.py:101] Node knowledgeBase failed with ABORT strategy: req_id: PluginInvokeError: {"args":{"description":"[models] Error: Error code: 400 - {'error': {'code': 'MissingParameter', 'message': 'The request failed because it is missing one or multiple required parameters. Request id: 02177753542296168d44c5a45de4f1e59cc8a01ee3524bc111cec', 'param': 'input[3].text', 'type': 'BadRequest'}}, request_id: 20260430075022FxoLiGnPeCo75J4wxt76"},"error_type":"InvokeError","message":"[models] Error: Error code: 400 - {'error': {'code': 'MissingParameter', 'message': 'The request failed because it is missing one or multiple required parameters. Request id: 02177753542296168d44c5a45de4f1e59cc8a01ee3524bc111cec', 'param': 'input[3].text', 'type': 'BadRequest'}}, request_id: 20260430075022FxoLiGnPeCo75J4wxt76"}

✔️ Expected Behavior

The General Chunker plugin always returns not empty strings { "chunks": [ "foo bar", "xxx", "yyyy", "zzzz" ] }

❌ Actual Behavior

The General Chunker plugin sometimes returns empty strings in the generated chunks. These empty chunks are then passed to the embedding model, which causes the indexing process to fail.

Example output from the chunker:

{ "chunks": [ "foo bar", "", "", "" ] }

The empty strings ("") are not filtered out and are sent to the embedding API.