n8n - 💡(How to fix) Fix Binary file gets lost on some executions [2 comments, 3 participants]

Describe the problem/error/question

On some executions of the following workflow: https://jobandtalent.app.n8n.cloud/workflow/kOZ7k739Dmujt2q0/executions/243028 the binary file gets lost and cannot get found on the second subworkflow. This workflow is supposed to post this file with some parameters to an external service to extract information from it. The fact that sometimes it works and sometimes it does not with the same input seems very weird and no documentation of this error was found.

What is the error message (if any)?

• error: all

TL;DR

The binary file loss in the n8n workflow may be due to the binary mode being set to filesystem, which could lead to file system limitations or concurrency issues.

Guidance

• Check the binaryMode setting in the storage configuration, as filesystem mode might be causing issues with concurrent executions.
• Verify that the file system has sufficient permissions and space to store the binary files.
• Consider changing the binaryMode to database to store binary data in the database instead of the file system, which might improve reliability.
• Review the workflow's concurrency setting (currently set to 200) and consider reducing it to see if it alleviates the issue.

Example

No code snippet is provided as the issue seems related to configuration and workflow settings.

Notes

The fact that the issue occurs intermittently with the same input suggests that it might be related to the workflow's execution environment or concurrency. The binaryMode setting and concurrency limit are potential contributing factors.

Recommendation

Apply workaround: Change the binaryMode to database to store binary data in the database, which might improve reliability and reduce the likelihood of file loss.