ollama - 💡(How to fix) Fix Ollama leaving orphaned files after safetensors import [2 comments, 2 participants]

TL;DR

Using the FILE_FLAG_DELETE_ON_CLOSE flag when creating files in the blobs directory may prevent orphaned files from accumulating after model conversion.

Guidance

• Investigate the Windows API for creating files with the FILE_FLAG_DELETE_ON_CLOSE flag to ensure it automatically deletes files when they are closed, regardless of the conversion outcome.
• Research the equivalent flags or methods for Linux and Mac to ensure cross-platform compatibility.
• Consider implementing a cleanup mechanism to remove unused files from the blobs directory, in case the flag approach does not cover all scenarios.
• Verify that using such a flag does not interfere with the normal functioning of the model conversion process.

Example

No example provided due to lack of specific code context.

Notes

The effectiveness of this approach may depend on how the files in the blobs directory are handled and closed after use. Additionally, ensuring the solution works across different operating systems is crucial.

Recommendation

Apply workaround: Using the FILE_FLAG_DELETE_ON_CLOSE flag or its equivalents seems promising for preventing orphaned files, but thorough testing is necessary to confirm its suitability and cross-platform compatibility.