openclaw - 💡(How to fix) Fix [Feature]: 需要能够获取模型推理的TTFT [1 participants]

TL;DR

Adding support for calculating TTFT by including the first chunk receive timestamp in the pi-agent's stream output events is the most likely fix.

Guidance

• Review the pi-agent's stream output events to determine the feasibility of adding a timestamp for the first chunk receive time.
• Calculate TTFT by subtracting the first chunk receive timestamp from the token out timestamp.
• Verify that the added timestamp does not interfere with existing event processing logic.
• Consider adding error handling for cases where the first chunk receive timestamp is missing or invalid.

Example

No code snippet is provided due to lack of specific technical details in the issue.

Notes

The solution assumes that the first chunk receive timestamp can be accurately obtained and added to the pi-agent's stream output events. The issue lacks specific technical details, so the guidance is limited to general suggestions.

Recommendation

Apply workaround: Add support for calculating TTFT by including the first chunk receive timestamp in the pi-agent's stream output events, as this is the proposed solution that directly addresses the problem.