gemini-cli - 💡(How to fix) Fix Fix baseline measurements [1 participants]

TL;DR

Investigate the test harness to ensure it is measuring the CLI process instead of the test runner process to resolve the inconsistent baseline measurements.

Guidance

• Verify that the test harness is correctly configured to measure the CLI process, rather than the test runner process.
• Review the measurement collection logic to ensure it accurately captures the desired metrics for both small and large cases.
• Compare the measurement collection process between small and large cases to identify any discrepancies.
• Consider adding logging or debugging statements to the test harness to gain insight into which process is being measured.

Notes

The issue may be specific to the test harness configuration or the measurement collection logic, and further investigation is needed to determine the root cause.

Recommendation

Apply workaround: Modify the test harness to correctly measure the CLI process, as the current implementation may be causing inaccurate measurements.