Megaservice / orchestrator metric testing + fixes

[eero-t]

Description

Adds test code for orchestrator.py metrics, and fixes for bugs revealed by the test code.

Issues

• First token count was wrong in some situations
• CI does not verify that orchestrator actually processed all tokens
• CI was missing tests for orchestrator metrics

Type of change

List the type of change like below. Please delete options that are not relevant.

• Bug fix (non-breaking change which fixes an issue)
• Others (added test code)

Dependencies

n/a

Tests

• Manual testing with ChatQnA, on top of working (earlier) GenAIComps code
• New CI test

[codecov]

Codecov Report

Attention: Patch coverage is 66.66667% with 1 line in your changes missing coverage. Please review.

Files with missing lines	Patch %	Lines
comps/cores/mega/orchestrator.py	66.66%	1 Missing ⚠️

Files with missing lines	Coverage Δ
comps/cores/mega/orchestrator.py	90.87% <66.66%> (-0.35%)	⬇️