[BUG] Agents cannot pass custom info back to flyte

[ddl-rliu]

Proposed fix: #5604 flyteorg/flytekit#2426

Describe the bug

Agents may use the Resource object to pass some data back to flyte, but the CustomInfo field is not exposed in this object.

The solution is to enhance flytekit to add this field to the Resource object, and enhance flyte (flyteplugins webapi agent) to read this field from the agent response: flyteorg/flytekit#2426 https://github.com/flyteorg/flyte/pull/5604/files

Expected behavior

Agents should be able to pass custom info back to Flyte. See custom info under https://docs.flyte.org/en/latest/protos/docs/event/event.html#taskexecutionevent

Additional context to reproduce

No response

Screenshots

No response

Are you sure this issue hasn't been raised already?

• Yes

Have you read the Code of Conduct?

• Yes

[runllm]

The CustomInfo field is indeed a part of the TaskExecutionEvent in Flyte, but it is not currently exposed in the Resource object used by custom agents. According to this discussion, the custom_info field can be used to send plugin-specific execution event information back to Flyte. However, the current implementation does not support this directly.

To address this, Flytekit and Flyte need to be enhanced to include the custom_info field in the Resource object and ensure that Flyte can read this field from the agent response. This would involve updating the Flytekit library to add the custom_info field to the Resource object and modifying Flyte's backend to handle this new field appropriately.

Would you like more detailed steps on how to implement these changes?

Sources:

• Flyte Discussion on Custom Info

---

This is an AI-generated response and your feedback is appreciated! Please leave a 👍 if this is helpful and 👎 if it is not.

Mention @RunLLM to ask follow-up questions. See runllm.com for more!

[ddl-rliu]

FYI some PRs which implement a fix to this issue.

#5604 (this should land first)
flyteorg/flytekit#2426 (this should land last)

[ddl-rliu]

Closing since both PRs have been merged. Thanks! 🎉