[HUDI-8498] Fix the async compaction task configuration error in CompactOperator

[usberkeley]

Change Logs

In the CompactOperator, the Async Compaction configuration was mistakenly used for executing Compaction Task configurations, resulting in Compaction Tasks only being executed asynchronously when using Async Compaction.

Impact

none

Risk level (write none, low medium or high below)

none

Documentation Update

none

Contributor's checklist

• Read through contributor's guide
• Change Logs and Impact were stated clearly
• Adequate tests were added if applicable
• CI passed

[hudi-bot]

CI report:

• 9f72744 UNKNOWN
• b2874f6 UNKNOWN
• 42ae12b UNKNOWN
• dcebb34 UNKNOWN
• 6df0643 UNKNOWN
• 2254304 Azure: SUCCESS

Bot commands

@hudi-bot supports the following commands:

• @hudi-bot run azure re-run the last Azure build

[usberkeley]

@danny0405 hello, Danny. Could you please help review this?

[usberkeley]

Background of Flink MOR Compaction

Inline Compaction: Will block writing, sequentially execute Write and Compaction.
Async Compaction: Will not block writing, and not block the checkpoint by executing in thread pool

Why is this PR no longer needed?

This PR implements async compaction + blocking checkpoint (executed in a single thread). In real-world scenarios, users won't use it this way; its only purpose is for CI testing. CC @danny0405 @voonhous