Skip to content

[server] Adjust limiting throttler at faster rate #611

[server] Adjust limiting throttler at faster rate

[server] Adjust limiting throttler at faster rate #611

GitHub Actions / IntegrationTests_1410 Test Reports succeeded Mar 5, 2025 in 0s

142 passed, 2 failed and 0 skipped

Tests failed

Report Passed Failed Skipped Time
IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.kafka.consumer.AdminConsumptionTaskIntegrationTest.xml 4✅ 1❌ 605s
IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.migration.TestMigrationPushStrategyZKAccessor.xml 2✅ 350ms
IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServer.xml 38✅ 279s
IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServerAcl.xml 2✅ 1s
IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServerGetLeader.xml 1✅ 449ms
IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServerWithMultiServers.xml 9✅ 19s
IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkWithMocks.xml 14✅ 2s
IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestBackupControllerResponse.xml 1✅ 29s
internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.kafka.consumer.AdminConsumptionTaskIntegrationTest.xml 4✅ 1❌ 605s
internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.migration.TestMigrationPushStrategyZKAccessor.xml 2✅ 350ms
internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServer.xml 38✅ 279s
internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServerAcl.xml 2✅ 1s
internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServerGetLeader.xml 1✅ 449ms
internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServerWithMultiServers.xml 9✅ 19s
internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkWithMocks.xml 14✅ 2s
internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestBackupControllerResponse.xml 1✅ 29s

❌ IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.kafka.consumer.AdminConsumptionTaskIntegrationTest.xml

5 tests were completed in 605s with 4 passed, 1 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.kafka.consumer.AdminConsumptionTaskIntegrationTest 4✅ 1❌ 605s

❌ com.linkedin.venice.controller.kafka.consumer.AdminConsumptionTaskIntegrationTest

✅ testAdminConsumptionTaskWithSpecificWriterId
✅ testParallelAdminExecutionTasks
❌ testSkipMessageEndToEnd
	org.testng.internal.thread.ThreadTimeoutException: Method com.linkedin.venice.controller.kafka.consumer.AdminConsumptionTaskIntegrationTest.testSkipMessageEndToEnd() didn't finish within the time-out 60000
✅ testUpdateAdminOperationVersion
✅ testSkipMessageEndToEnd

✅ IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.migration.TestMigrationPushStrategyZKAccessor.xml

2 tests were completed in 350ms with 2 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.migration.TestMigrationPushStrategyZKAccessor 2✅ 350ms

✅ com.linkedin.venice.controller.migration.TestMigrationPushStrategyZKAccessor

✅ testCreateAndUpdatePushStrategy
✅ testSetInvalidStrategy

✅ IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServer.xml

38 tests were completed in 279s with 38 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.server.TestAdminSparkServer 38✅ 279s

✅ com.linkedin.venice.controller.server.TestAdminSparkServer

✅ canCreateAHybridStore
✅ controllerCanGetDeletableStoreTopics
✅ controllerCanHandleLargePayload
✅ controllerClientCanCreateNewStore
✅ controllerClientCanDeleteAllVersion
✅ controllerClientCanDeleteOldVersion
✅ controllerClientCanDeleteStore
✅ controllerClientCanDisableStoresRead
✅ controllerClientCanDisableStoresReadWrite
✅ controllerClientCanDisableStoresWrite
✅ controllerClientCanDiscoverCluster
✅ controllerClientCanEnableMaxCapacityProtection
✅ controllerClientCanEnableThrottling
✅ controllerClientCanGetExecutionOfDeleteAllVersions
✅ controllerClientCanGetExecutionOfDeleteStore
✅ controllerClientCanGetLastSucceedExecutionId
✅ controllerClientCanGetStorageEngineOverheadRatio
✅ controllerClientCanGetStoreInfo
✅ controllerClientCanListFutureStoreVersions
✅ controllerClientCanListStoresStatuses
✅ controllerClientCanNotDeleteStore
✅ controllerClientCanQueryInstanceStatusInCluster
✅ controllerClientCanQueryNodesInCluster
✅ controllerClientCanQueryRemovability
✅ controllerClientCanQueryReplicasForTopic
✅ controllerClientCanQueryReplicasOnAStorageNode
✅ controllerClientCanSetStore
✅ controllerClientCanSetStoreMetadata
✅ controllerClientCanSetStoreMissingSomeFields
✅ controllerClientCanUpdateAllowList
✅ controllerClientGetKeySchema
✅ controllerClientManageValueSchema
✅ controllerClientProvidesErrorWhenRequestingTopicForStoreThatDoesNotExist
✅ controllerClientReturns404ForNonexistentStoreQuery
✅ controllerClientSchemaOperationsAgainstInvalidStore
✅ testAggregatedHealthStatusCall
✅ testCleanupInstanceCustomizedStates
✅ testDeleteKafkaTopic

✅ IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServerAcl.xml

2 tests were completed in 1s with 2 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.server.TestAdminSparkServerAcl 2✅ 1s

✅ com.linkedin.venice.controller.server.TestAdminSparkServerAcl

✅ testAclRestApiException
✅ testAclRestApis

✅ IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServerGetLeader.xml

1 tests were completed in 449ms with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.server.TestAdminSparkServerGetLeader 1✅ 449ms

✅ com.linkedin.venice.controller.server.TestAdminSparkServerGetLeader

✅ testGetLeaderController

✅ IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServerWithMultiServers.xml

9 tests were completed in 19s with 9 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.server.TestAdminSparkServerWithMultiServers 9✅ 19s

✅ com.linkedin.venice.controller.server.TestAdminSparkServerWithMultiServers

✅ controllerClientCanRemoveNodeFromCluster
✅ controllerClientShouldCreateStoreWithParameters
✅ controllerClientShouldCreateStoreWithParametersAndNotDeleteItIfItExists
✅ controllerClientShouldListStores
✅ controllerClientShouldSendEmptyPushAndWait
✅ endOfPushEndpointTriggersVersionSwap
✅ requestTopicIsIdempotent
✅ requestTopicIsIdempotentWithConcurrency
✅ testListStoreWithConfigFilter

✅ IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkWithMocks.xml

14 tests were completed in 2s with 14 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.server.TestAdminSparkWithMocks 14✅ 2s

✅ com.linkedin.venice.controller.server.TestAdminSparkWithMocks

✅ testAAIncrementalPushRTSourceRegion[0](false, false)
✅ testAAIncrementalPushRTSourceRegion[1](true, false)
✅ testAAIncrementalPushRTSourceRegion[2](false, true)
✅ testAAIncrementalPushRTSourceRegion[3](true, true)
✅ testBannedRoutesAreRejected
✅ testGetRealTimeTopicForStreamPushJobUsesAdmin
✅ testSamzaReplicationPolicyMode[0](false, false, false)
✅ testSamzaReplicationPolicyMode[1](true, false, false)
✅ testSamzaReplicationPolicyMode[2](false, true, false)
✅ testSamzaReplicationPolicyMode[3](true, true, false)
✅ testSamzaReplicationPolicyMode[4](false, false, true)
✅ testSamzaReplicationPolicyMode[5](true, false, true)
✅ testSamzaReplicationPolicyMode[6](false, true, true)
✅ testSamzaReplicationPolicyMode[7](true, true, true)

✅ IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestBackupControllerResponse.xml

1 tests were completed in 29s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.server.TestBackupControllerResponse 1✅ 29s

✅ com.linkedin.venice.controller.server.TestBackupControllerResponse

✅ backupControllerThrows421

❌ internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.kafka.consumer.AdminConsumptionTaskIntegrationTest.xml

5 tests were completed in 605s with 4 passed, 1 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.kafka.consumer.AdminConsumptionTaskIntegrationTest 4✅ 1❌ 605s

❌ com.linkedin.venice.controller.kafka.consumer.AdminConsumptionTaskIntegrationTest

✅ testAdminConsumptionTaskWithSpecificWriterId
✅ testParallelAdminExecutionTasks
❌ testSkipMessageEndToEnd
	org.testng.internal.thread.ThreadTimeoutException: Method com.linkedin.venice.controller.kafka.consumer.AdminConsumptionTaskIntegrationTest.testSkipMessageEndToEnd() didn't finish within the time-out 60000
✅ testUpdateAdminOperationVersion
✅ testSkipMessageEndToEnd

✅ internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.migration.TestMigrationPushStrategyZKAccessor.xml

2 tests were completed in 350ms with 2 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.migration.TestMigrationPushStrategyZKAccessor 2✅ 350ms

✅ com.linkedin.venice.controller.migration.TestMigrationPushStrategyZKAccessor

✅ testCreateAndUpdatePushStrategy
✅ testSetInvalidStrategy

✅ internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServer.xml

38 tests were completed in 279s with 38 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.server.TestAdminSparkServer 38✅ 279s

✅ com.linkedin.venice.controller.server.TestAdminSparkServer

✅ canCreateAHybridStore
✅ controllerCanGetDeletableStoreTopics
✅ controllerCanHandleLargePayload
✅ controllerClientCanCreateNewStore
✅ controllerClientCanDeleteAllVersion
✅ controllerClientCanDeleteOldVersion
✅ controllerClientCanDeleteStore
✅ controllerClientCanDisableStoresRead
✅ controllerClientCanDisableStoresReadWrite
✅ controllerClientCanDisableStoresWrite
✅ controllerClientCanDiscoverCluster
✅ controllerClientCanEnableMaxCapacityProtection
✅ controllerClientCanEnableThrottling
✅ controllerClientCanGetExecutionOfDeleteAllVersions
✅ controllerClientCanGetExecutionOfDeleteStore
✅ controllerClientCanGetLastSucceedExecutionId
✅ controllerClientCanGetStorageEngineOverheadRatio
✅ controllerClientCanGetStoreInfo
✅ controllerClientCanListFutureStoreVersions
✅ controllerClientCanListStoresStatuses
✅ controllerClientCanNotDeleteStore
✅ controllerClientCanQueryInstanceStatusInCluster
✅ controllerClientCanQueryNodesInCluster
✅ controllerClientCanQueryRemovability
✅ controllerClientCanQueryReplicasForTopic
✅ controllerClientCanQueryReplicasOnAStorageNode
✅ controllerClientCanSetStore
✅ controllerClientCanSetStoreMetadata
✅ controllerClientCanSetStoreMissingSomeFields
✅ controllerClientCanUpdateAllowList
✅ controllerClientGetKeySchema
✅ controllerClientManageValueSchema
✅ controllerClientProvidesErrorWhenRequestingTopicForStoreThatDoesNotExist
✅ controllerClientReturns404ForNonexistentStoreQuery
✅ controllerClientSchemaOperationsAgainstInvalidStore
✅ testAggregatedHealthStatusCall
✅ testCleanupInstanceCustomizedStates
✅ testDeleteKafkaTopic

✅ internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServerAcl.xml

2 tests were completed in 1s with 2 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.server.TestAdminSparkServerAcl 2✅ 1s

✅ com.linkedin.venice.controller.server.TestAdminSparkServerAcl

✅ testAclRestApiException
✅ testAclRestApis

✅ internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServerGetLeader.xml

1 tests were completed in 449ms with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.server.TestAdminSparkServerGetLeader 1✅ 449ms

✅ com.linkedin.venice.controller.server.TestAdminSparkServerGetLeader

✅ testGetLeaderController

✅ internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkServerWithMultiServers.xml

9 tests were completed in 19s with 9 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.server.TestAdminSparkServerWithMultiServers 9✅ 19s

✅ com.linkedin.venice.controller.server.TestAdminSparkServerWithMultiServers

✅ controllerClientCanRemoveNodeFromCluster
✅ controllerClientShouldCreateStoreWithParameters
✅ controllerClientShouldCreateStoreWithParametersAndNotDeleteItIfItExists
✅ controllerClientShouldListStores
✅ controllerClientShouldSendEmptyPushAndWait
✅ endOfPushEndpointTriggersVersionSwap
✅ requestTopicIsIdempotent
✅ requestTopicIsIdempotentWithConcurrency
✅ testListStoreWithConfigFilter

✅ internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestAdminSparkWithMocks.xml

14 tests were completed in 2s with 14 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.server.TestAdminSparkWithMocks 14✅ 2s

✅ com.linkedin.venice.controller.server.TestAdminSparkWithMocks

✅ testAAIncrementalPushRTSourceRegion[0](false, false)
✅ testAAIncrementalPushRTSourceRegion[1](true, false)
✅ testAAIncrementalPushRTSourceRegion[2](false, true)
✅ testAAIncrementalPushRTSourceRegion[3](true, true)
✅ testBannedRoutesAreRejected
✅ testGetRealTimeTopicForStreamPushJobUsesAdmin
✅ testSamzaReplicationPolicyMode[0](false, false, false)
✅ testSamzaReplicationPolicyMode[1](true, false, false)
✅ testSamzaReplicationPolicyMode[2](false, true, false)
✅ testSamzaReplicationPolicyMode[3](true, true, false)
✅ testSamzaReplicationPolicyMode[4](false, false, true)
✅ testSamzaReplicationPolicyMode[5](true, false, true)
✅ testSamzaReplicationPolicyMode[6](false, true, true)
✅ testSamzaReplicationPolicyMode[7](true, true, true)

✅ internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.server.TestBackupControllerResponse.xml

1 tests were completed in 29s with 1 passed, 0 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.controller.server.TestBackupControllerResponse 1✅ 29s

✅ com.linkedin.venice.controller.server.TestBackupControllerResponse

✅ backupControllerThrows421

Annotations

Check failure on line 169 in internal/venice-common/src/main/java/com/linkedin/venice/controllerapi/ControllerTransport.java

See this annotation in the file changed.

@github-actions github-actions / IntegrationTests_1410 Test Reports

com.linkedin.venice.controller.kafka.consumer.AdminConsumptionTaskIntegrationTest ► testSkipMessageEndToEnd

Failed test found in:
  IntegrationTests_1410-artifacts/internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.kafka.consumer.AdminConsumptionTaskIntegrationTest.xml
  internal/venice-test-common/build/test-results/integrationTests_1410/TEST-com.linkedin.venice.controller.kafka.consumer.AdminConsumptionTaskIntegrationTest.xml
Error:
  org.testng.internal.thread.ThreadTimeoutException: Method com.linkedin.venice.controller.kafka.consumer.AdminConsumptionTaskIntegrationTest.testSkipMessageEndToEnd() didn't finish within the time-out 60000
Raw output
org.testng.internal.thread.ThreadTimeoutException: Method com.linkedin.venice.controller.kafka.consumer.AdminConsumptionTaskIntegrationTest.testSkipMessageEndToEnd() didn't finish within the time-out 60000
	at app//org.apache.http.impl.nio.client.AbstractClientExchangeHandler.discardConnection(AbstractClientExchangeHandler.java:270)
	at app//org.apache.http.impl.nio.client.AbstractClientExchangeHandler.cancel(AbstractClientExchangeHandler.java:453)
	at app//org.apache.http.client.methods.AbstractExecutionAwareRequest.abort(AbstractExecutionAwareRequest.java:94)
	at app//com.linkedin.venice.controllerapi.ControllerTransport.executeRequest(ControllerTransport.java:169)
	at app//com.linkedin.venice.controllerapi.ControllerTransport.executeGet(ControllerTransport.java:108)
	at app//com.linkedin.venice.controllerapi.ControllerTransport.request(ControllerTransport.java:83)
	at app//com.linkedin.venice.controllerapi.ControllerClient.request(ControllerClient.java:1491)
	at app//com.linkedin.venice.controllerapi.ControllerClient.request(ControllerClient.java:1468)
	at app//com.linkedin.venice.controllerapi.ControllerClient.getStore(ControllerClient.java:240)
	at app//com.linkedin.venice.controller.kafka.consumer.AdminConsumptionTaskIntegrationTest.lambda$testSkipMessageEndToEnd$1(AdminConsumptionTaskIntegrationTest.java:147)
	at app//com.linkedin.venice.controller.kafka.consumer.AdminConsumptionTaskIntegrationTest$$Lambda$3097/0x00007f9580d71d28.execute(Unknown Source)
	at app//com.linkedin.venice.utils.TestUtils.waitForNonDeterministicAssertion(TestUtils.java:266)
	at app//com.linkedin.venice.utils.TestUtils.waitForNonDeterministicAssertion(TestUtils.java:251)
	at app//com.linkedin.venice.utils.TestUtils.waitForNonDeterministicAssertion(TestUtils.java:243)
	at app//com.linkedin.venice.controller.kafka.consumer.AdminConsumptionTaskIntegrationTest.testSkipMessageEndToEnd(AdminConsumptionTaskIntegrationTest.java:146)