Skip to content

[server] Adjust limiting throttler at faster rate #611

[server] Adjust limiting throttler at faster rate

[server] Adjust limiting throttler at faster rate #611

GitHub Actions / IntegrationTests_1250 Test Reports succeeded Mar 5, 2025 in 0s

70 passed, 6 failed and 0 skipped

Tests failed

Report Passed Failed Skipped Time
IntegrationTests_1250-artifacts/internal/venice-test-common/build/test-results/integrationTests_1250/TEST-com.linkedin.venice.endToEnd.PartialUpdateTest.xml 35✅ 3❌ 1383s
internal/venice-test-common/build/test-results/integrationTests_1250/TEST-com.linkedin.venice.endToEnd.PartialUpdateTest.xml 35✅ 3❌ 1383s

❌ IntegrationTests_1250-artifacts/internal/venice-test-common/build/test-results/integrationTests_1250/TEST-com.linkedin.venice.endToEnd.PartialUpdateTest.xml

38 tests were completed in 1383s with 35 passed, 3 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.endToEnd.PartialUpdateTest 35✅ 3❌ 1383s

❌ com.linkedin.venice.endToEnd.PartialUpdateTest

✅ testActiveActivePartialUpdateWithCompression[0](NO_OP)
✅ testActiveActivePartialUpdateWithCompression[2](GZIP)
✅ testActiveActivePartialUpdateWithCompression[4](ZSTD_WITH_DICT)
✅ testConvertRmdType
✅ testEnablePartialUpdateOnActiveActiveStore
✅ testIncrementalPushPartialUpdateClassicFormat
✅ testIncrementalPushPartialUpdateNewFormat[0](false)
✅ testIncrementalPushPartialUpdateNewFormat[2](true)
✅ testNonAAPartialUpdateChunkDeletion
✅ testNonAARewind
✅ testPartialUpdateOnBatchPushedChunkKeys
✅ testPartialUpdateOnBatchPushedKeys[0](NO_OP)
❌ testPartialUpdateOnBatchPushedKeys[2](GZIP)
	org.testng.internal.thread.ThreadTimeoutException: Method com.linkedin.venice.endToEnd.PartialUpdateTest.testPartialUpdateOnBatchPushedKeys() didn't finish within the time-out 180000
✅ testPartialUpdateOnBatchPushedKeys[3](ZSTD_WITH_DICT)
✅ testRTTopicDeletionWithHybridAndIncrementalVersions
✅ testRepushWithChunkingFlagChanged
✅ testRepushWithDeleteRecord
✅ testRepushWithTTLWithActiveActivePartialUpdateStore[0](NO_OP)
✅ testRepushWithTTLWithActiveActivePartialUpdateStore[2](GZIP)
✅ testRepushWithTTLWithActiveActivePartialUpdateStore[4](ZSTD_WITH_DICT)
❌ testUpdateWithSupersetSchema
	java.lang.AssertionError: Push is yet to complete: JobStatusQueryResponse(
✅ testWriteComputeWithHybridLeaderFollowerLargeRecord[0](false, NO_OP)
✅ testWriteComputeWithHybridLeaderFollowerLargeRecord[2](true, NO_OP)
✅ testWriteComputeWithHybridLeaderFollowerLargeRecord[4](false, GZIP)
✅ testWriteComputeWithHybridLeaderFollowerLargeRecord[6](true, GZIP)
✅ testWriteComputeWithHybridLeaderFollowerLargeRecord[8](false, ZSTD_WITH_DICT)
❌ testWriteComputeWithHybridLeaderFollowerLargeRecord[10](true, ZSTD_WITH_DICT)
	org.testng.internal.thread.ThreadTimeoutException: Method com.linkedin.venice.endToEnd.PartialUpdateTest.testWriteComputeWithHybridLeaderFollowerLargeRecord() didn't finish within the time-out 180000
✅ testWriteComputeWithSamzaBatchJob
✅ testPartialUpdateOnBatchPushedKeys[0](NO_OP)
✅ testPartialUpdateOnBatchPushedKeys[2](GZIP)
✅ testPartialUpdateOnBatchPushedKeys[4](ZSTD_WITH_DICT)
✅ testUpdateWithSupersetSchema
✅ testWriteComputeWithHybridLeaderFollowerLargeRecord[0](false, NO_OP)
✅ testWriteComputeWithHybridLeaderFollowerLargeRecord[2](true, NO_OP)
✅ testWriteComputeWithHybridLeaderFollowerLargeRecord[4](false, GZIP)
✅ testWriteComputeWithHybridLeaderFollowerLargeRecord[6](true, GZIP)
✅ testWriteComputeWithHybridLeaderFollowerLargeRecord[8](false, ZSTD_WITH_DICT)
✅ testWriteComputeWithHybridLeaderFollowerLargeRecord[10](true, ZSTD_WITH_DICT)

❌ internal/venice-test-common/build/test-results/integrationTests_1250/TEST-com.linkedin.venice.endToEnd.PartialUpdateTest.xml

38 tests were completed in 1383s with 35 passed, 3 failed and 0 skipped.

Test suite Passed Failed Skipped Time
com.linkedin.venice.endToEnd.PartialUpdateTest 35✅ 3❌ 1383s

❌ com.linkedin.venice.endToEnd.PartialUpdateTest

✅ testActiveActivePartialUpdateWithCompression[0](NO_OP)
✅ testActiveActivePartialUpdateWithCompression[2](GZIP)
✅ testActiveActivePartialUpdateWithCompression[4](ZSTD_WITH_DICT)
✅ testConvertRmdType
✅ testEnablePartialUpdateOnActiveActiveStore
✅ testIncrementalPushPartialUpdateClassicFormat
✅ testIncrementalPushPartialUpdateNewFormat[0](false)
✅ testIncrementalPushPartialUpdateNewFormat[2](true)
✅ testNonAAPartialUpdateChunkDeletion
✅ testNonAARewind
✅ testPartialUpdateOnBatchPushedChunkKeys
✅ testPartialUpdateOnBatchPushedKeys[0](NO_OP)
❌ testPartialUpdateOnBatchPushedKeys[2](GZIP)
	org.testng.internal.thread.ThreadTimeoutException: Method com.linkedin.venice.endToEnd.PartialUpdateTest.testPartialUpdateOnBatchPushedKeys() didn't finish within the time-out 180000
✅ testPartialUpdateOnBatchPushedKeys[3](ZSTD_WITH_DICT)
✅ testRTTopicDeletionWithHybridAndIncrementalVersions
✅ testRepushWithChunkingFlagChanged
✅ testRepushWithDeleteRecord
✅ testRepushWithTTLWithActiveActivePartialUpdateStore[0](NO_OP)
✅ testRepushWithTTLWithActiveActivePartialUpdateStore[2](GZIP)
✅ testRepushWithTTLWithActiveActivePartialUpdateStore[4](ZSTD_WITH_DICT)
❌ testUpdateWithSupersetSchema
	java.lang.AssertionError: Push is yet to complete: JobStatusQueryResponse(
✅ testWriteComputeWithHybridLeaderFollowerLargeRecord[0](false, NO_OP)
✅ testWriteComputeWithHybridLeaderFollowerLargeRecord[2](true, NO_OP)
✅ testWriteComputeWithHybridLeaderFollowerLargeRecord[4](false, GZIP)
✅ testWriteComputeWithHybridLeaderFollowerLargeRecord[6](true, GZIP)
✅ testWriteComputeWithHybridLeaderFollowerLargeRecord[8](false, ZSTD_WITH_DICT)
❌ testWriteComputeWithHybridLeaderFollowerLargeRecord[10](true, ZSTD_WITH_DICT)
	org.testng.internal.thread.ThreadTimeoutException: Method com.linkedin.venice.endToEnd.PartialUpdateTest.testWriteComputeWithHybridLeaderFollowerLargeRecord() didn't finish within the time-out 180000
✅ testWriteComputeWithSamzaBatchJob
✅ testPartialUpdateOnBatchPushedKeys[0](NO_OP)
✅ testPartialUpdateOnBatchPushedKeys[2](GZIP)
✅ testPartialUpdateOnBatchPushedKeys[4](ZSTD_WITH_DICT)
✅ testUpdateWithSupersetSchema
✅ testWriteComputeWithHybridLeaderFollowerLargeRecord[0](false, NO_OP)
✅ testWriteComputeWithHybridLeaderFollowerLargeRecord[2](true, NO_OP)
✅ testWriteComputeWithHybridLeaderFollowerLargeRecord[4](false, GZIP)
✅ testWriteComputeWithHybridLeaderFollowerLargeRecord[6](true, GZIP)
✅ testWriteComputeWithHybridLeaderFollowerLargeRecord[8](false, ZSTD_WITH_DICT)
✅ testWriteComputeWithHybridLeaderFollowerLargeRecord[10](true, ZSTD_WITH_DICT)

Annotations

Check failure on line 890 in clients/venice-push-job/src/main/java/com/linkedin/venice/hadoop/VenicePushJob.java

See this annotation in the file changed.

@github-actions github-actions / IntegrationTests_1250 Test Reports

com.linkedin.venice.endToEnd.PartialUpdateTest ► testPartialUpdateOnBatchPushedKeys[2](GZIP)

Failed test found in:
  IntegrationTests_1250-artifacts/internal/venice-test-common/build/test-results/integrationTests_1250/TEST-com.linkedin.venice.endToEnd.PartialUpdateTest.xml
  internal/venice-test-common/build/test-results/integrationTests_1250/TEST-com.linkedin.venice.endToEnd.PartialUpdateTest.xml
Error:
  org.testng.internal.thread.ThreadTimeoutException: Method com.linkedin.venice.endToEnd.PartialUpdateTest.testPartialUpdateOnBatchPushedKeys() didn't finish within the time-out 180000
Raw output
org.testng.internal.thread.ThreadTimeoutException: Method com.linkedin.venice.endToEnd.PartialUpdateTest.testPartialUpdateOnBatchPushedKeys() didn't finish within the time-out 180000
	at app//com.linkedin.venice.hadoop.VenicePushJob.run(VenicePushJob.java:890)
	at app//com.linkedin.venice.endToEnd.PartialUpdateTest.runVPJ(PartialUpdateTest.java:2296)
	at app//com.linkedin.venice.endToEnd.PartialUpdateTest.testPartialUpdateOnBatchPushedKeys(PartialUpdateTest.java:503)

Check failure on line 500 in internal/venice-test-common/src/main/java/com/linkedin/venice/utils/TestUtils.java

See this annotation in the file changed.

@github-actions github-actions / IntegrationTests_1250 Test Reports

com.linkedin.venice.endToEnd.PartialUpdateTest ► testUpdateWithSupersetSchema

Failed test found in:
  IntegrationTests_1250-artifacts/internal/venice-test-common/build/test-results/integrationTests_1250/TEST-com.linkedin.venice.endToEnd.PartialUpdateTest.xml
  internal/venice-test-common/build/test-results/integrationTests_1250/TEST-com.linkedin.venice.endToEnd.PartialUpdateTest.xml
Error:
  java.lang.AssertionError: Push is yet to complete: JobStatusQueryResponse(
Raw output
java.lang.AssertionError: Push is yet to complete: JobStatusQueryResponse(
version: 1,
status: END_OF_PUSH_RECEIVED,
statusDetails: ,
extraInfo: {dc-0=COMPLETED, dc-1=END_OF_PUSH_RECEIVED},
extraDetails: {dc-1=http://localhost:42469 2/3 partitions completed.. Following partitions still not complete [2]},
ControllerResponse(cluster: venice-cluster0, name: store_e78df75ca1_d3206973, error: null, errorType: null, exceptionType: null)) expected [COMPLETED] but found [END_OF_PUSH_RECEIVED]
	at org.testng.Assert.fail(Assert.java:96)
	at org.testng.Assert.failNotEquals(Assert.java:776)
	at org.testng.Assert.assertEqualsImpl(Assert.java:137)
	at org.testng.Assert.assertEquals(Assert.java:118)
	at com.linkedin.venice.utils.TestUtils.lambda$waitForNonDeterministicPushCompletion$2(TestUtils.java:500)
	at com.linkedin.venice.utils.TestUtils.waitForNonDeterministicAssertion(TestUtils.java:266)
	at com.linkedin.venice.utils.TestUtils.waitForNonDeterministicAssertion(TestUtils.java:251)
	at com.linkedin.venice.utils.TestUtils.waitForNonDeterministicPushCompletion(TestUtils.java:493)
	at com.linkedin.venice.endToEnd.PartialUpdateTest.testUpdateWithSupersetSchema(PartialUpdateTest.java:1896)

Check failure on line 884 in clients/venice-push-job/src/main/java/com/linkedin/venice/hadoop/VenicePushJob.java

See this annotation in the file changed.

@github-actions github-actions / IntegrationTests_1250 Test Reports

com.linkedin.venice.endToEnd.PartialUpdateTest ► testWriteComputeWithHybridLeaderFollowerLargeRecord[10](true, ZSTD_WITH_DICT)

Failed test found in:
  IntegrationTests_1250-artifacts/internal/venice-test-common/build/test-results/integrationTests_1250/TEST-com.linkedin.venice.endToEnd.PartialUpdateTest.xml
  internal/venice-test-common/build/test-results/integrationTests_1250/TEST-com.linkedin.venice.endToEnd.PartialUpdateTest.xml
Error:
  org.testng.internal.thread.ThreadTimeoutException: Method com.linkedin.venice.endToEnd.PartialUpdateTest.testWriteComputeWithHybridLeaderFollowerLargeRecord() didn't finish within the time-out 180000
Raw output
org.testng.internal.thread.ThreadTimeoutException: Method com.linkedin.venice.endToEnd.PartialUpdateTest.testWriteComputeWithHybridLeaderFollowerLargeRecord() didn't finish within the time-out 180000
	at [email protected]/java.lang.StackTraceElement.initStackTraceElements(Native Method)
	at [email protected]/java.lang.StackTraceElement.of(StackTraceElement.java:541)
	at [email protected]/java.lang.Throwable.getOurStackTrace(Throwable.java:839)
	at [email protected]/java.lang.Throwable.getStackTrace(Throwable.java:831)
	at app//org.apache.logging.log4j.core.impl.ThrowableProxy.<init>(ThrowableProxy.java:112)
	at app//org.apache.logging.log4j.core.impl.ThrowableProxy.<init>(ThrowableProxy.java:96)
	at app//org.apache.logging.log4j.core.impl.Log4jLogEvent.getThrownProxy(Log4jLogEvent.java:629)
	at app//org.apache.logging.log4j.core.pattern.ExtendedThrowablePatternConverter.format(ExtendedThrowablePatternConverter.java:63)
	at app//org.apache.logging.log4j.core.layout.PatternLayout$NoFormatPatternSerializer.toSerializable(PatternLayout.java:343)
	at app//org.apache.logging.log4j.core.layout.PatternLayout.toText(PatternLayout.java:241)
	at app//org.apache.logging.log4j.core.layout.PatternLayout.encode(PatternLayout.java:226)
	at app//org.apache.logging.log4j.core.layout.PatternLayout.encode(PatternLayout.java:60)
	at app//org.apache.logging.log4j.core.appender.AbstractOutputStreamAppender.directEncodeEvent(AbstractOutputStreamAppender.java:197)
	at app//org.apache.logging.log4j.core.appender.AbstractOutputStreamAppender.tryAppend(AbstractOutputStreamAppender.java:190)
	at app//org.apache.logging.log4j.core.appender.AbstractOutputStreamAppender.append(AbstractOutputStreamAppender.java:181)
	at app//org.apache.logging.log4j.core.config.AppenderControl.tryCallAppender(AppenderControl.java:161)
	at app//org.apache.logging.log4j.core.config.AppenderControl.callAppender0(AppenderControl.java:134)
	at app//org.apache.logging.log4j.core.config.AppenderControl.callAppenderPreventRecursion(AppenderControl.java:125)
	at app//org.apache.logging.log4j.core.config.AppenderControl.callAppender(AppenderControl.java:89)
	at app//org.apache.logging.log4j.core.config.LoggerConfig.callAppenders(LoggerConfig.java:542)
	at app//org.apache.logging.log4j.core.config.LoggerConfig.processLogEvent(LoggerConfig.java:500)
	at app//org.apache.logging.log4j.core.config.LoggerConfig.log(LoggerConfig.java:483)
	at app//org.apache.logging.log4j.core.config.LoggerConfig.log(LoggerConfig.java:417)
	at app//org.apache.logging.log4j.core.config.AwaitCompletionReliabilityStrategy.log(AwaitCompletionReliabilityStrategy.java:82)
	at app//org.apache.logging.log4j.core.Logger.log(Logger.java:161)
	at app//org.apache.logging.log4j.spi.AbstractLogger.tryLogMessage(AbstractLogger.java:2205)
	at app//org.apache.logging.log4j.spi.AbstractLogger.logMessageTrackRecursion(AbstractLogger.java:2159)
	at app//org.apache.logging.log4j.spi.AbstractLogger.logMessageSafely(AbstractLogger.java:2142)
	at app//org.apache.logging.log4j.spi.AbstractLogger.logMessage(AbstractLogger.java:2017)
	at app//org.apache.logging.log4j.spi.AbstractLogger.logIfEnabled(AbstractLogger.java:1983)
	at app//org.apache.logging.log4j.spi.AbstractLogger.error(AbstractLogger.java:750)
	at app//com.linkedin.venice.hadoop.VenicePushJob.run(VenicePushJob.java:884)
	at app//com.linkedin.venice.endToEnd.PartialUpdateTest.runVPJ(PartialUpdateTest.java:2296)
	at app//com.linkedin.venice.endToEnd.PartialUpdateTest.testWriteComputeWithHybridLeaderFollowerLargeRecord(PartialUpdateTest.java:2024)