Skip to content

Commit

Permalink
apacheGH-38745: [Integration] Fix huge integration test (apache#38746)
Browse files Browse the repository at this point in the history
### Rationale for this change

For some reason, the decimal files generated by the integration test suite have as many record batches as columns.
This looks like a programming error rather than something deliberate.

### What changes are included in this PR?

Use similar batch sizes as for other test files.

### Are these changes tested?

Yes.

### Are there any user-facing changes?

No.

* Closes: apache#38745

Authored-by: Antoine Pitrou <[email protected]>
Signed-off-by: Antoine Pitrou <[email protected]>
  • Loading branch information
pitrou authored Nov 16, 2023
1 parent 5583dbe commit 971bf38
Showing 1 changed file with 2 additions and 4 deletions.
6 changes: 2 additions & 4 deletions dev/archery/archery/integration/datagen.py
Original file line number Diff line number Diff line change
Expand Up @@ -1520,8 +1520,7 @@ def generate_decimal128_case():
for i, precision in enumerate(range(3, 39))
]

possible_batch_sizes = 7, 10
batch_sizes = [possible_batch_sizes[i % 2] for i in range(len(fields))]
batch_sizes = [7, 10]
# 'decimal' is the original name for the test, and it must match
# provide "gold" files that test backwards compatibility, so they
# can be appropriately skipped.
Expand All @@ -1535,8 +1534,7 @@ def generate_decimal256_case():
for i, precision in enumerate(range(37, 70))
]

possible_batch_sizes = 7, 10
batch_sizes = [possible_batch_sizes[i % 2] for i in range(len(fields))]
batch_sizes = [7, 10]
return _generate_file('decimal256', fields, batch_sizes)


Expand Down

0 comments on commit 971bf38

Please sign in to comment.