forked from apache/spark
-
Notifications
You must be signed in to change notification settings - Fork 1
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
[SPARK-43612][PYTHON][CONNECT][FOLLOW-UP] Copy dependent data files t…
…o data directory ### What changes were proposed in this pull request? This PR proposes to move several data files used for PySpark artifact tests from `connector/connect/common/src/test/resources/artifact-tests`, added in apache#40368, to `data` directory. ### Why are the changes needed? PySpark tests should better not depend on Spark's test package build. This PR decouples it. ### Does this PR introduce _any_ user-facing change? No, dev-only. ### How was this patch tested? CI in this PR should verify it. Closes apache#41510 from HyukjinKwon/SPARK-43612-followup. Authored-by: Hyukjin Kwon <[email protected]> Signed-off-by: Ruifeng Zheng <[email protected]>
- Loading branch information
1 parent
f1cca85
commit 3cae38b
Showing
6 changed files
with
19 additions
and
3 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,5 @@ | ||
The CRCs for a specific file are stored in a text file with the same name (excluding the original extension). | ||
|
||
The CRCs are calculated for data chunks of `32768 bytes` (individual CRCs) and are newline delimited. | ||
|
||
The CRCs were calculated using https://simplycalc.com/crc32-file.php |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1,12 @@ | ||
902183889 | ||
2415704507 | ||
1084811487 | ||
1951510 | ||
1158852476 | ||
2003120166 | ||
3026803842 | ||
3850244775 | ||
3409267044 | ||
652109216 | ||
104029242 | ||
3019434266 |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -0,0 +1 @@ | ||
1631702900 |
Binary file not shown.
Binary file not shown.
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters