Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Rebase of task-force from Orchid release branch. #1462

Merged
merged 74 commits into from
Oct 6, 2023

Conversation

JohnC-80
Copy link
Contributor

@JohnC-80 JohnC-80 commented Aug 30, 2023

In draft for now as we continue to troubleshoot any issues.

The overarching change is conditional behavior based on whether or not object storage capabilities are enabled (S3). This is determined by a response from the data-import/splitStatus endpoint.

If this returns false, behavior is kept the same.

If the response is true, then a number of things change:

  • query parameters for the running jobs list and the job log
  • display of a link to download the system-generated slices of larger MARC files.
  • usage of multipart-upload capability on the front-end, including
    • a size-based splitting (30MB/slice) of the uploaded file.
    • request to initiate a multipart upload
    • request for subsequent pre-signed URL's to upload parts beyond the first
    • a call to finalize the upload and re-assemble the uploaded pieces.
    • A MultipartUploader class which manages the above.
  • different verbiage in the UI, informing the user that larger MARC files will be sliced.
  • display of Job parts information (ex: 3 of 7) in the JobLogs table.
  • display of consolidated information from multiple jobs/child splits within single "Composite parent" cards in the "Running Jobs" list.
    • Collection of values from compositeDetails in its own utility files.
  • Canceling composite parent jobs, and all associated child jobs that still have yet to be executed.

JohnC-80 and others added 23 commits August 30, 2023 13:46
…nt (#1453)

* add composit job details to Job component

* add tests, update babel config/dependencies

* add column header translations, job parts column

* add additional tests for jobLogsContainer - job parts column

* test jobLogsContainer with split job entry

* make DataFetcher paths functional depending on upload configuration

* add further optional chaining to data fetcher export

* add tests for functional URL function (getJobSplittingURL) in DataFetcher
* translations, layout for cancellation modal

* add endpoint call, test for canceling a multipart job

* remove comment

* clean up Job imports, improve test coverage.
* render download link in job summary page

* update tests for Job summary, add tests

* improve layout/behavior of SourceDownloadLink component

* mock callout from stripes-core

* appease the lint gods
…ion (#1458)

* display jobParts column in Jobs using this profile section

* cleaner wrap for settings, tests for ViewJobProfile

* provide upload definition id in test context
@github-actions
Copy link

github-actions bot commented Aug 30, 2023

Jest Unit Test Statistics

       1 files  ±  0     174 suites  +3   13m 50s ⏱️ -17s
1 122 tests +86  1 021 ✔️ +86  101 💤 ±0  0 ±0 
1 142 runs  +86  1 037 ✔️ +86  105 💤 ±0  0 ±0 

Results for commit 52118a8. ± Comparison against base commit f367f53.

♻️ This comment has been updated with latest results.

@github-actions
Copy link

github-actions bot commented Aug 30, 2023

BigTest Unit Test Statistics

0 tests  ±0   0 ✔️ ±0   0s ⏱️ ±0s
0 suites ±0   0 💤 ±0 
0 files   ±0   0 ±0 

Results for commit 52118a8. ± Comparison against base commit f367f53.

♻️ This comment has been updated with latest results.

@sonarqubecloud
Copy link

sonarqubecloud bot commented Oct 5, 2023

Kudos, SonarCloud Quality Gate passed!    Quality Gate passed

Bug A 0 Bugs
Vulnerability A 0 Vulnerabilities
Security Hotspot A 0 Security Hotspots
Code Smell A 0 Code Smells

85.8% 85.8% Coverage
2.4% 2.4% Duplication

@JohnC-80 JohnC-80 merged commit 0fd40d5 into b6.0 Oct 6, 2023
5 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants