Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

UI timing out "Server busy" error after inserting rows #1367

Open
atcooper1 opened this issue Jun 18, 2024 · 19 comments
Open

UI timing out "Server busy" error after inserting rows #1367

atcooper1 opened this issue Jun 18, 2024 · 19 comments
Assignees
Labels
issue inconsistent with the specification / other T3 - NRMN

Comments

@atcooper1
Copy link
Collaborator

Rows don’t always insert where expected, instead they insert at the top of the sheet, but when users paste new data into the blank rows inserted at the top of the sheet, the UI re-orders the rows to the phantom locations within the sheet (i.e. where users originally tried to insert blank rows). If rows are inserted/cloned, the datasheet is unable to be validated as a "Server Error" persists.

IMG_5660.MOV

image

@utas-raymondng
Copy link
Contributor

@atcooper1 If there is a ingestion already running at the background (due to previous submission) you will see server is busy error.

Please wait for some time, once the previous job run completed, then you can submit again.

@utas-raymondng
Copy link
Contributor

Regarding the insert issue, can you use clone so you do not need to copy and paste after insert?

We are testing a fix in edge for not allow insert for more than 3 lines and this may fix this issue as well. Please wait sometime and we will push changes to staging

@atcooper1
Copy link
Collaborator Author

Hi Raymond, there is no ingestion running in the background. This is happening during a 'save and validate' function with a single datasheet active. The Ingestion issue (i.e. sheets taking over half an hour to ingest) in another problem.

Clone produces the same issues, but regardless, i need to be able to accurately copy and paste data from excel to the inserted or cloned rows.

@utas-raymondng
Copy link
Contributor

Hi Toni,

I mean there is a global lock for ingestion operation, git change, so if the system is busy process ingestion operation, not necessary you submit it, can be other user. Then system will show this message because it is busy processing. You need to wait until the processing done before you can do another save and validate.

@atcooper1
Copy link
Collaborator Author

Hi Raymond, Yes I am aware of the global lock. But Lizzi was not ingesting data at the same time and she is the only other user.
Cheers

@utas-raymondng
Copy link
Contributor

I download the log from aws, there is a materialized view generated which takes 45mins to complete, although not completely match the time, but I suspect this may cause the server busy

``
2024-06-17 01:53:54.948 INFO 2885 --- [io-8080-exec-10] a.o.a.n.r.security.JwtTokenProvider : Expired JWT token
2024-06-17 01:53:54.948 INFO 2885 --- [io-8080-exec-10] a.o.a.n.r.config.RateLimitInterceptor : auth request from ip 131.217.255.200
2024-06-17 01:53:54.949 INFO 2885 --- [io-8080-exec-10] a.o.a.n.r.controller.AuthController : login attempt
2024-06-17 01:54:07.975 INFO 2885 --- [nio-8080-exec-7] a.o.a.n.r.controller.TemplateController : downloading template zip
2024-06-17 03:25:59.941 INFO 2885 --- [nio-8080-exec-6] a.o.a.n.r.config.RateLimitInterceptor : auth request from ip 131.217.255.210
2024-06-17 03:25:59.942 INFO 2885 --- [nio-8080-exec-6] a.o.a.n.r.controller.AuthController : login attempt
2024-06-17 04:12:56.636 INFO 2885 --- [nio-8080-exec-4] a.o.a.n.r.security.JwtTokenProvider : Expired JWT token
2024-06-17 04:12:56.636 INFO 2885 --- [nio-8080-exec-4] a.o.a.n.r.config.RateLimitInterceptor : auth request from ip 131.217.255.210
2024-06-17 04:12:56.637 INFO 2885 --- [nio-8080-exec-4] a.o.a.n.r.controller.AuthController : login attempt
2024-06-17 05:16:40.570 INFO 2885 --- [ task-36] a.o.a.n.r.s.MaterializedViewService : Endpoints refreshed in 150.893655721s
2024-06-17 05:27:34.083 INFO 2885 --- [nio-8080-exec-2] a.o.a.n.r.config.RateLimitInterceptor : auth request from ip 131.217.255.210
2024-06-17 05:27:34.084 INFO 2885 --- [nio-8080-exec-2] a.o.a.n.r.controller.AuthController : login attempt
2024-06-17 05:31:59.256 INFO 2885 --- [nio-8080-exec-1] a.o.a.n.r.c.StagedJobController : JobRepo save job RLS NSW_template_2024_LHI_Consolidated_FINAL.xlsx
2024-06-17 05:31:59.261 INFO 2885 --- [nio-8080-exec-1] a.o.a.n.r.c.StagedJobController : JobLog save job RLS NSW_template_2024_LHI_Consolidated_FINAL.xlsx
2024-06-17 05:32:00.657 INFO 2885 --- [nio-8080-exec-1] a.o.a.n.r.c.StagedJobController : JobRepo save job after file RLS NSW_template_2024_LHI_Consolidated_FINAL.xlsx parsed
2024-06-17 05:32:00.662 INFO 2885 --- [nio-8080-exec-1] a.o.a.n.r.c.StagedJobController : JobLog save job after file RLS NSW_template_2024_LHI_Consolidated_FINAL.xlsx parsed
2024-06-17 14:00:00.016 INFO 2885 --- [ scheduling-1] a.o.a.n.restapi.service.PQSurveyService : Starting update of survey PQ zip files
2024-06-17 14:00:03.436 INFO 2885 --- [ scheduling-1] a.o.a.n.restapi.service.PQSurveyService : Updates PQ zip file urls for 0 surveys
2024-06-17 14:02:34.741 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Endpoints refreshed in 151.30501878s
2024-06-17 14:02:34.741 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Expiring materialized views
2024-06-17 14:02:34.756 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Materialized views expired in 14ms
2024-06-17 14:02:34.761 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Generating materialized views CSV extracts
2024-06-17 14:02:34.764 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Generating CSV extracts for view ep_site_list
2024-06-17 14:02:34.831 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_site_list
2024-06-17 14:02:34.849 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_site_list
2024-06-17 14:02:35.681 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Generating CSV extracts for view ep_m0_off_transect_sighting
2024-06-17 14:02:36.577 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m0_off_transect_sighting
2024-06-17 14:02:36.691 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m0_off_transect_sighting
2024-06-17 14:02:36.845 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Generating CSV extracts for view ep_survey_list
2024-06-17 14:02:37.246 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_survey_list
2024-06-17 14:02:37.503 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_survey_list
2024-06-17 14:02:37.678 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Generating CSV extracts for view ep_site_list
2024-06-17 14:02:37.716 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_site_list
2024-06-17 14:02:37.733 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_site_list
2024-06-17 14:02:37.856 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Generating CSV extracts for view ep_observable_items
2024-06-17 14:02:37.978 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_observable_items
2024-06-17 14:02:38.025 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_observable_items
2024-06-17 14:02:38.143 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Generating CSV extracts for view ep_rarity_abundance
2024-06-17 14:02:38.158 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_rarity_abundance
2024-06-17 14:02:38.167 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_rarity_abundance
2024-06-17 14:02:38.276 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Generating CSV extracts for view ep_rarity_range
2024-06-17 14:02:38.289 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_rarity_range
2024-06-17 14:02:38.296 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_rarity_range
2024-06-17 14:02:38.430 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Generating CSV extracts for view ep_rarity_extents
2024-06-17 14:02:38.553 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_rarity_extents
2024-06-17 14:02:38.613 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_rarity_extents
2024-06-17 14:02:38.904 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Generating CSV extracts for view ep_m1
2024-06-17 14:02:41.238 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m1_tas
2024-06-17 14:02:41.243 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m1_nsw
2024-06-17 14:02:41.498 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m1_vic
2024-06-17 14:02:41.503 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m1_qld
2024-06-17 14:02:41.508 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m1_sa
2024-06-17 14:02:41.516 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m1_wa
2024-06-17 14:02:41.522 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m1_nt
2024-06-17 14:02:41.527 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m1_australia
2024-06-17 14:02:41.785 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m1_all
2024-06-17 14:19:18.625 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m1_tas
2024-06-17 14:19:19.251 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m1_nsw
2024-06-17 14:19:20.124 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m1_vic
2024-06-17 14:19:20.671 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m1_qld
2024-06-17 14:19:21.357 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m1_sa
2024-06-17 14:19:21.756 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m1_wa
2024-06-17 14:19:22.637 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m1_nt
2024-06-17 14:19:22.808 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m1_australia
2024-06-17 14:19:25.844 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m1_all
2024-06-17 14:19:29.434 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Generating CSV extracts for view ep_m2_cryptic_fish
2024-06-17 14:19:30.428 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m2_cryptic_fish_tas
2024-06-17 14:19:30.475 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m2_cryptic_fish_nsw
2024-06-17 14:19:30.648 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m2_cryptic_fish_vic
2024-06-17 14:19:30.660 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m2_cryptic_fish_qld
2024-06-17 14:19:30.696 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m2_cryptic_fish_sa
2024-06-17 14:19:30.714 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m2_cryptic_fish_wa
2024-06-17 14:19:30.763 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m2_cryptic_fish_nt
2024-06-17 14:19:30.768 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m2_cryptic_fish_australia
2024-06-17 14:19:31.089 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m2_cryptic_fish_all
2024-06-17 14:19:35.016 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m2_cryptic_fish_tas
2024-06-17 14:19:35.128 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m2_cryptic_fish_nsw
2024-06-17 14:19:35.327 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m2_cryptic_fish_vic
2024-06-17 14:19:35.440 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m2_cryptic_fish_qld
2024-06-17 14:19:35.530 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m2_cryptic_fish_sa
2024-06-17 14:19:35.673 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m2_cryptic_fish_wa
2024-06-17 14:19:35.800 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m2_cryptic_fish_nt
2024-06-17 14:19:35.950 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m2_cryptic_fish_australia
2024-06-17 14:19:36.269 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m2_cryptic_fish_all
2024-06-17 14:19:36.669 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Generating CSV extracts for view ep_m2_inverts
2024-06-17 14:19:38.460 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m2_inverts_tas
2024-06-17 14:19:38.481 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m2_inverts_nsw
2024-06-17 14:19:38.567 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m2_inverts_vic
2024-06-17 14:19:38.679 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m2_inverts_qld
2024-06-17 14:19:38.692 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m2_inverts_sa
2024-06-17 14:19:38.712 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m2_inverts_wa
2024-06-17 14:19:38.746 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m2_inverts_nt
2024-06-17 14:19:38.752 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m2_inverts_australia
2024-06-17 14:19:39.092 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m2_inverts_all
2024-06-17 14:19:53.610 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m2_inverts_tas
2024-06-17 14:19:53.915 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m2_inverts_nsw
2024-06-17 14:19:54.133 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m2_inverts_vic
2024-06-17 14:19:54.340 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m2_inverts_qld
2024-06-17 14:19:54.417 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m2_inverts_sa
2024-06-17 14:19:54.629 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m2_inverts_wa
2024-06-17 14:19:54.824 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m2_inverts_nt
2024-06-17 14:19:54.937 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m2_inverts_australia
2024-06-17 14:19:55.564 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m2_inverts_all
2024-06-17 14:20:07.413 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Generating CSV extracts for view ep_m3_isq
2024-06-17 14:20:09.308 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m3_isq
2024-06-17 14:20:58.792 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m3_isq
2024-06-17 14:21:00.392 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Generating CSV extracts for view ep_m4_macrocystis_count
2024-06-17 14:21:00.670 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m4_macrocystis_count
2024-06-17 14:21:00.689 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m4_macrocystis_count
2024-06-17 14:21:00.833 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Generating CSV extracts for view ep_m5_limpet_quadrats
2024-06-17 14:21:01.139 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m5_limpet_quadrats
2024-06-17 14:21:01.168 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m5_limpet_quadrats
2024-06-17 14:21:01.383 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Generating CSV extracts for view ep_m7_lobster_count
2024-06-17 14:21:01.620 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m7_lobster_count
2024-06-17 14:21:01.632 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m7_lobster_count
2024-06-17 14:21:01.802 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Generating CSV extracts for view ep_m11_off_transect_measurement
2024-06-17 14:21:01.840 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m11_off_transect_measurement
2024-06-17 14:21:01.843 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m11_off_transect_measurement
2024-06-17 14:21:02.021 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Generating CSV extracts for view ep_m12_debris
2024-06-17 14:21:02.282 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m12_debris
2024-06-17 14:21:02.325 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m12_debris
2024-06-17 14:21:02.525 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Generating CSV extracts for view ep_m13_pq_scores
2024-06-17 14:21:03.801 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_m13_pq_scores
2024-06-17 14:21:04.911 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_m13_pq_scores
2024-06-17 14:21:20.980 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Generating CSV extracts for view ep_species_survey_observation
2024-06-17 14:21:58.380 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Writing CSV ep_species_survey_observation
2024-06-17 14:47:08.035 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploading CSV ep_species_survey_observation
2024-06-17 14:47:12.269 INFO 2885 --- [ task-37] a.o.a.n.r.s.MaterializedViewService : Uploaded all materialized views in 2677507ms
2024-06-17 22:24:04.057 INFO 2885 --- [nio-8080-exec-2] a.o.a.n.r.security.JwtTokenProvider : Expired JWT token
2024-06-17 22:24:04.059 INFO 2885 --- [nio-8080-exec-2] a.o.a.n.r.config.RateLimitInterceptor : auth request from ip 131.217.255.210
2024-06-17 22:24:04.061 INFO 2885 --- [nio-8080-exec-2] a.o.a.n.r.controller.AuthController : login attempt
2024-06-17 23:29:53.272 INFO 2885 --- [nio-8080-exec-9] a.o.a.n.r.security.JwtTokenProvider : Expired JWT token
2024-06-17 23:29:53.273 INFO 2885 --- [nio-8080-exec-9] a.o.a.n.r.config.RateLimitInterceptor : auth request from ip 131.217.38.126
2024-06-17 23:29:53.273 INFO 2885 --- [nio-8080-exec-9] a.o.a.n.r.controller.AuthController : login attempt

@utas-raymondng
Copy link
Contributor

Have look at the code, the "sever is busy" warning shows when there is either a "validate" or "ingest" is in progress. That is at any time, there can only be 1 ingest or 1 validate happens.

Since it set a marker in the db, so there must be a in progress "validate" or "ingest" happening

@utas-raymondng utas-raymondng self-assigned this Jul 22, 2024
@utas-raymondng utas-raymondng added the issue inconsistent with the specification / other label Jul 22, 2024
@utas-raymondng utas-raymondng added this to the Maintenance - Software milestone Jul 22, 2024
@utas-raymondng
Copy link
Contributor

The insert should have fixed with the recent release too

@utas-raymondng
Copy link
Contributor

@atcooper1 do you think this is still an issue ?

@atcooper1
Copy link
Collaborator Author

Hi Raymond, I haven't loaded a large sheet for a while so I can't say whether this issue has resolved. The UI is still performing particularly slowly though. See example below - entering a new site is taking far longer than normal to load the reference data:

image

@utas-raymondng
Copy link
Contributor

That is strange, I just try now, but cannot repeat what you see

image

@atcooper1
Copy link
Collaborator Author

The UI is very slow generally. I'm still waiting on a sheet that was ingested over 40 mins ago to load so i can keep working in the UI. I am unable to do anything until this loads as I get a "server is busy" error.

@utas-raymondng
Copy link
Contributor

Screencast.from.04-10-24.16.41.56.webm

I really cannot repeat what you see

@utas-raymondng
Copy link
Contributor

Can you share the excel you importing, I can try it in staging to see if I can repeat it thanks

@atcooper1
Copy link
Collaborator Author

image
This is what i'm currently getting in the UI

@utas-raymondng
Copy link
Contributor

Can I press the Save and Validate button for any of the STAGED job, until that I cannot trigger the "Server is busy.."

@utas-raymondng
Copy link
Contributor

utas-raymondng commented Oct 4, 2024

Ok your ingest completed I see the following log captured, almost an hour to complete

2024-10-04 05:43:19.882 INFO 2896 --- [nio-8080-exec-8] a.o.a.n.r.c.IngestionController : Ingest job id 762 with transaction
2024-10-04 05:43:19.906 INFO 2896 --- [pool-2-thread-1] a.o.a.n.r.c.IngestionController : Execute ingest job id 762 with transaction
2024-10-04 06:33:45.031 INFO 2896 --- [nio-8080-exec-6] a.o.a.n.r.config.RateLimitInterceptor : auth request from ip 131.217.255.240
2024-10-04 06:33:46.566 INFO 2896 --- [nio-8080-exec-5] a.o.a.n.r.config.RateLimitInterceptor : auth request from ip 131.217.255.240
2024-10-04 06:33:46.566 INFO 2896 --- [nio-8080-exec-5] a.o.a.n.r.controller.AuthController : login attempt
2024-10-04 06:38:12.030 INFO 2896 --- [nio-8080-exec-4] a.o.a.n.r.security.JwtTokenProvider : Expired JWT token
2024-10-04 06:38:12.032 INFO 2896 --- [nio-8080-exec-4] a.o.a.n.r.config.RateLimitInterceptor : auth request from ip 120.159.176.65
2024-10-04 06:38:12.034 INFO 2896 --- [nio-8080-exec-4] a.o.a.n.r.controller.AuthController : login attempt
2024-10-04 06:38:32.364 INFO 2896 --- [nio-8080-exec-5] a.o.a.n.r.security.JwtTokenProvider : Expired JWT token
2024-10-04 06:38:32.365 INFO 2896 --- [nio-8080-exec-5] a.o.a.n.r.config.RateLimitInterceptor : auth request from ip 120.159.176.65
2024-10-04 06:38:32.367 INFO 2896 --- [nio-8080-exec-5] a.o.a.n.r.controller.AuthController : login attempt
2024-10-04 06:56:55.357 INFO 2896 --- [pool-2-thread-1] a.o.a.n.r.c.IngestionController : Refresh materialized view after job id 762 ingested
2024-10-04 06:59:44.408 INFO 2896 --- [ task-74] a.o.a.n.r.s.MaterializedViewService : Endpoints refreshed in 169.03831038s

WAF Combined 02082024_Clean.xlsx

@atcooper1
Copy link
Collaborator Author

Yes, and while that is happening i cannot load new sites, new observable items, or work on additional jobs. So it is an hour I have to wait until I can continue working on data. This is too long to load a relatively small data sheet. Ingest time historically used to range from a few seconds up to 4 mins (for very large sheets), but this lag has increased over time and now it is unsustainable for successful/productive workflow.

@utas-raymondng
Copy link
Contributor

OK let me try in on my side to see where the time spend, thanks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
issue inconsistent with the specification / other T3 - NRMN
Projects
None yet
Development

No branches or pull requests

2 participants