[BUG] CSV files unable to upload

[yschan-ntu]

Is there an existing issue for this?

• I have searched the existing issues

Description

Hi, am still testing the library! I was trying to upload a testing dataset in CSV. However, I kept getting errors, although am unsure what error I am hitting since there is no error message shown on the portal. I also tried with the datasets provided, but doesn't seem to be a go. Same issue with the models.

Current Behavior

Abortion of upload without a clear error message.

Expected Behavior

I thought that since .CSV is a comma delimited file, it should be able to upload. Minimally, an error message to troubleshoot this issue would be nice.

Steps To Reproduce

I was following the steps on uploading a model dataset. Ideally, there really shouldn't be any issue.

Environment

- Operating System and Version:
- AI Verify Version: 0.9
- Any other relevant information (e.g. version of related package dependencies installed):
As it was built from Docker, thought that this shouldn't be an issue.
Did you build using source code or from docker file?
- From Docker

Screenshots/ Code snippets

Error Message Shown

When I tried to see what the actual error was, so far was unable to get anything.

Additional Context

To note, facing the same issue with models as well since I tried uploading using the default models provided.

Possible Solution (Optional)

No response

[kimeetok]

Hi @yschan-ntu , we are unable to recreate this bug on our end. Are you able to share the validation error message with us? You can get it by clicking on the row (see screenshot). Meanwhile, perhaps you could try re-building the docker image with no-cache and see if the issue persists. Thank you!

[yschan-ntu]

Clicking on row does not return me any error message as well.

Anyways, I think I will try to rebuild it with no-cache. I will report back on whether this helps.

[yschan-ntu]

Have already rebuilt with no-cache. Issue seems to have been resolved after rebuilding with no-cache using the 17th June release.

[yschan-ntu]

A quick update on this bug: seems that this is intermittent. I have faced a similar error on a different day, where datasets and models that are valid were not able to upload without any valid error message. While this resolves itself upon restart of the container (workaround), I would consider this a bug still.

[imda-benedictlee]

Hi @yschan-ntu, can I clarify with you what you mean by "datasets and models that are valid were not able to upload without any valid error message"? Also, what are the specific steps that you took to reach the error?

[yschan-ntu]

Hi @yschan-ntu, can I clarify with you what you mean by "datasets and models that are valid were not able to upload without any valid error message"? Also, what are the specific steps that you took to reach the error?

As per the screenshot above (https://user-images.githubusercontent.com/133835535/255117197-84f2c22f-3ee2-4d41-97fb-18cfd9f55f60.png), when I uploaded a .CSV file that has previously uploaded without any issues (I tested with a number of file in case the files I tried uploading was corrupted), it gave me an error without any error message. Which is to say, I am unable to troubleshoot any errors with the file even if it has occurred. Note that after restarting, I was able to upload the file successfully.

The steps I have followed are as per the successful datasets standard upload, nothing out of the ordinary.

Note that this is an intermittent issue though.

[imda-benedictlee]

Hi @yschan-ntu, thanks for providing more context on the issue, and apologies for the delay in response. After discussion with the team, we would like your help in providing screenshots of the logs in the Docker containers for the Test Engine App, API GW, and Portal when you encounter the issue again. This will inform us of what actually happens before and during the upload process.

[yschan-ntu]

Just happened today, please see attached for a copy and paste of the logs at 4.11pm.

2023-08-16 AiVerify-User-Portal-1.txt
2023-08-16 161103 aiverify-user-test-logs.txt

For reference, this is the screenshot of the failed dataset:

[kimeetok]

Hi @yschan-ntu , thanks for the logs they are helpful in scoping the issue. We are still trying to reproduce the bug on our end, will continue to monitor it and tag it as awaiting more evidence

[imda-benedictlee]

Hi @yschan-ntu, I would like to check in to see if this issue still persist for you. If so, would you be able to provide the CSV that you used previously as showed in the screenshot?