[BUG] Client side exception

[Gary-Isaac]

Is there an existing issue for this?

• I have searched the existing issues

Description

I am testing the Alpha release deployed on my local computer (WSL 2 on Windows 11). I followed the credit default tutorial. AI Verify completes the tests however the report states "Application error: a client-side exception has occurred (see the browser console for more information)." I have attached the logs. Which logs should I look at to debug?

Current Behavior

The report does not generate with the expected content.

Expected Behavior

AI Summary Report created with the test and process results.

Steps To Reproduce

Follow the tutorial with the test data and model supplied by AI Verify.

Environment

- Operating System and Version: Ubuntu 22.04 on WSL 2 Windows 11
- AI Verify Version: Alpha 1.0
- Any other relevant information (e.g. version of related package dependencies installed):

Built from source code.
- Python Version: 3.11.10
- Node Version: 18.20.4
- Redis Version: 
- Mongo Version: 
- Screen Resolution:

Screenshots/ Code snippets

task67709c92f235e802147a4538-6770a2c2f235e802147a68c8.log
task67709c92f235e802147a4538-6770a2c2f235e802147a68c9.log
0c9e4a43-d178-4fc6-8924-6f4fb44a3148.log

Additional Context

No response

Possible Solution (Optional)

No response

[Gary-Isaac]

I fixed the report generation issue. I believe it was because the SHAP Toolbox plugin did not install when I built AI Verify. I installed the plugin by downloading the folder from Github and installing the zip files from the dist folder. I used the AI Verify UI plugin manager to install it. However, I get an error that AI Verify cannot find the SHAP Toolbox algorithm. The report generates successfully but shows the SHAP tests failed. Any ideas?

2025-01-01 13:47:26,885 [INFO][app_logger.py::add_to_log(116)] [plugin_controller.py:get_plugin_instance(112)]: Attempting to find algo:aiverify.stock.shap_toolbox:shap_toolbox in the algorithm registry
2025-01-01 13:47:26,902 [INFO][app_logger.py::add_to_log(116)] [plugin_controller.py:get_plugin_instance(141)]: algo:aiverify.stock.shap_toolbox:shap_toolbox is in the algorithm registry. Attempting to re-discover algorithm
2025-01-01 13:47:26,963 [ERROR][log_utils.py::log_message(37)] [algorithm_manager.py:get_algorithm(126)]: There was an error getting algorithm instance (not found): algo:aiverify.stock.shap_toolbox:shap_toolbox
2025-01-01 13:47:26,964 [WARNING][app_logger.py::add_to_log(121)] [task_processing.py:process_new_task(189)]: The task terminated: Unable to get algorithm instance: There was an error loading algorithm: There was an error getting algorithm instance (not found): algo:aiverify.stock.shap_toolbox:shap_toolbox

task67758d502a3243fb90498a79-67758dbd2a3243fb9049a7d4.log
aiverify.stock.shap_toolbox-0.10.0.zip
aiverify.stock.shap_toolbox-1.0.0.zip

[imda-benedictlee]

Hi @Gary-Isaac, let me take a look at this and update you soon. Can I check if this is for aiverify 1.0 or 2.0?

[Gary-Isaac]

Thank you Benedict. I thought it was 2.0 but I see 1.0 when I start it up. Where can I see the version? I wanted to install 2.0 but could not extract the zip file from your Releases. I downloaded the Main branch from Github as a zip file. Then I built AI Verify. I thought the main branch would be 2.0? Does AI Verify use the plugins in the stock-plugins folder after they are installed? Or, do they install into another folder? I am wondering if file permissions are causing the app to not find the algorithm. Thanks again, Gary

…

________________________________ From: Benedict Lee ***@***.***> Sent: Thursday, January 2, 2025 12:24 AM To: aiverify-foundation/aiverify ***@***.***> Cc: Gary Isaac ***@***.***>; Mention ***@***.***> Subject: Re: [aiverify-foundation/aiverify] [BUG] Client side exception (Issue #382) Hi @Gary-Isaac<https://github.com/Gary-Isaac>, let me take a look at this and update you soon. Can I check if this is for aiverify 1.0 or 2.0? — Reply to this email directly, view it on GitHub<#382 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AYQQZ3LEA4LJNZ43D6JTK6L2ITEP7AVCNFSM6AAAAABUKKMR52VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKNRXGI4TQMBXGM>. You are receiving this because you were mentioned.Message ID: ***@***.***>

[imda-benedictlee]

Hi @Gary-Isaac, currently we are still in the process of building v2.0. The branch for v2.0 is in v2.x, which can be found at this link: https://github.com/aiverify-foundation/aiverify/tree/v2.x. For this release of AI Verify, the plugins can be run in a standalone mode. If you would like to try it, you can clone it locally on your machine and go into the stock plugins folder.

Using Accumulated Local Effects Algorithm as an example [https://github.com/aiverify-foundation/aiverify/tree/v2.x/stock-plugins/aiverify.stock.accumulated-local-effect], you can install the plugin locally on your machine using the instructions provided here [https://github.com/aiverify-foundation/aiverify/tree/v2.x/stock-plugins/aiverify.stock.accumulated-local-effect/algorithms/accumulated_local_effect] and run the command to run the test.

For your question for the plugins in the stock plugins folder for AI Verify 1.0, it will look inside each dist folder inside the stock plugin and unzip it into the AI Verify Portal Plugin Directory. The portal will scan the Plugin Directory and load it into AI Verify. Below is a code snippet of the setup process.

# Unzip stock plugin bundles into the plugins folder cd stock-plugins for plugin_dir in *; do \ echo "Unpacking stock plugin $plugin_dir"; \ unzip -o $plugin_dir/dist/*.zip -d ../ai-verify-portal/plugins/$plugin_dir; \ done cd ..

[Gary-Isaac]

Thank you Benedict! I will follow your instructions for 2.0 and check the permissions on the Portal Plugin Directory. Have a great day!

…

________________________________ From: Benedict Lee ***@***.***> Sent: Monday, January 13, 2025 10:44 PM To: aiverify-foundation/aiverify ***@***.***> Cc: Gary Isaac ***@***.***>; Mention ***@***.***> Subject: Re: [aiverify-foundation/aiverify] [BUG] Client side exception (Issue #382) Hi @Gary-Isaac<https://github.com/Gary-Isaac>, currently we are still in the process of building v2.0. The branch for v2.0 is in v2.x, which can be found at this link: https://github.com/aiverify-foundation/aiverify/tree/v2.x. For this release of AI Verify, the plugins can be run in a standalone mode. If you would like to try it, you can clone it locally on your machine and go into the stock plugins folder. Using Accumulated Local Effects Algorithm as an example [https://github.com/aiverify-foundation/aiverify/tree/v2.x/stock-plugins/aiverify.stock.accumulated-local-effect], you can install the plugin locally on your machine using the instructions provided here [https://github.com/aiverify-foundation/aiverify/tree/v2.x/stock-plugins/aiverify.stock.accumulated-local-effect/algorithms/accumulated_local_effect] and run the command to run the test. For your question for the plugins in the stock plugins folder for AI Verify 1.0, it will look inside each dist folder inside the stock plugin, unzip it into the AI Verify Portal Plugin Directory. The portal will scan the Plugin Directory and load it into AI Verify. Below is a code snippet of the setup process. # Unzip stock plugin bundles into the plugins folder cd stock-plugins for plugin_dir in *; do \ echo "Unpacking stock plugin $plugin_dir"; \ unzip -o $plugin_dir/dist/*.zip -d ../ai-verify-portal/plugins/$plugin_dir; \ done cd .. — Reply to this email directly, view it on GitHub<#382 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AYQQZ3NAXDKNS56AEEKGJ2L2KSBY3AVCNFSM6AAAAABUKKMR52VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKOBYHA3DMMJUGU>. You are receiving this because you were mentioned.Message ID: ***@***.***>

[imda-benedictlee]

Hi @Gary-Isaac, yes, do try out the instructions and let me know if you require additional assistance on this.

[Gary-Isaac]

Thank you Benedict. How do I install the app for the https://github.com/aiverify-foundation/aiverify/tree/v2.x branch? In the past, I have used the install script in the aiverify-dev folder of setup-aiverify. I can install version 2 on the same WSL Ubuntu system as version 1. Do you recommend settibg it up on its own WSL instance?

…

________________________________ From: Benedict Lee ***@***.***> Sent: Wednesday, January 15, 2025 4:38 AM To: aiverify-foundation/aiverify ***@***.***> Cc: Gary Isaac ***@***.***>; Mention ***@***.***> Subject: Re: [aiverify-foundation/aiverify] [BUG] Client side exception (Issue #382) Hi @Gary-Isaac<https://github.com/Gary-Isaac>, yes, do try out the instructions and let me know if you require additional assistance on this. — Reply to this email directly, view it on GitHub<#382 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AYQQZ3IA6NNFS7LTRBBQFB32KYUCNAVCNFSM6AAAAABUKKMR52VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDKOJSGEZTGMZVGE>. You are receiving this because you were mentioned.Message ID: ***@***.***>

[imda-benedictlee]

Hi @Gary-Isaac, for AI Verify 2.0, the UI Frontend is still in the midst of development. Instead, each of the stock plugins can be run standalone and individually in the Command Line without the UI. I will update you again here on this thread when the UI is developed and ready for used.

Regarding Version 2 on the same WSL, the current release of AIV 2.0 can be run on the same WSL as Version 1.0. I will provide more information for AIV 2.0 here on this thread as well when I have more information to share with you, so stay tuned!

[Gary-Isaac]

Thanks! I didn’t understand that the UI is in development when you mentioned the plugins can be run in standalone mode earlier in the thread. I will wait for your team to finish the UI. Thanks! Get Outlook for iOS<https://aka.ms/o0ukef>

…

________________________________ From: Benedict Lee ***@***.***> Sent: Monday, January 20, 2025 9:32:59 PM To: aiverify-foundation/aiverify ***@***.***> Cc: Gary Isaac ***@***.***>; Mention ***@***.***> Subject: Re: [aiverify-foundation/aiverify] [BUG] Client side exception (Issue #382) Hi @Gary-Isaac<https://github.com/Gary-Isaac>, for AI Verify 2.0, the UI Frontend is still in the midst of development. Instead, each of the stock plugins can be run standalone and individually in the Command Line without the UI. I will update you again here on this thread when the UI is developed and ready for used. Regarding Version 2 on the same WSL, the current release of AIV 2.0 can be run on the same WSL as Version 1.0. I will provide more information for AIV 2.0 here on this thread as well when I have more information to share with you, so stay tuned! — Reply to this email directly, view it on GitHub<#382 (comment)>, or unsubscribe<https://github.com/notifications/unsubscribe-auth/AYQQZ3OEMWWZCUMRPXS3DF32LWWVXAVCNFSM6AAAAABUKKMR52VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDMMBTGUYDENBWGQ>. You are receiving this because you were mentioned.Message ID: ***@***.***>