bias.myti.report

bias.myti.report is a visualization tool to facilitate the comparison of user-implemented bias mitigation methods for AI models.

Overview of the bias amplification process

---

This repository contains the implementation of two AI bias amplification approaches presented in the paper: “Bias amplification to facilitate the systematic evaluation of bias mitigation methods”. The graphical user interface(GUI) tool helps the user to better understand the amplified model bias with or without bias mitigation. The whole platform allows an objective assessment and systematic comparison of bias mitigation methods, and assists the user to select the most appropriate mitigation method under different circumstances.

• Testing results for two amplification approaches are included in two example Jupyter notebooks, please see here to access.

• Instructions on how to use the GUI tool can be found here.

Related References

• A. Burgon, Y. Zhang, N. Petrick, B. Sahiner, K. H. Cha, R. K. Samala, "Bias amplification to facilitate the systematic evaluation of bias mitigation methods", in IEEE Journal of Biomedical and Health Informatics (2024) doi:10.1109/JBHI.2024.3491946
• A. Burgon, Y. Zhang, B. Sahiner, N. Petrick, K. H. Cha, R. K. Samala*, “Manipulation of sources of bias in AI device development”, Proc. of SPIE (2024)
• Y. Zhang, A. Burgon, N. Petrick, B. Sahiner, G. Pennello, R. K. Samala*, “Evaluation of AI bias mitigation algorithms by systematically promoting sources of bias”, RSNA Program Book (2023)

Introduction

With increasing utilization of AI in clinical practice, it is critical to understand and control AI model bias to ensure health equities. Numerous methods have been developed to mitigate bias, however, there is a lack of consistent way to systematically evaluate the effectiveness and potential trade-off of these mitigation methods. To facilitate such evaluation, we presented two bias amplification approaches by promoting the spurious correlation between AI outputs and patient attributes.

• Quantitative misrepresentation: a manipulation of data selection to the training set such that the disease prevalence is varied between different patient subgroups.
• Inductive transfer learning: a two-step transfer learning approach where the AI is trained to classify patient attributes during the first step. The AI is then fine-tuned to perform clinical tasks during the second step.

Getting Started

For detailed information, view the bias.myti.report documentation.

Bias Amplification

Examples showing instructions on how to implement the two bias amplification approaches can be found in example for quantitative misrepresention (/example/Bias amplification (quantitative misrepresentation) example.ipynb) and example for inductive transfer learning (/example/Bias amplification (inductive transfer learning) example.ipynb).

Quick Guide for bias.myti.report GUI

To visualize the bias by bias.myti.report GUI, run the following code:

cd src/
python mytiUI.py

Here is a quick guidance on how to use the tool.

Page 1 (Input page)

1. Select and upload the csv file that contains calculated bias measurements.
2. Specify the implemented bias amplification approach (quantitative misrepresentation or inductive transfer learning).
3. Select the study type (mitigation comparison, finite sample size or none of these).

Click the 'Next Page' button on bottom left after all steps are finished and navigate to the next page.

Preview of page 1

---

Page 2 (Variables Page)

1. Click the icons to display detailed information for corresponding variables.
2. Specify corresponding column names in the csv file to variables.

Click the 'Next Page' button on bottom left after all steps are finished and navigate to the next page.

Preview of page 2

---

Page 3 (Report Page)

1. Previews for bias visualization figures. Click on the figure for display.
2. Selected figure will be displayed along with the description below.
3. Click to customize subgroup colors in the figure.
4. Click the "Save Report" button to save the selected figure and description as a report. Example reports are included in the example folder.

Preview of page 3

---

Example Outputs

Example figure showing bias mitigation comparison when sex-related bias has been amplified by quantitative misrepresentation. Each subplot shows the predicted disease prevalence within each patient subgroup.

---

For more detailed information, view the bias.myti.report documentation.

System Requirements

The tool is developed and tested with Ubuntu 22.04.3 LTS and python 3.10.12.

The tool is tested with NVIDIA Tesla V100 SXM2 32 GB, with NVIDIA Driver Version 550.67 and CUDA version 12.4.

Python package requirements can be found in requirements.txt.

Potential Issue & Solution

If the user encounters the following error when trying to launch the GUI during first time:

qt.qpa.plugin: Could not load the Qt platform plugin "xcb" in "" even though it was found.

The solution is to install the dependency by running:

apt-get install libxcb-cursor0

Data

The imaging and associated clinical data downloaded from MIDRC (The Medical Imaging and Data Resource Center) and used for research in this repository was made possible by the National Institute of Biomedical Imaging and Bioengineering (NIBIB) of the National Institutes of Health under contract 75N92020C00021. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health.