Table 1.

Available open-source tool kits for bias detection and mitigation

Tool	Year	Description	Target	GitHub	License	Paper	Bias Detection	Bias Mitigation
AIF360 [79]	2019	Open-source Python tool kit	Performance benchmarking	https://github.com/Trusted-AI/AIF360	Apache version 2.0	https://ieeexplore.ieee.org/abstract/document/8843908	Yes	Yes
Themis-ML [80]	2017	Open-source Python tool kit	Measure fairness for binary classification	https://github.com/cosmicBboy/themis-ml	MIT open-source	https://arxiv.org/abs/1710.06921	Yes	Yes
Fairlearn [81]	2020	Open-source Python tool kit	Interactive visualization dashboard and unfairness mitigation	https://github.com/fairlearn/fairlearn	MIT open-source	https://www.microsoft.com/en-us/research/publication/fairlearn-a-toolkit-for-assessing-and-improving-fairness-in-ai/	Yes	Yes
FairML [82]	2016	Open-source Python tool kit	Audit cumbersome predictive models	https://github.com/adebayoj/fairml	MIT open-source	https://dspace.mit.edu/handle/1721.1/108212	Yes	No
Aequitas [83]	2018	Open-source Python tool kit	Visualization of bias metrics	https://github.com/dssg/aequitas	MIT open-source	https://arxiv.org/abs/1811.05577	Yes	No
VerifyML [84]	2022	Open-source Python tool kit	Computing fairness degree	https://github.com/cylynx/verifyml	Apache version 2.0	https://arxiv.org/abs/2210.08418	Yes	No
Fairkit-Learn [85]	2022	Open-source interactive Python tool kit	Understand fairness and support training	https://github.com/INSPIRED-GMU/fairkit-learn	–	https://people.cs.umass.edu/~brun/pubs/pubs/Johnson22.pdf	Yes	Yes
Fairness comparison [86]	2018	Open-source Python + R	Access to fairnessenhancing classification algorithms	https://github.com/algofairness/fairness-comparison	Apache version 2.0	https://arxiv.org/abs/1802.04422	Yes	Yes
Fairness Measures [87]	2017	Open-source Python	Measure fairness with new metrics	https://github.com/FairnessMeasures/fairness-measures-code	GPL-3.0	https://link.springer.com/article/10.1007/s10618-017-0506-1	Yes	No
FairTest [88]	2015	Open source Python + MongoDB + Python R interface	Discover confounding factor	https://github.com/columbia/fairtest	Apache version 2.0	https://arxiv.org/abs/1510.02377	Yes	No
Google’s What-If Tool [89]	2020	Open source Interactive Python toolbox	Understanding of a black-box classification or regression ML model	https://github.com/pair-code/what-if-tool	Apache version 2.0	https://pair-code.github.io/what-if-tool/	Yes	No
IBM Watson OpenScale [90]	2022	Cloud engine: free basic	Monitor AI models for bias, fairness, and trust	https://github.com/IBM/watson-openscale-samples	Apache version 2.0	https://www.ibm.com/docs/en/cloud-paks/cp-data/3.5.0?topic=services-watson-openscale	Yes	Yes