AI Transparency Index

[Maryblessing]

Metric basics

• Metric title: AI Transparency Index
• Metric summary (1-2 sentences): This metric measures the integration of AI models, datasets, and tools within open source projects while evaluating the transparency of documentation, its adherence to ethical guidelines, and the diversity of contributors.
• Why should this metric be created? (1-2 sentences): I think if considered might reduce ethical risks (e.g biased models), fostering trust and compliance.
  Knowing contributor demographics can reduce the risk of biased AI outputs on OS projects

here is a rough working document I started: https://docs.google.com/document/d/1cT5y4EpqQVq1F1j1KPish3quL08tsFIjcg0I5KOdMCY/edit?usp=sharing. I'm hoping to get support from this group

Data collection and measurement

Are there existing tools that could collect this data? If yes, list them:
Nil

If this metric involves a lot of raw data, what filters would you use to narrow down the metric? If applicable, describe ways to filter the data into smaller segments:
Nil

How would you visualize this metric? If you have an idea on how this metric should be visualized or displayed so it makes the most sense to a viewer, describe that here:
Nil

About you

• Are you interested in authoring this metric together with the Working Group?: yes
• Have you attended a CHAOSS Working Group meeting before?: yes
• If not, would you consider joining one to discuss your metric idea?:
• Anything else you would like us to know?: