The justice system, banks, and private companies use algorithms to make decisions that have profound impacts on people’s lives. Unfortunately, those algorithms are sometimes biased—disproportionately impacting people of color as well as individuals in lower-income classes when they apply for loans or jobs, or even when courts decide what bail should be set while a person awaits trial.
MIT researchers have developed a new AI programming language that can assess the fairness of algorithms more exactly, and more quickly, than available alternatives.
Their Sum-Product Probabilistic Language (SPPL) is a probabilistic programming system. Probabilistic programming is an emerging field at the intersection of programming languages and artificial intelligence that aims to make AI systems much easier to develop, with early successes in computer vision, common-sense data cleaning, and automated data modeling. Probabilistic programming languages make it much easier for programmers to define probabilistic models and carry out probabilistic inference—that is, work backward to infer probable explanations for observed data.
There are previous systems that can solve various fairness questions. Our system is not the first; but because our system is specialized and optimized for a certain class of models, it can deliver solutions thousands of times faster.
SPPL gives fast, exact solutions to probabilistic inference questions such as “How likely is the model to recommend a loan to someone over age 40?” or “Generate 1,000 synthetic loan applicants, all under age 30, whose loans will be approved.” These inference results are based on SPPL programs that encode probabilistic models of what kinds of applicants are likely, a priori, and also how to classify them. Fairness questions that SPPL can answer include “Is there a difference between the probability of recommending a loan to an immigrant and nonimmigrant applicant with the same socioeconomic status?” or “What’s the probability of a hire, given that the candidate is qualified for the job and from an underrepresented group?”
SPPL is different from most probabilistic programming languages, as SPPL only allows users to write probabilistic programs for which it can automatically deliver exact probabilistic inference results. SPPL also makes it possible for users to check how fast inference will be, and therefore avoid writing slow programs. In contrast, other probabilistic programming languages such as Gen and Pyro allow users to write down probabilistic programs where the only known ways to do inference are approximate—that is, the results include errors whose nature and magnitude can be hard to characterize.
Error from approximate probabilistic inference is tolerable in many AI applications. But it is undesirable to have inference errors corrupting results in socially impactful applications of AI, such as automated decision-making, and especially in fairness analysis.
SPPL avoids errors by restricting to a carefully designed class of models that still includes a broad class of AI algorithms, including the decision tree classifiers that are widely used for algorithmic decision-making. SPPL works by compiling probabilistic programs into a specialized data structure called a “sum-product expression.” SPPL further builds on the emerging theme of using probabilistic circuits as a representation that enables efficient probabilistic inference. This approach extends prior work on sum-product networks to models and queries expressed via a probabilistic programming language. However, Saad notes that this approach comes with limitations: “SPPL is substantially faster for analyzing the fairness of a decision tree, for example, but it can’t analyze models like neural networks. Other systems can analyze both neural networks and decision trees, but they tend to be slower and give inexact answers.”
SPPL shows that exact probabilistic inference is practical, not just theoretically possible, for a broad class of probabilistic programs. In my lab, we’ve seen symbolic inference driving speed and accuracy improvements in other inference tasks that we previously approached via approximate Monte Carlo and deep learning algorithms. We’ve also been applying SPPL to probabilistic programs learned from real-world databases, to quantify the probability of rare events, generate synthetic proxy data given constraints, and automatically screen data for probable anomalies.
-
electronica India and Productronica India along with MatDispens are Rescheduled to December 16–18, 2021
-
Honda Launches New U-GO Electric Scooter
-
Decks Cleared for Assam State Electronics Development Corporation Limited for High Speed Internet Connectivity
-
Geo-imaging Satellite “EOS-03” is Scheduled for Launch in Third Quarter of 2021
Mayank Vashisht
-
Mayank Vashishthttps://www.eletimes.com/author/mayankvashishtAnritsu’s Measurement Solutions for 5G NR Communications at Anritsu Test and Measurement Web Expo – Spring 2021
-
Mayank Vashishthttps://www.eletimes.com/author/mayankvashishtAI and ML will Unlock the Next Level in Chip Design Game
-
Mayank Vashishthttps://www.eletimes.com/author/mayankvashishtThe Artificial General Intelligence (AGI) and the Real Existential Threat Hypothesis
-
Mayank Vashishthttps://www.eletimes.com/author/mayankvashishtExtended Reality, Fading the Lines between Imagination and Reality