Algorithmic Transparency with Strategic Users: when a firm strictly prefers a transparent hiring algorithm, region by region in the agents' cost planeResearch Paper
Why transparency of a hiring algorithm is an economic question
Firms increasingly screen job applicants, borrowers and customers with algorithms built on observable features. Regulators and the public ask for these algorithms to be made transparent, and firms often resist, arguing that agents who know the algorithm will game it. Wang, Huang, Jasin and Singh (arXiv:2008.09283, 2020; published in Management Science, 2023) model this tension as a game between a firm and strategic agents. They separate causal features, which change an agent's productivity (education), from correlational features, which only predict it. Their first headline result, Theorem 1, says exactly when a profit-maximizing firm is better off disclosing its algorithm. The answer depends on the agents' education costs, region by region in the cost plane.
The model builds on the signaling literature, in which education is both a signal and a source of productivity (Spence, 1973; Weiss, 1983), and on strategic classification, where agents manipulate the features a classifier uses (Hardt et al., 2016).
Setting
A unit mass of agents contains a share of high-talent agents (type H) and of low-talent agents (type L). A share of H agents and a share of L agents are high on a correlational feature. Every agent may acquire education at cost (type H) or (type L), with . An agent's productivity is , and the firm pays every hired agent the wage . The standing assumptions are (Assumption 1) and two-sided bounds on and (Assumptions 2 and 3) that exclude trivial equilibria.
In the opaque game the agents do not know the correlational feature. They choose education, ending in one of four states (education 0/1 times feature 1/0), and the firm hires state with probability . In the transparent game every agent raises the disclosed feature, so only education matters (states , ). Each type plays a common mixed strategy: it improves with probability or . The firm's payoff is , where the margin is computed from the masses in state . A Nash equilibrium requires each type to best-respond, and the firm to hire an occupied state surely when and never when . In the opaque game the agents move first and coordinate on the payoff-dominant equilibrium (IsOpaqueOutcome), the one that is best for both types at once.
Formalization targets
Goal: Theorem 1, corrected
Let be the firm's payoff at any selected opaque outcome and its payoff at any transparent equilibrium. On seven open regions of the plane (InRegion):
with , the explicit thresholds (13)–(14). The statement also asserts that the compared equilibria exist, so no clause holds vacuously.
Milestones
The milestones follow the paper's argument: the firm's thresholds (12); the opaque cases that cannot be equilibria; Lemma 1, the selected opaque outcome per region; the transparent cases that cannot be equilibria; Lemma 2, the transparent equilibrium; and the five payoff comparisons (N1–N3, (13), (14), (15), C4).
Significance
Theorem 1 overturns the common view that transparency always hurts the firm. Disclosure destroys the predictive value of the correlational feature, but it also intensifies competition on education. Where this makes the types separate (), or where education is productive enough (, ), the firm gains. The thresholds are explicit, so the result gives testable conditions for the regulatory debate.
The printed theorem is false on part of its region map. The paper rules out equilibria in which both types mix ("case 9", p.18). At , , , , and , a point of the printed region , a both-types-mixing equilibrium exists and dominates for both types. Its firm payoff is , below the transparent payoff . The printed case-4 region of Lemma 1 also reverses an inequality. The mission states the corrected theorem: the boundary between and moves to the ray , and the clause, with the same threshold , holds on the enlarged region . No machine-checked proof of any part of the paper exists. A formal proof settles the corrected region map, which so far rests on exact-rational sampling.
Difficulty
The algebra is elementary; the difficulty is completeness. The paper's argument checks a list of nine strategy patterns, each with a guessed hiring vector. A proof of Theorem 1 must instead classify all equilibria: every sign pattern of the four margins, every tie, and every degenerate line inside a region, where continua of equilibria appear. It must then show that the payoff-dominant one exists and has the stated payoff. The obvious shortcut is to argue that L agents cannot need a higher hiring chance than H agents. It fails because the two types sit at different values of the correlational feature: both types are indifferent in a mixed equilibrium whenever . The remaining steps are sign arguments for rational functions of under Assumptions 1–3. The hardest is the positivity of the denominator of the case-9 payoff , whose minimum approaches zero as .
Formalization scope
All quantities are real numbers. Strategies are a common mixed strategy per type, with expected masses. Firm optimality is stated through the signed margins, never through the ratios , which are at an unoccupied state. At an unoccupied state the firm hires an educated state with probability 1 and an uneducated state with probability 0. This off-path convention is used by every equilibrium in the paper's appendix, and without it the payoff-dominance selection has no solution in region . Selection compares against every opaque equilibrium, not against the paper's list of cases. Regions are open sets read off Figure 4; boundaries are not claimed. is kept: there the opaque game has no equilibrium on , so that clause is vacuous and existence is not claimed there.
The definitions are self-contained: parameters and assumptions (Params, Standing), the two games (masses, margins, payoffs, utilities), the two equilibrium predicates, the selection, the regions and the thresholds. Contributions are welcome on each milestone. The equilibrium classifications (Lemmas 1 and 2) are the core; the five payoff comparisons are independent ordered-field exercises.
Selected references
- Q. Wang, Y. Huang, S. Jasin, P. V. Singh, Algorithmic Transparency with Strategic Users, arXiv:2008.09283v1, 2020; published in Management Science, 2023. https://arxiv.org/abs/2008.09283
- M. Spence, Job Market Signaling, Quarterly Journal of Economics 87(3), 355–374, 1973. https://doi.org/10.2307/1882010
- A. Weiss, A Sorting-cum-Learning Model of Education, Journal of Political Economy 91(3), 420–442, 1983. https://doi.org/10.1086/261147
- M. Hardt, N. Megiddo, C. Papadimitriou, M. Wootters, Strategic Classification, ITCS 2016. https://doi.org/10.1145/2840728.2840730