Summary
The authors are focused on matching markets in which different firms use a single algorithm / evaluation criterion (monoculture) vs. markets where different firms may each have different evaluation algorithms / criterion (polyculture). This can be seen as a substantial generalization of the wonderful work of Kleinberg and Raghavan [35] on monoculture in hiring with two firms.
The authors first introduce the continuum matching market model introduced by Azevedo and Leshno [10]. Here, there is a continuum of applicants, and a finite number of firms. The authors make the assumptions that (1) each firm has the same fixed capacity, and (2) not all applicants will eventually be matched with a firm. The authors first review critical results in the existing continuum model. These include the fact that a stable matching corresponds to a particular cutoff vector, and subject to this cutoff vector, applicants always choose their highest preferred firm for which their estimated quality is higher than the cutoff for that firm.
Next, the authors introduce their notion of mono and polyculture into this model. Intuitively, monoculture is where each firm has an identical estimate of the value of an applicant of type $\theta(v)$, given by $v + X$ for an $X$ drawn from some noise distribution $D$. This captures, for example, each firm using Chat GPT to evaluate the resumes of all applicants. In polyculture, each firm $i$ may have a different estimate $v + X_i$ for the value of applicants of type $\theta(v)$.
The authors begin by proving that the cutoff characterization of stable matching is unique in the mono and polyculture settings (Lemma 2). This follows from the lattice structure of stable matchings. Then, in Proposition 3, they show that the probability of an applicant of type $\theta(v)$ being matched under polyculture is related to the maximum of $X_i$ over all firms' noisy estimates $X_i$, whereas under monoculture this probability is related only to $X$ (since all firms have identical estimates).
We now move to the main results. In Theorem 1, the authors show that under polyculture, as the number of firms $m \to \infty$, the (firm-) optimal welfare can be achieved by the resulting matching. This does not hold for monoculture. In particular, under monoculture, the probability that an individual of type $\theta(v)$ is matched at all is constant for varying $m$.
In Theorem 2, the authors examine applicant welfare. They show that applicants have a higher chance of being matched with their top choice under monoculture, but that for a subset of applicants of positive measure, the variance in whether they are matched or not is higher under monoculture than polyculture. This means that not all applicants are incentivized to prefer monoculture unconditionally.
Finally, some extensions under a differential application access setting are provided. Intuitively, the authors show that more applications do not help applicants under monoculture but does under polyculture. Experiments complement most of the theoretical results, and also demonstrate that the uniform preference assumption is not essential to practical relevance of the results.
Strengths
The paper is generally extremely well written, motivated, and clear. I also think that the work is already very important in the modern context in which universities and hiring managers may already be using one of only a handful of services to conduct automated applicant filtering. The work examines what this would potentially lead to in terms of macroeconomic market dynamics.
The theoretical results are presented clearly, and I understood most even though I have not personally worked in the continuum matching model (have only worked in the discrete matching model). I appreciate that the authors also empirically investigate the (strong) assumption that all applicants' preferences over firms are drawn uniformly at random. The empirical results confirm that this is perhaps not a fundamental assumption, even though the (current) proofs critically hinge on it.
This work certainly challenged my preconceived notion (“monoculture=bad”) in a fundamental way and may open a more general line of inquiry into monoculture more broadly. This paper was a pleasure to read, and I look forward to additional work from the authors.
Weaknesses
Note that I did not carefully check the proofs.
(W1) I think the introduction of the continuum model could be made a bit more clear, in particular the definition of applicant types. For example, there seems to be a small typo in lines 141-142:: “The realization of θ(v) is their type, which lies in $\Theta \coloneqq \mathcal{R} \times \mathbb{R}^m$ is the set of applicant types,”.
Further, I am not sure if this is a typo as well (in line 143): “$\succ^\theta$ is the preference ordering of v over firms…”. Do all applicants of value $v$ have the same type $\theta(v)$? That is, do all have the same preferences over firms? Or, do we draw different preferences uniformly at random for each individual of value $v$? These were not clear from just this introduction on the continuum model.
(W2) The model considers identical noise across all applicant “types”. This is certainly a reasonable form of polyculture to analyze, however, in practice we may be more concerned with bias based on different “types” of individuals. I.e., historically underrepresented minorities having a skewed or higher variance noise distribution. “Types” in this sense is (I believe) not captured by solely preference and firm quality estimates. This is certainly less of a weakness and more of a direction of future work, but I think it is perhaps important to mention. The authors have some discussion in lines 350-352, but more could certainly be added earlier in the paper.
(W3) I think that the assumptions made throughout the work are sprinkled throughout the paper. Having a collection of all assumptions, perhaps in the appendix, may help the reader better understand the limitations of the work.
Minor: Most non-theorems from the main paper are referred to incorrectly in the appendix, e.g. Lemma 2 is mistakenly referred to as proposition 2 in the appendix, and similarly proposition 10 / lemma 10, and corollary 4 / proposition 4.
Questions
Q1: How does Lemma 2 (Equal Cutoffs Lemma) relate to Theorem 1 part 1 from Azevedo and Leshno [10], which says that if $\eta$ has full support, then there is a unique stable matching?
Q2: Do we expect the maximum concentrating distribution assumption to hold in, e.g., the included experiments?
Limitations
I do not believe that the authors have a dedicated limitations section of their paper, which I recommend. Some limitations are sprinkled throughout the paper (e.g. Line 350-353), but perhaps more could be mentioned. In particular, how strong/important the technical assumptions are in practice are could be explicitly discussed in a formal limitation section.