Interdisciplinary migration research is currently witnessing an increased interest in the impact of colonialism, decolonization, and expertization on present-day integrationism and racism. Tracing the genealogy of current ways of framing, categorizing, and governing groups viewed as “migrant Others” forms part of a reflexive research agenda that analyses migration as a product of changing constellations and categorizations. The article takes up this interest in the recent (and sometimes less recent) past in migration research. Bringing this interdisciplinary body of work into conversation with historical scholarship, we discuss how migration scholars make use of historical genealogies and we identify three different ways of relating the past to the present in debates about current migration and border regimes: We distinguish between what we term an anthropological “deep history” mode, a “genealogical” mode, and a “contrapuntal” or “disruptive” mode. This article argues for a careful, reflexive use of the past. We contend that both the alterity of past discourses and practices and their persistence and lasting impact can help us better make sense of the present in critical migration research.