Having a concept usually has some epistemic benefits. It might give one means to knowing certain facts, for example. This paper explores the possibility that having a concept can have an epistemic cost. I argue that it typically does, even putting aside our contingent limitations, assuming that there is epistemic value in understanding others from their own perspectives.