The granular dorsolateral prefrontal cortex (dlPFC) is an evolutionary specialization of primates that is centrally involved in cognition. We assessed more than 600,000 single-nucleus transcriptomes from adult human, chimpanzee, macaque, and marmoset dlPFC. Although most cell subtypes defined transcriptomically are conserved, we detected several that exist only in a subset of species as well as substantial species-specific molecular differences across homologous neuronal, glial, and non-neural subtypes. The latter are exemplified by human-specific switching between expression of the neuropeptide somatostatin and tyrosine hydroxylase, the rate-limiting enzyme in dopamine production in certain interneurons. The above molecular differences are also illustrated by expression of the neuropsychiatric risk gene FOXP2, which is human-specific in microglia and primate-specific in layer 4 granular neurons. We generated a comprehensive survey of the dlPFC cellular repertoire and its shared and divergent features in anthropoid primates.