Neuropsychological and neuroimaging data have shown a functional lateralization of the medial temporal lobes for verbal and non-verbal memory material respectively. We hypothesized that this lateralization is related to language lateralization. Using fMRI we conducted three memory tasks with different memory material (words, faces, landscape images) alongside with a paradigm for the determination of language dominance in 44 healthy subjects. We included left as well as right-handed subjects because persons with atypical language dominance are known to be overrepresented in the group of left-handers. Lateralization indices for the BOLD activation in the medial temporal lobes from the memory tasks were correlated with those for the language task. We show that the material-specific lateralization is related to language dominance such that verbal encoding shows strong positive relation to language dominance whereas face encoding shows the opposite effect. Our data provide first fMRI evidence for a relation between language dominance and material specificity of the medial temporal lobes for memory functions. We suggest that the language-dominant hemisphere is more strongly engaged in memory processing of verbal material. These data provide grounds for the investigation of pathological changes in this relationship due to cortical dysfunctions.