Two genetic loci, one in the cytochrome P450 1A1 (CYP1A1) and 1A2 (CYP1A2) gene region (rs2472297) and one near the aryl-hydrocarbon receptor (AHR) gene (rs6968865), have been associated with habitual caffeine consumption. We sought to establish whether a more refined and comprehensive assessment of caffeine consumption would provide stronger evidence of association, and whether a combined allelic score comprising these two variants would further strengthen the association. We used data from between 4,460 and 7,520 women in the Avon Longitudinal Study of Parents and Children, a longitudinal birth cohort based in the United Kingdom. Self-report data on coffee, tea and cola consumption (including consumption of decaffeinated drinks) were available at multiple time points. Both genotypes were individually associated with total caffeine consumption, and with coffee and tea consumption. There was no association with cola consumption, possibly due to low levels of consumption in this sample. There was also no association with measures of decaffeinated drink consumption, indicating that the observed association is most likely mediated via caffeine. The association was strengthened when a combined allelic score was used, accounting for up to 1.28% of phenotypic variance. This was not associated with potential confounders of observational association. A combined allelic score accounts for sufficient phenotypic variance in caffeine consumption that this may be useful in Mendelian randomization studies. Future studies may therefore be able to use this combined allelic score to explore causal effects of habitual caffeine consumption on health outcomes.