Aging is associated with increased breast cancer risk and outcomes are worse for the oldest and youngest patients, regardless of subtype. It is not known how cells in the breast tumor microenvironment are impacted by age and how they might contribute to age-related disease pathology. Here, we discover age-associated differences in cell states and interactions in human estrogen receptor-positive (ER+) and triple-negative breast cancers (TNBC) using new computational analyses of existing single-cell gene expression data. Age-specific program enrichment (ASPEN) analysis reveals age-related changes, including increased tumor cell epithelial-mesenchymal transition, cancer-associated fibroblast inflammatory responses, and T cell stress responses and apoptosis in TNBC. ER+ breast cancer is dominated by increased cancer cell estrogen receptor 1 (ESR1) and luminal cell activity, reduced immune cell metabolism, and decreased vascular and extracellular matrix (ECM) remodeling with age. Cell interactome analysis reveals candidate signaling pathways that drive many of these cell states. This work lays a foundation for discovery of age-adapted therapeutic interventions for breast cancer.