3-dimensional (3D) genome conformation is central to gene expression regulation, yet our understanding of its contribution to rapid transcriptional responses, signal integration, and memory in immune cells is limited. Here, we study the molecular regulation of the inflammatory response in primary macrophages using integrated transcriptomic, epigenomic, and chromosome conformation data, including base pair-resolution Micro-Capture C. We demonstrate that interleukin-4 (IL-4) primes the inflammatory response in macrophages by stably rewiring 3D genome conformation, juxtaposing endotoxin-, interferon-gamma-, and dexamethasone-responsive enhancers in close proximity to their cognate gene promoters. CRISPR-based perturbations of enhancer-promoter contacts or CCCTC-binding factor (CTCF) boundary elements demonstrated that IL-4-driven conformation changes are indispensable for enhanced and synergistic endotoxin-induced transcriptional responses, as well as transcriptional memory following stimulus removal. Moreover, transcriptional memory mediated by changes in chromosome conformation often occurred in the absence of changes in chromatin accessibility or histone modifications. Collectively, these findings demonstrate that rapid and memory transcriptional responses to immunological stimuli are encoded in the 3D genome.