Cells respond to fluctuating nutrient supply by adaptive changes in organelle dynamics and in metabolism. How such changes are orchestrated on a cell-wide scale is unknown. We show that endosomal signaling lipid turnover by MTM1, a phosphatidylinositol 3-phosphate [PI(3)P] 3-phosphatase mutated in X-linked centronuclear myopathy in humans, controls mitochondrial morphology and function by reshaping the endoplasmic reticulum (ER). Starvation-induced endosomal recruitment of MTM1 impairs PI(3)P-dependent contact formation between tubular ER membranes and early endosomes, resulting in the conversion of ER tubules into sheets, the inhibition of mitochondrial fission, and sustained oxidative metabolism. Our results unravel an important role for early endosomal lipid signaling in controlling ER shape and, thereby, mitochondrial form and function to enable cells to adapt to fluctuating nutrient environments.