We identify SMARCD2 (SWI/SNF-related, matrix-associated, actin-dependent regulator of chromatin, subfamily D, member 2), also known as BAF60b (BRG1/Brahma-associated factor 60b), as a critical regulator of myeloid differentiation in humans, mice, and zebrafish. Studying patients from three unrelated pedigrees characterized by neutropenia, specific granule deficiency, myelodysplasia with excess of blast cells, and various developmental aberrations, we identified three homozygous loss-of-function mutations in SMARCD2. Using mice and zebrafish as model systems, we showed that SMARCD2 controls early steps in the differentiation of myeloid-erythroid progenitor cells. In vitro, SMARCD2 interacts with the transcription factor CEBPɛ and controls expression of neutrophil proteins stored in specific granules. Defective expression of SMARCD2 leads to transcriptional and chromatin changes in acute myeloid leukemia (AML) human promyelocytic cells. In summary, SMARCD2 is a key factor controlling myelopoiesis and is a potential tumor suppressor in leukemia.