Spermatogenesis, which involves mitosis and meiosis of male germ cells, is a highly complicated and coordinately ordered process. Cyclin B1 (CCNB1), an important regulator in cell cycle machinery, is proved essential for mouse embryonic development. However, the role of CCNB1 in mammalian spermatogenesis remains unclear. Here we tested the requirement for CCNB1 using conditional knockout mice lacking CCNB1 in male germ cells. We found that ablation of CCNB1 in gonocytes and spermatogonia led to mouse sterile caused by the male germ cells' depletion. Gonocyte and spermatogonia without CCNB1 is unable to proliferate normally and apoptosis increased. Moreover, CCNB1 ablation in spermatogonia may promote their differentiation by downregulating Lin28a and upregulating let-7 miRNA. However, ablation of CCNB1 in premeiotic male germ cells did not have an effect on meiosis of spermatocytes and male fertility, suggesting that CCNB1 may be dispensable for meiosis of spermatocytes. Collectively, these results indicate that CCNB1 is critically required for the proliferation of gonocytes and spermatogonia but may be redundant in meiosis of spermatocytes in mouse spermatogenesis.