Small RNAs regulate a multitude of cellular processes, including development, stress responses, metabolism, and maintenance of genome integrity, in a sequence-specific manner. Accumulating evidence reveals that host endogenous small RNAs and small RNA pathway components play important roles in plant immune responses against various pathogens, including bacteria, fungi, oomycetes, and viruses. Small-RNA-mediated defense responses are regulated through diverse pathways and the components of these pathways, including Dicer-like proteins, RNA-dependent RNA polymerases, Argonaute proteins, and RNA polymerase IV and V, exhibit functional specificities as well as redundancy. In this review, we summarize the recent insights revealed mainly through the examination of two model plants, Arabidopsis and rice, with a primary focus on our emerging understanding of how these small RNA pathway components contribute to plant immunity.