The host restriction factors TRIM5α and TRIMCyp potently inhibit retrovirus infection by binding to the incoming retrovirus capsid. TRIM5 proteins are dimeric, and their association with the viral capsid appears to be enhanced by avidity effects owing to formation of higher-order oligomeric complexes. We examined the stoichiometric requirement for TRIM5 functional recognition by quantifying the efficiencies of restriction of HIV-1 and murine leukemia virus (MLV) particles containing various proportions of restriction-sensitive and -insensitive CA subunits. Both TRIMCyp and TRIM5α inhibited infection of retrovirus particles containing as little as 25% of the restriction-sensitive CA protein. Accordingly, we also observed efficient binding of TRIMCyp in vitro to capsid assemblies containing as little as one-fourth wild-type CA protein. Paradoxically, the ability of HIV-1 particles to abrogate TRIMCyp restriction in trans was more strongly dependent on the fraction of wild-type CA than was restriction of infection. Collectively, our results indicate that TRIM5 restriction factors bind to retroviral capsids in a highly cooperative manner and suggest that TRIM5 can engage a capsid lattice containing a minimum of three or fewer recognizable subunits per hexamer. Our study supports a model in which localized binding of TRIM5 to the viral capsid nucleates rapid polymerization of a TRIM5 lattice on the capsid surface.