COVID-19 convalescent plasma, particularly plasma with high-titer SARS-CoV-2 (CoV2) antibodies, has been successfully used for treatment of COVID-19. The functionality of convalescent plasma varies greatly, but the association of antibody epitope specificities with plasma functionality remains uncharacterized. We assessed antibody functionality and reactivities to peptides across the CoV2 and the four endemic human coronavirus (HCoV) genomes in 126 COVID-19 convalescent plasma donations. We found strong correlation between plasma functionality and polyclonal antibody targeting of CoV2 spike protein peptides. Antibody reactivity to many HCoV spike peptides also displayed strong correlation with plasma functionality, including pan-coronavirus cross-reactive epitopes located in a conserved region of the fusion peptide. After accounting for antibody cross-reactivity, we identified an association between greater alphacoronavirus NL63 antibody responses and development of highly neutralizing antibodies to SARS-CoV-2. We also found that plasma preferentially reactive to the CoV2 receptor binding domain (RBD), versus the betacoronavirus HKU1 RBD, had higher neutralizing titer. Finally, we developed a two-peptide serosignature that identifies plasma donations with high anti-S titer but that suffer from low neutralizing activity. These results suggest that analysis of coronavirus antibody fine specificities may be useful for selecting therapeutic plasma with desired functionalities.