Among eukaryotes, four major phytoplankton lineages are responsible for marine photosynthesis; prymnesiophytes, alveolates, stramenopiles, and prasinophytes. Contributions by individual taxa, however, are not well known, and genomes have been analyzed from only the latter two lineages. Tiny "picoplanktonic" members of the prymnesiophyte lineage have long been inferred to be ecologically important but remain poorly characterized. Here, we examine pico-prymnesiophyte evolutionary history and ecology using cultivation-independent methods. 18S rRNA gene analysis showed pico-prymnesiophytes belonged to broadly distributed uncultivated taxa. Therefore, we used targeted metagenomics to analyze uncultured pico-prymnesiophytes sorted by flow cytometry from subtropical North Atlantic waters. The data reveal a composite nuclear-encoded gene repertoire with strong green-lineage affiliations, which contrasts with the evolutionary history indicated by the plastid genome. Measured pico-prymnesiophyte growth rates were rapid in this region, resulting in primary production contributions similar to the cyanobacterium Prochlorococcus. On average, pico-prymnesiophytes formed 25% of global picophytoplankton biomass, with differing contributions in five biogeographical provinces spanning tropical to subpolar systems. Elements likely contributing to success include high gene density and genes potentially involved in defense and nutrient uptake. Our findings have implications reaching beyond pico-prymnesiophytes, to the prasinophytes and stramenopiles. For example, prevalence of putative Ni-containing superoxide dismutases (SODs), instead of Fe-containing SODs, seems to be a common adaptation among eukaryotic phytoplankton for reducing Fe quotas in low-Fe modern oceans. Moreover, highly mosaic gene repertoires, although compositionally distinct for each major eukaryotic lineage, now seem to be an underlying facet of successful marine phytoplankton.