Cryptococcosis is one of the most important invasive fungal infections and is a significant contributor to the mortality associated with HIV/AIDS. As part of our program to repurpose molecules related to the selective estrogen receptor modulator (SERM) tamoxifen as anti-cryptococcal agents, we have explored the structure-activity relationships of a set of structurally diverse SERMs and tamoxifen derivatives. Our data provide the first insights into the structural requirements for the antifungal activity of this scaffold. Three key molecular characteristics affecting anti-cryptococcal activity emerged from our studies: 1) the presence of an alkylamino group tethered to one of the aromatic rings of the triphenylethylene core; 2) an appropriately sized aliphatic substituent at the 2 position of the ethylene moiety; and 3) electronegative substituents on the aromatic rings modestly improved activity. Using a cell-based assay of calmodulin antagonism, we found that the anti-cryptococcal activity of the scaffold correlates with calmodulin inhibition. Finally, we developed a homology model of C. neoformans calmodulin and used it to rationalize the structural basis for the activity of these molecules. Taken together, these data and models provide a basis for the further optimization of this promising anti-cryptococcal scaffold.