The Lipari-Szabo generalized order parameter probes the picosecond to nanosecond time scale motions of a protein and is useful for rationalizing a multitude of biological processes such as protein recognition and ligand binding. Although these fast motions are an important and intrinsic property of proteins, it remains unclear what simulation conditions are most suitable to reproduce methyl symmetry axis side chain order parameter data (Saxis2) from molecular dynamics simulations. In this study, we show that, while Saxis2 tends to converge within tens of nanoseconds, it is essential to run 10 to 20 replicas starting from configurations close to the experimental structure to obtain the best agreement with experimental Saxis2 values. Additionally, in a comparison of force fields, AMBER ff14SB outperforms CHARMM36m in accurately capturing these fast time scale motions, and we suggest that the origin of this performance gap is likely attributed to differences in side chain torsional parametrization and not due to differences in the global protein conformations sampled by the force fields. This study provides insight into obtaining accurate and reproducible Saxis2 values from molecular simulations and underscores the necessity of using replica simulations to compute equilibrium properties.