Accurately describing protein-ligand binding and unbinding kinetics remains challenging. Computational calculations are difficult and costly, while experimental measurements often lack molecular detail and can be unobtainable. Here, we extend our multiscale milestoning method, Simulation-Enabled Estimation of Kinetics Rates (SEEKR), with metadynamics molecular dynamics simulations to yield accurate small molecule drug residence times. Using the pharmaceutically relevant threonine-tyrosine kinase (TTK) and eight long-residence-time (tens of seconds to hours) inhibitors, we demonstrate accurate prediction of absolute and rank-ordered ligand residence times and free energies of binding.