The Impact of the Stellar Evolution of Single and Binary Stars on the Global, Dynamical Evolution of Dense Star Clusters Across Cosmic Time