From ergodic infinite-time to finite-time transition path theory