Non-Markovian barrier crossing with two-time-scale memory is dominated by the faster memory component