The dynamics of a classical heavy particle moving in a quantum environment is determined by a Langevin equation which encapsulates the effect of the environment-induced reaction forces on the particle. For an open quantum system these include a Born-Oppenheimer force, a dissipative force and a stochastic force due to shot and thermal noise. Recently it was shown that these forces can be expressed in terms of the scattering matrix of the system by considering the classical heavy particle as a time-dependent scattering center, allowing to demonstrate interesting features of these forces when the system is driven out of equilibrium. At the same time, it is well known that small changes in a scattering potential can have a profound impact on a fermionic system due to the Anderson orthogonality catastrophe. In this work, by calculating the Loschmidt echo, we relate Anderson orthogonality effects with the mesoscopic reaction forces for an environment that can be taken out of equilibrium. In particular we show how the decay of the Loschmidt echo is characterized by fluctuations and dissipation in the system and discuss different quench protocols.