Exponentially tighter bounds on limitations of quantum error mitigation