Critical and supercritical singular S(P)DEs: A probabilistic approach