Anderson models with singular potentials or weakly self-avoiding motion