Ramsey games near the critical threshold