Although previous research has investigated the impact of parents and peers on test anxiety in secondary or tertiary education, little is known about younger students, especially during the transition to secondary school. Additionally, it is unclear whether these social factors affect girls’ and boys’ test anxiety differently. Therefore, the current study examined the role of perceived peer integration into the new class context, perceived parental control, and autonomy support on girls’ and boys’ test anxiety (worry and emotionality) during the transition to secondary school. Data from 1770 students (Mage = 10.47, SD = 0.56; 51% females) were analyzed before (4th grade) and after the transition (5th grade) using a multigroup (girls vs. boys) structural equation model. Both facets of test anxiety decreased from 4th to 5th grade. Perceived peer integration into the new class was only relevant for girls’ test anxiety, while parental control predicted post-transition test anxiety for boys. The results suggest that the perceived social environment is an important factor in helping students cope with the demands of the transition to secondary school.