Previous research found associations between lower vs. upper space and negative vs. positive stimuli correspondingly (vertical Space-Valence Associations, SVAs) and between the left vs. right side and negative vs. positive stimuli correspondingly (horizontal SVAs). We conducted a comprehensive meta-analysis of SVAs for both dimensions in behavioral studies. We tested the robustness of SVAs and examined factors potentially modulating them: participants’ culture, handedness, gender, age, the exact valence domain under study, the experimental task, type of stimuli, publication year, and statistics used. Articles were extracted from Web of Science, PubMed, and ScienceDirect in February 2021. Overall, 91 articles with 199 experiments and 21,951 participants were included in the final analysis. We found robust evidence of SVAs in vertical (r = .440, k = 111 experiments) and horizontal dimensions (r = .310; k = 88 experiments), with little evidence for literature biases. The distribution of effect sizes was highly heterogeneous, even after subgroup analyses, which indicates unidentified factors varying across studies. Experiments on vertical SVAs explicitly asking participants to evaluate valence showed larger effect sizes than experiments where valence remained task-irrelevant. There was a robust effect of handedness on horizontal SVAs: Participants associated positive stimuli with the side of their dominant hand. There was also some evidence of cultural influences on the horizontal SVAs. Overall, our meta-analysis revealed a hierarchy of factors modulating activation of SVAs, which includes both situated and embodied factors. It is, therefore, essential to focus on specific concept categories and contexts rather than consider abstract concepts in general.