Objective Sedentary behavior such as television viewing may be an independent risk factor for coronary heart disease. However, few studies have assessed the impact of television viewing time on coronary artery calcification and it remains unclear how body fat contributes to this relationship. The aim of this study is to evaluate the association between television viewing time and subclinical atherosclerosis and whether effects on visceral or subcutaneous fat may mediate any associations observed. Methods This was a cross-sectional study of 398 Chinese participants (192 men and 206 women) from Singapore prospective study. Participants were free from known cardiovascular diseases and underwent interview, health screening, computed tomography scans of coronary arteries and abdomen. Spearman’s correlation was used to test the correlation between television viewing time, physical activity, body composition and abdominal fat distribution. The association between television viewing time and subclinical atherosclerosis was assessed by multiple logistic regression analysis. Results In men, television viewing time was significantly correlated with higher body fat mass index, percent body fat, subcutaneous and visceral fat. These associations were in the same direction, but weaker and not statistically significant in women. Television viewing time (hours/day) was associated with subclinical atherosclerosis in men (odds ratio: 1.41, 95% CI: 1.03-1.93) but no significant association was observed in women (odds ratio: 0.88, 95% CI: 0.59-1.31) after adjusting for potential socio- demographic and lifestyle confounders. Further adjustments for biological factors did not affect these associations. Conclusions Television viewing time was associated with greater adiposity and higher subcutaneous and visceral fat in men. TV viewing time was also associated with subclinical atherosclerosis in men and the potential mechanisms underlying this association require further investigation.