Hyperphosphatemia is one of the most notable features of chronic kidney disease (CKD). Numerous epidemiological and clinical studies have found that high serum phosphate concentrations are associated with calcification in the coronary arteries. However, the mechanisms underlying the vascular calcification induced by high phosphate have not been understood fully. Vascular smooth muscle cells (VSMCs) were cultured in high-phosphate media to induce vascular calcification, which was detected by Alizarin red S staining. Gene expression and protein levels of differentiation markers were determined by real-time RT-PCR and western blotting, respectively. Protein levels of phosphorylated NF-κB and TLR4 were detected by western blotting, and the role of NF-κB/TLR4 was further confirmed by using an NF-κB inhibitor or TLR4 siRNA. Our results showed that high-phosphate media induced obvious calcification of VSMCs. Simultaneously, VSMC differentiation was confirmed by the increased expression of bone morphogenetic protein-2 and Runt-related transcription factor 2 and decreased expression of the VSMC-specific marker SM22α, which was accompanied by the increased expression of inflammatory cytokines. Moreover, a significant upregulation of TLR4 and phosphorylated NF-κB was also detected in VSMCs with high-phosphate media. In contrast, VSMC calcification and the increased expression of inflammatory cytokines were markedly attenuated by pretreatment with TLR4 siRNA and pyrrolidine dithiocarbamic acid, an NF-κB inhibitor. These data suggest that high-phosphate conditions directly induce vascular calcification via the activation of TLR4/NF-κB signaling in VSMCs. Moreover, inhibition of the TLR4/NF-κB signaling pathway might be a key intervention to prevent vascular calcification in patients with CKD.