The centrosome is a conserved eukaryotic organelle essential for reproductive process, and centrosomal proteins (CEP) are necessary for composition of the centrosome. However, few CEPs have been genetically linked to fertility, and the related molecular mechanisms remains mysterious. Here, we identified a new CEP, CEP128, which is functional in spermatogenesis, fertilization and embryonic development in both humans and mice. The variants of CEP128/Cep128 could lead to aberrant centrosome structures of the sperm inducing to anomalies in sperm morphology, count as well as motility, and further result in male infertility, but did not grossly affect ciliogenesis. Mechanistically, both loss and up-regulation of CEP128 could cause suppressed expressions of the genes involved in the spermatogenesis and fertilization phase. Altogether, our findings unprecedentedly unveil a crucial role of CEP128 in male fertility and provides new insight into the function of CEPs in human disease.