Bacteriophage (phage) are viruses that can kill bacteria, but also mediate gene transfer for bacterial evolution. The telomere phages are a curious form using telomere-like structures to replicate their genomes as linear extrachromosomal elements. Here we find that telomere phages are widely distributed in bacteria, being highly prevalent in Klebsiella species. We established a model system to investigate telomere phage biology and find only a small set of phage proteins are expressed in phage-host cells, including a toxin – telocin - that kills other Klebsiella strains. We identify and validate other telocins in the genomes of other, widespread Klebsiella telomere phages. Thus, telomere phages are widespread elements encoding diverse antibacterial weapons and we discuss the prospect of using telocins for precision editing of microbial populations.