Peroxisomes are ubiquitous organelles that mediate central metabolic functions, such as fatty acid β-oxidation, as well as diverse tissue- and organism-specific processes. Membrane contact sites, regions of close apposition with other organelles for direct communication, are central to several aspects of their life cycle. Pex3 is a conserved multifunctional peroxisomal transmembrane protein that is involved in the insertion of peroxisomal membrane proteins, in pexophagy, and in the formation of membrane contact sites. Here, we show that high Pex3 levels in Saccharomyces cerevisiae induce the formation of peroxisome clusters surrounded by lipid droplets, mediated by peroxisome-peroxisome and peroxisome-lipid droplet contact sites. This clustering occurs independently of Pex3 partners in other processes Pex19, Inp1, and Atg36. The cytosolic domain of Pex3 binds peroxisomes, suggesting a direct role in homotypic contact site formation. Lipid droplet-peroxisome contact sites require the lipid droplet-localized triacylglycerol lipase Tgl4, which is enriched at this interface along with other lipases. Pex3 overexpression in Drosophila melanogaster similarly alters peroxisome and lipid droplet morphology and promotes contact site formation. Together, our results offer novel molecular insights into homotypic peroxisome contact sites and peroxisome-lipid droplet contact sites across species.