Differentiation of stem cells embedded within the mammary epithelium is orchestrated by lineage-specifying transcription factors. Unlike the well-defined luminal hierarchy, dissection of the basal lineage has been hindered by a lack of specific markers. Inhibitor of Differentiation 4 (ID4) is a basally-restricted helix-loop-helix (HLH) transcription factor essential for mammary development. Here we show that ID4 is highly expressed in basal stem cells and decreases during myoepithelial differentiation. By integrating transcriptomic, proteomic and chromatin-association data we reveal that ID4 is required to suppress myoepithelial gene expression and cell fate.