Cancer development and progression depend on tumor cell intrinsic factors, the tumor microenvironment and host characteristics. Despite the identification of the plasticity of adipocytes, the primary breast stromal cells, both in physiology and cancer, we lack a complete understanding of mechanisms that regulate adipocyte-tumor cell crosstalk. Here we dissected the breast cancer crosstalk with adipocytes and studied relevant molecules. We identified that the ability of breast cancer cells to dedifferentiate adipocytes is intrinsic subtype-dependent, with all breast cancer subtypes, except for HER2+ER+ subtype, capable of inducing this phenomenon. Crosstalk between breast cancer cells and adipocytes in vitro increased cancer stem-like features and recruitment of pro-tumorigenic immune cells, through chemokine production. Serum amyloid A1 (SAA1) was in vitro identified as a regulator of the adipocyte dedifferentiation program in triple-negative breast cancer (TNBC) through CD36 and P2XR7 signaling. In human TNBCs, SAA1 expression was associated with CAA infiltration, inflammation, stimulated lipolysis, stem-like properties and distinct tumor immune microenvironment. Our findings provide evidence that interaction between tumor cells and adipocytes through SAA1 release is relevant to the aggressiveness of TNBC, potentially supporting its targeting.