We adopted the method used in the O-Pair article to validate the FDR calculations of O-glycopeptide search in O-Search-Pattern, O-Pair Search, MSFragger-Glyco, and pGlyco. The detailed description of the method was provided in the ‘Methods’ and ‘Evaluating O-Pair Search performance’ parts of O-Pair article (Lu et al., 2020).