<jats:p>Tobacco smoking is one of the main risk factors for gastric cancer, but the magnitude of the association estimated by conventional systematic reviews and meta-analyses might be inaccurate, due to heterogeneous reporting of data and publication bias. We aimed to quantify the combined impact of publication-related biases, and heterogeneity in data analysis or presentation, in the summary estimates obtained from conventional meta-analyses. We compared results from individual participant data pooled-analyses, including the studies in the Stomach Cancer Pooling (StoP) Project, with conventional meta-analyses carried out using only data available in previously published reports from the same studies. From the 23 studies in the StoP Project, 20 had published reports with information on smoking and gastric cancer, but only six had specific data for gastric cardia cancer and seven had data on the daily number of cigarettes smoked. Compared to the results obtained with the StoP database, conventional meta-analyses overvalued the relation between ever smoking (summary odds ratios ranging from 7% higher for all studies to 22% higher for the risk of gastric cardia cancer) and yielded less precise summary estimates (SE ≤2.4 times higher). Additionally, funnel plot asymmetry and corresponding hypotheses tests were suggestive of publication bias. Conventional meta-analyses and individual participant data pooled-analyses reached similar conclusions on the direction of the association between smoking and gastric cancer. However, published data tended to overestimate the magnitude of the effects, possibly due to publication biases and limited the analyses by different levels of exposure or cancer subtypes.</jats:p>