Reporting Standard for Meta-Analysis in Psychology: Status and Recommendations
摘要: 元分析通过综合实证研究结果,积累证据、去伪存真,在研究与实践中有着非常重要的作用。元分析所用方法种类繁多,其选择对研究的质量影响较大,当前元分析报告迅猛增长使得其质量更应多加关注。为规范元分析流程、提升报告质量,生物医学(如由医疗卫生领域专家国际性小组制定的PRISMA)及心理学(如美国心理学会推荐的MARS)领域中均制定了元分析报告标准。然而,这类标准开放度不够而且没有中国数据支撑。结合心理学的特点以及最近开放科学的趋势,本文拟提出更具有开放性与透明性的元分析报告标准,共包括7部分30个条目。基于该标准的方法与结果报告部分的条目,本文对2017年国内心理学期刊上发表的元分析报告进行评估。结果发现:已有元分析报告存在方案预注册信息缺乏、研究方法与结果部分内容的混淆、数据来源与分析过程开放性不够等问题。本文提出的元分析报告标准,既可以帮助研究者实施元分析,又有助于提升国内元分析研究的质量。
Abstract: Meta-analysis is a cluster of statistical techniques to quantitatively synthesize empirical findings. By doing meta-analysis, the science community can accumulate existing evidence and distinguish true effects from false positives. Therefore, meta-analytic results were regarded as the high-level evidence in both basic research and clinical settings. Despite its importance, the qualities of published meta-analysis studies, however, is not always warranted. With the rapid increase in the number of published meta-analytic studies, the science community increasingly pays attention to the quality of meta-analytic studies, and several standards have been developed in different fields of science, for example, the Preferred Reporting Items for Systematic Reports and Meta-Analyses (PRISMA) were developed in medical science and the Meta-Analysis Reporting Standards (MARS) were developed in psychology. However, there is no standard for meta-analysis in Chinese, although many meta-analytic studies were published in Chinese every year. To fill this gap, we developed Preferred Reporting Items for Open and Reproducible Meta-analysis (PRIOR-MA). PRIOR-MA integrates items from PRISMA and MARS, as well as the Transparency and Openness Promotion (TOP) guidelines. Therefore, PRIOR-MA provides three advantages: (1) it is based on the most widely used reporting standard for meta-analysis – PRISMA, therefore have recommendation value; (2) it integrates items from MARS so that it has higher practical value than PRISMA for researchers in psychology and related field, and (3) it embraces the latest open science initiative and encourages opening data and analytic code. PRIOR-MA consists of seven sections, and 30 items in total. Based on PRIOR-MA, we evaluated meta-analytic studies published in Chinese psychology journals in 2017, and the results showed that many of these articles did not fully report important information that is necessary for evaluating their qualities, for example, there is lack of protocol and registration information, confusion between method and results, and unavailability of data and analytical code. These results suggested that Chinese researchers need a reporting standard like PRIOR-MA. We recommend Chinese psychology journals adopt PRIOR-MA as part of their policy. We believe applying PRIOR-MA in the journal policy will benefit not only researchers who conduct meta-analysis but also the science community as a whole.
[V10] | 2022-07-30 11:45:37 | ChinaXiv:201809.00177v10 查看此版本 | 下载全文 |
[V9] | 2021-01-11 11:43:56 | ChinaXiv:201809.00177v9 查看此版本 | 下载全文 |
[V8] | 2019-06-05 13:57:05 | ChinaXiv:201809.00177v8 查看此版本 | 下载全文 |
[V7] | 2019-06-05 00:41:18 | ChinaXiv:201809.00177v7 查看此版本 | 下载全文 |
[V6] | 2019-02-19 06:36:11 | ChinaXiv:201809.00177v6 查看此版本 | 下载全文 |
[V5] | 2018-12-25 18:18:31 | ChinaXiv:201809.00177v5 查看此版本 | 下载全文 |
[V4] | 2018-12-23 21:20:43 | ChinaXiv:201809.00177v4 查看此版本 | 下载全文 |
[V3] | 2018-10-19 13:14:54 | ChinaXiv:201809.00177v3 查看此版本 | 下载全文 |
[V2] | 2018-09-25 17:23:15 | ChinaXiv:201809.00177v2 查看此版本 | 下载全文 |
[V1] | 2018-09-23 04:20:03 | ChinaXiv:201809.00177V1 | 下载全文 |
1. 主观社会阶层如何预测亲社会倾向?基于互惠信念的有调节链式中介模型 | 2023-09-30 |
2. 事件相关电位研究的统计检验力分析:方法及影响因素 | 2023-09-30 |
3. 语素意识与快速命名对汉语儿童阅读能力的影响:跨学段的中介效应分析 | 2023-09-27 |
4. 研究社会文化变迁的新视角——表征相似性分析:以老年人心理健康为例 | 2023-09-27 |
5. 抑郁症情绪失调的动态特征:情绪动力学的视角 | 2023-09-26 |
6. 对疼痛线索的晚期注视偏向预测慢性疼痛的维持:来自眼动的证据 | 2023-09-26 |
7. 视觉意识是离散还是连续模式?基于注意瞬脱的整合性视角 | 2023-09-26 |
8. 睡眠对婴幼儿学习的记忆巩固作用 | 2023-09-26 |
9. 系统合理信念维护心理健康:缓和作用与拓展 | 2023-09-23 |
10. The intersubjective interaction in psychoanalysis: Enlightenment from Martin Buber’s philosophy of dialogue | 2023-09-19 |