2019/11/21
在判斷與決策中進行大量預註冊的複制和擴展：見解，發現和機會
講題：在判斷與決策中進行大量預註冊的複制和擴展：見解，發現和機會
講者：香港大學 心理系 Assistant professor Gilad Feldman (費德曼教授)
時間：2019年11月21日（四）中午 12:00~約14:00
地點：社科大樓北棟3F院會議室(院辦公室旁)
摘要：
可再現性和可複制性是科學的核心，然而近年來越來越多的證據表明，心理學中的許多發現都是不可複制且不可複制的，這被稱為“複製/可複制性危機”和新的“可信性革命”，改變我們科學的方式。有危機嗎？這會影響我們的研究議程嗎？如果是這樣，怎麼辦？
我將介紹香港大學（HKU）正在進行的大規模複製工作，在指導研究生的論文工作中完成了〜45項預註冊複製，正在進行中的〜25項預先註冊的複制，以及在香港大學的六門一學期的大學本科課程，概述如下：http://mgto.org/pre-registered-replications/。
大學生分析了具有影響力的判斷和決策文學經典，並嘗試複製方法和材料來進行效果量大小的計算和考驗力分析，設計實驗，並採用最新的工具和模板來預先註冊開放式科學框架上的複制和擴展。我們在功能強大的在線Prolific和MTurk樣本上進行了實驗（功效= 0.95-0.99； N = 400-1500）。學生使用全面的補充材料撰寫了他們的發現，並整理稿件準備就緒的手稿。本著完全透明和開放科學的精神，所有程序，決策，材料，數據集和分析/代碼都將在開放科學框架中共享。在此處查看範例項目：https://tinyurl.com/hkureplicationexamples
我將簡要介紹該過程，發現，主要見解和自己的收穫，並回顧我們開發的開放資源，例如課程材料，協作指南和可在其研究實驗室中使用的所有工具。
聯絡人：
龔俊嘉老師（chunkung@mail.ncku.edu.tw /分機：56508）
林君昱老師（cyjlin@mail.ncku.edu.tw /分機：56512 ）
【English information:】
Title:
Mass pre-registered replications and extensions in Judgment and Decision Making: Insights, findings, and opportunities
Speaker:
Assistant professor Gilad Feldman, Department of Psychology, University of Hong Kong
Abstract:
Reproducibility and replicability are at heart of science, yet increasing evidence from recent years suggests that many of the findings in psychological science are irreproducible and non-replicable in what some termed as a “replication/reproducibility crisis” and a new “credibility revolution” calling for significant changes in the way we do science. Is there a crisis? Should this affect our research agenda? If so – how?
I will present an ongoing mass replication effort at the University of Hong Kong (HKU), with ~45 completed and ~25 ongoing pre-registered replications in guided thesis work and six undergraduate one-semester courses at HKU, outlined in http://mgto.org/pre-registered-replications/ .
Undergraduate students analyzed impactful Judgment and Decision Making literature classics and attempted to reproduce methods and materials to conduct effect-size calculations and power analyses, design experiments, and adopt latest tools and templates in preregistering replications and extensions on the Open Science Framework. We ran the experiments on well-powered online Prolific and MTurk samples (power = 0.95-0.99; N = 400-1500). Students wrote full submission-ready manuscripts of their findings with comprehensive supplementary materials. In the spirit of full transparency and open-science, all procedures, decisions, materials, datasets, and analyses/code are in the process of being shared on the Open Science Framework. See sample projects here: https://tinyurl.com/hkureplicationexamples
I will briefly present the process, findings, main insights, and my own take-aways, and will review open resources we developed such as course materials, collaborative guides, and tools that can be used by all in their research labs.
Biosketch of the speaker:
Gilad is an assistant professor with the psychology department at the University of Hong Kong. Gilad’s work is in the areas of social-cognitive psychology and judgment and decision-making. Research focuses on the topics of biases and heuristics, especially regarding agency and action. In recent years, with the emergence of the credibility revolution (so-called “replication/reproducibility crisis”), Gilad has taken a special interest in the movement for advancing psychological science by giving workshops and seminars and guiding researchers and students about open-science, statistical tools and simulations using open-source software (R), meta-analyses, pre-registrations, replications, and reproducibility. Open workshop materials: http://mgto.org/workshops/; Open teaching materials: http://mgto.org/teaching-courses/
More details on Gilad can be found at http://giladfeldman.org
講者：香港大學 心理系 Assistant professor Gilad Feldman (費德曼教授)
時間：2019年11月21日（四）中午 12:00~約14:00
地點：社科大樓北棟3F院會議室(院辦公室旁)
摘要：
可再現性和可複制性是科學的核心，然而近年來越來越多的證據表明，心理學中的許多發現都是不可複制且不可複制的，這被稱為“複製/可複制性危機”和新的“可信性革命”，改變我們科學的方式。有危機嗎？這會影響我們的研究議程嗎？如果是這樣，怎麼辦？
我將介紹香港大學（HKU）正在進行的大規模複製工作，在指導研究生的論文工作中完成了〜45項預註冊複製，正在進行中的〜25項預先註冊的複制，以及在香港大學的六門一學期的大學本科課程，概述如下：http://mgto.org/pre-registered-replications/。
大學生分析了具有影響力的判斷和決策文學經典，並嘗試複製方法和材料來進行效果量大小的計算和考驗力分析，設計實驗，並採用最新的工具和模板來預先註冊開放式科學框架上的複制和擴展。我們在功能強大的在線Prolific和MTurk樣本上進行了實驗（功效= 0.95-0.99； N = 400-1500）。學生使用全面的補充材料撰寫了他們的發現，並整理稿件準備就緒的手稿。本著完全透明和開放科學的精神，所有程序，決策，材料，數據集和分析/代碼都將在開放科學框架中共享。在此處查看範例項目：https://tinyurl.com/hkureplicationexamples
我將簡要介紹該過程，發現，主要見解和自己的收穫，並回顧我們開發的開放資源，例如課程材料，協作指南和可在其研究實驗室中使用的所有工具。
聯絡人：
龔俊嘉老師（chunkung@mail.ncku.edu.tw /分機：56508）
林君昱老師（cyjlin@mail.ncku.edu.tw /分機：56512 ）
【English information:】
Title:
Mass pre-registered replications and extensions in Judgment and Decision Making: Insights, findings, and opportunities
Speaker:
Assistant professor Gilad Feldman, Department of Psychology, University of Hong Kong
Abstract:
Reproducibility and replicability are at heart of science, yet increasing evidence from recent years suggests that many of the findings in psychological science are irreproducible and non-replicable in what some termed as a “replication/reproducibility crisis” and a new “credibility revolution” calling for significant changes in the way we do science. Is there a crisis? Should this affect our research agenda? If so – how?
I will present an ongoing mass replication effort at the University of Hong Kong (HKU), with ~45 completed and ~25 ongoing pre-registered replications in guided thesis work and six undergraduate one-semester courses at HKU, outlined in http://mgto.org/pre-registered-replications/ .
Undergraduate students analyzed impactful Judgment and Decision Making literature classics and attempted to reproduce methods and materials to conduct effect-size calculations and power analyses, design experiments, and adopt latest tools and templates in preregistering replications and extensions on the Open Science Framework. We ran the experiments on well-powered online Prolific and MTurk samples (power = 0.95-0.99; N = 400-1500). Students wrote full submission-ready manuscripts of their findings with comprehensive supplementary materials. In the spirit of full transparency and open-science, all procedures, decisions, materials, datasets, and analyses/code are in the process of being shared on the Open Science Framework. See sample projects here: https://tinyurl.com/hkureplicationexamples
I will briefly present the process, findings, main insights, and my own take-aways, and will review open resources we developed such as course materials, collaborative guides, and tools that can be used by all in their research labs.
Biosketch of the speaker:
Gilad is an assistant professor with the psychology department at the University of Hong Kong. Gilad’s work is in the areas of social-cognitive psychology and judgment and decision-making. Research focuses on the topics of biases and heuristics, especially regarding agency and action. In recent years, with the emergence of the credibility revolution (so-called “replication/reproducibility crisis”), Gilad has taken a special interest in the movement for advancing psychological science by giving workshops and seminars and guiding researchers and students about open-science, statistical tools and simulations using open-source software (R), meta-analyses, pre-registrations, replications, and reproducibility. Open workshop materials: http://mgto.org/workshops/; Open teaching materials: http://mgto.org/teaching-courses/
More details on Gilad can be found at http://giladfeldman.org