Skip to main navigation Skip to main content
info(at)avldigital.remove-this.de
Deutsch English
Last searches

Results for *

Displaying results 1 to 5 of 5.

  1. A protocol for structured robustness reproductions and replicability assessments
    Author: Ankel-Peters, Jörg; Brodeur, Abel; Dreber, Anna; Johannesson, Magnus; Neubauer, Florian; Rose, Julian
    Published: 2024
    Publisher:  RWI - Leibniz-Institut für Wirtschaftsforschung, Essen, Germany

    Robustness reproductions and replicability discussions are on the rise in response to concerns about a potential credibility crisis in economics. This paper proposes a protocol to structure reproducibility and replicability assessments, with a focus... more

    Access:
    Verlag (kostenfrei)
    Resolving-System (kostenfrei)
    Resolving-System (kostenfrei)

    Location:
    ZBW - Leibniz-Informationszentrum Wirtschaft, Standort Kiel
    Signature:
    DS 10
    Inter-library loan:
    No inter-library loan

     

    Robustness reproductions and replicability discussions are on the rise in response to concerns about a potential credibility crisis in economics. This paper proposes a protocol to structure reproducibility and replicability assessments, with a focus on robustness. Starting with a computational reproduction upon data availability, the protocol encourages replicators to prespecify robustness tests, prior to implementing them. The protocol contains three different reporting tools to streamline the presentation of results. Beyond reproductions, our protocol assesses adherence to the pre-analysis plans in the replicated papers as well as external and construct validity. Our ambition is to put often controversial debates between replicators and replicated authors on a solid basis and contribute to an improved replication culture in economics. Die Diskussionen über die Robustheit von Reproduktionen und die Replizierbarkeit nehmen angesichts der Besorgnis über eine mögliche Glaubwürdigkeitskrise in den Wirtschaftswissenschaften zu. In diesem Papier wird ein Protokoll zur Strukturierung von Reproduzierbarkeits- und Replizierbarkeitsbewertungen vorgeschlagen, wobei der Schwerpunkt auf der Robustheit liegt. Das Protokoll beginnt mit einer rechnerischen Reproduktion bei Datenverfügbarkeit und ermutigt die Replikatoren, Robustheitstests vor ihrer Durchführung festzulegen. Das Protokoll enthält drei verschiedene Berichtswerkzeuge, um die Präsentation der Ergebnisse zu vereinfachen. Über die Reproduktionen hinaus bewertet unser Protokoll die Einhaltung der Prä-Analysepläne in den replizierten Arbeiten sowie die externe und konstruktive Validität. Unser Ziel ist es, die oft kontroversen Debatten zwischen Replikatoren und Replikationsautoren auf eine solide Basis zu stellen und zu einer verbesserten Replikationskultur in den Wirtschaftswissenschaften beizutragen.

     
    Export to reference management software   RIS file
      BibTeX file
    Source: Union catalogues
    Language: English
    Media type: Ebook
    Format: Online
    ISBN: 9783969732847
    Other identifier:
    hdl: 10419/306836
    Series: Ruhr economic papers ; #1106
    Subjects: Replication; reproducibility; robustness; research transparency; meta-science
    Scope: 1 Online-Ressource (circa 33 Seiten), Illustrationen
  2. Long-term effects of the targeting the ultra-poor program
    a reproducibility and replicability assessment of Banerjee et al. (2021)
    Author: Rose, Julian; Neubauer, Florian; Ankel-Peters, Jörg
    Published: 2024
    Publisher:  RWI - Leibniz-Institut für Wirtschaftsforschung, Essen, Germany

    Banerjee, Duflo, and Sharma (BDS, 2021a) conduct a ten-year follow-up of a randomized transfer program in West Bengal. BDS find large effects on consumption, food security, income, and health. We conduct a replicability assessment. First, we... more

    Access:
    Verlag (kostenfrei)
    Resolving-System (kostenfrei)
    Resolving-System (kostenfrei)

    Location:
    ZBW - Leibniz-Informationszentrum Wirtschaft, Standort Kiel
    Signature:
    DS 10
    Inter-library loan:
    No inter-library loan

     

    Banerjee, Duflo, and Sharma (BDS, 2021a) conduct a ten-year follow-up of a randomized transfer program in West Bengal. BDS find large effects on consumption, food security, income, and health. We conduct a replicability assessment. First, we successfully reproduce the results, thanks to a perfectly documented reproduction package. Results are robust across alternative specifications. We furthermore assess the paper’s pre-specification diligence and the reporting in terms of extern. Banerjee, Duflo und Sharma (BDS, 2021a) führen eine zehnjährige Nachuntersuchung eines randomisierten Transferprogramms in Westbengalen durch. BDS finden große Auswirkungen auf Konsum, Ernährungssicherheit, Einkommen und Gesundheit. Wir führen eine Bewertung der Replizierbarkeit durch. Zunächst gelingt es uns, die Ergebnisse dank eines perfekt dokumentierten Reproduktionspakets zu reproduzieren. Die Ergebnisse sind robust gegenüber alternativen Spezifikationen. Darüber hinaus bewerten wir die Sorgfalt, mit der die Studie vor der Spezifikation erstellt wurde, und die Berichterstattung in Bezug auf die externen Daten.

     
    Export to reference management software   RIS file
      BibTeX file
    Source: Union catalogues
    Contributor: Banerjee, Abhijit V. (VerfasserIn des Bezugswerks); Duflo, Esther (VerfasserIn des Bezugswerks); Sharma, Garima (VerfasserIn des Bezugswerks)
    Language: English
    Media type: Ebook
    Format: Online
    ISBN: 9783969732854
    Other identifier:
    hdl: 10419/306837
    Series: Ruhr economic papers ; #1107
    Subjects: Replicability; randomized controlled trial; transfer programs; research transparency
    Scope: 1 Online-Ressource (circa 33 Seiten), Illustrationen
  3. Long-term effects of the targeting the ultra-poor program
    a reproducibility and replicability assessment of Banerjee et al. (2021)
    Author: Rose, Julian; Neubauer, Florian; Ankel-Peters, Jörg
    Published: August 2024
    Publisher:  Institute for Replication, Essen, Germany

    Banerjee, Duflo, and Sharma (BDS, 2021a) conduct a ten-year follow-up of a randomized transfer program in West Bengal. BDS find large effects on consumption, food security, income, and health. We conduct a replicability assessment. First, we... more

    Access:
    Verlag (kostenfrei)
    Resolving-System (kostenfrei)
    Verlag (kostenfrei)

    Location:
    ZBW - Leibniz-Informationszentrum Wirtschaft, Standort Kiel
    Signature:
    DS 831
    Inter-library loan:
    No inter-library loan

     

    Banerjee, Duflo, and Sharma (BDS, 2021a) conduct a ten-year follow-up of a randomized transfer program in West Bengal. BDS find large effects on consumption, food security, income, and health. We conduct a replicability assessment. First, we successfully reproduce the results, thanks to a perfectly documented reproduction package. Results are robust across alternative specifications. We furthermore assess the paper's pre-specification diligence and the reporting in terms of external and construct validity. While the paper refers to a pre-registration, it lacks a pre-analysis plan. Assessing the validity of findings for other contexts is difficult absent necessary details about the exact treatment delivery.

     
    Export to reference management software   RIS file
      BibTeX file
    Source: Union catalogues
    Contributor: Banerjee, Abhijit V. (VerfasserIn des Bezugswerks); Duflo, Esther (VerfasserIn des Bezugswerks); Sharma, Garima (VerfasserIn des Bezugswerks)
    Language: English
    Media type: Book
    Format: Online
    Other identifier:
    hdl: 10419/301431
    Series: I4R discussion paper series / Institute for Replication ; no. 142
    Subjects: replicability; randomized controlled trial; transfer programs; research transparency
    Scope: 1 Online-Ressource (circa 32 Seiten), Illustrationen
  4. A protocol for structured robustness reproductions and replicability assessments
    Author: Ankel-Peters, Jörg; Brodeur, Abel; Dreber, Anna; Johannesson, Magnus; Neubauer, Florian; Rose, Julian
    Published: August 2024
    Publisher:  Institute for Replication, Essen, Germany

    Robustness reproductions and replicability discussions are on the rise in response to concerns about a potential credibility crisis in economics. This paper proposes a protocol to structure reproducibility and replicability assessments, with a focus... more

    Access:
    Verlag (kostenfrei)
    Resolving-System (kostenfrei)
    Verlag (kostenfrei)

    Location:
    ZBW - Leibniz-Informationszentrum Wirtschaft, Standort Kiel
    Signature:
    DS 831
    Inter-library loan:
    No inter-library loan

     

    Robustness reproductions and replicability discussions are on the rise in response to concerns about a potential credibility crisis in economics. This paper proposes a protocol to structure reproducibility and replicability assessments, with a focus on robustness. Starting with a computational reproduction upon data availability, the protocol encourages replicators to prespecify robustness tests, prior to implementing them. The protocol contains three different reporting tools to streamline the presentation of results. Beyond reproductions, our protocol assesses adherence to the pre-analysis plans in the replicated papers as well as external and construct validity. Our ambition is to put often controversial debates between replicators and replicated authors on a solid basis and contribute to an improved replication culture in economics.

     
    Export to reference management software   RIS file
      BibTeX file
    Source: Union catalogues
    Language: English
    Media type: Book
    Format: Online
    Other identifier:
    hdl: 10419/301917
    Series: I4R discussion paper series / Institute for Replication ; no. 143
    Subjects: replication; reproducibility; robustness; research transparency; meta-science
    Scope: 1 Online-Ressource (circa 34 Seiten), Illustrationen
  5. Mass reproducibility and replicability
    a new hope
    Author: Brodeur, Abel; Mikola, Derek; Cook, Nikolai
    Published: April 2024
    Publisher:  IZA - Institute of Labor Economics, Bonn, Germany

    This study pushes our understanding of research reliability by reproducing and replicating claims from 110 papers in leading economic and political science journals. The analysis involves computational reproducibility checks and robustness... more

    Access:
    Verlag (kostenfrei)
    Verlag (kostenfrei)
    Resolving-System (kostenfrei)

    Location:
    ZBW - Leibniz-Informationszentrum Wirtschaft, Standort Kiel
    Signature:
    DS 4
    Inter-library loan:
    No inter-library loan

     

    This study pushes our understanding of research reliability by reproducing and replicating claims from 110 papers in leading economic and political science journals. The analysis involves computational reproducibility checks and robustness assessments. It reveals several patterns. First, we uncover a high rate of fully computationally reproducible results (over 85%). Second, excluding minor issues like missing packages or broken pathways, we uncover coding errors for about 25% of studies, with some studies containing multiple errors. Third, we test the robustness of the results to 5,511 re-analyses. We find a robustness reproducibility of about 70%. Robustness reproducibility rates are relatively higher for re-analyses that introduce new data and lower for re-analyses that change the sample or the definition of the dependent variable. Fourth, 52% of re-analysis effect size estimates are smaller than the original published estimates and the average statistical significance of a re-analysis is 77% of the original. Lastly, we rely on six teams of researchers working independently to answer eight additional research questions on the determinants of robustness reproducibility. Most teams find a negative relationship between replicators' experience and reproducibility, while finding no relationship between reproducibility and the provision of intermediate or even raw data combined with the necessary cleaning codes.

     
    Export to reference management software   RIS file
      BibTeX file
    Source: Union catalogues
    Language: English
    Media type: Book
    Format: Online
    Other identifier:
    hdl: 10419/295935
    Series: Discussion paper series / IZA ; no. 16912
    Subjects: reproduction; replication; research transparency; open science; economics; political science
    Scope: 1 Online-Ressource (circa 246 Seiten), Illustrationen