Academic journals should publish failed replications Why

Is there a journal for replications in experimental economics?


Is there a journal that publishes replications (failed and successful) of (published) experiments? And if not, why not? And what about failed experiments (i.e. experiments with insignificant results)?

I think replication of experiments is very important because experimentation in business depends on a lot of different things and most of them we don't really understand. After repeating an experiment, you can make sure that the results you got are not purely random (or worse). More importantly, failed attempts to replicate a study indicate that something was wrong with one of the studies.

Since this was not clear: I am talking about laboratory experiments, not field experiments.


Reply:



I assume you are talking about field testing and empirical work in general. (Not Vernon Smith's laboratory experiments.)

The website summarizes results from several programs, including those that did not have significant relationships.

Also read Vivalt: How Much Can We Generalize From Impact Assessments?

Some researchers publish insignificant results of empirical work to refute another's theory, usually along with significant results. Field testing in business makes this possible because you are trying to test as many hypotheses as possible when you run a $ 1M experiment.

For example:

You can see these papers address many problems at once, including "failed" hypotheses. Therefore, any journal that contains empirical data also contains failed experiments.





The Journal of Economic Science Association to add a companion journal Experimental Economics, is dedicated, among other things, to the publication of replications of experiments.

As stated on the Economic Science Association website:

The Journal of the Economic Science Association is dedicated to the promotion of theoretical, empirical, methodological and policy-relevant knowledge with the help of experimental economic methods. JESA promotes pioneering and advanced research of laboratory and field methods to answer important economic questions that are difficult to investigate with naturally occurring data. JESA is open to all areas of economic research and at the interface of economics and other disciplines, including but not limited to psychology, political science, statistics, finance, marketing and organizational behavior.

JESA will focus on publishing shorter articles (original articles, methodological articles, surveys, comments on recently published experimental articles) and article types that are important but underrepresented in the experimental literature (i.e. replications, minor extensions, robustness tests, meta) - Analyzes and good experimental designs, even if no results are obtained). JESA will regularly publish special editions on topics of particular interest to economic experimentation, including articles requested by leading scholars inside and outside of experimental economics.

JESA promotes the experimental economy by bringing together innovative research that conforms to the professional standards of experimental methods, but without editorial focus on specific orientations. All submissions are reviewed using the standard anonymous arbitrator procedure, and all accepted manuscripts must be approved by both editors. Authors are expected to submit separate data and instructional attachments to be attached to the journal's website when published.

The journal is published under the auspices of the Economic Science Association, a professional organization dedicated to using controlled experimentation to learn more about economic behavior. JESA is a companion journal to Experimental Economics that publishes longer original articles (without meta-analyzes) as well as longer surveys and methods.

We use cookies and other tracking technologies to improve your browsing experience on our website, to show you personalized content and targeted ads, to analyze our website traffic, and to understand where our visitors are coming from.

By continuing, you consent to our use of cookies and other tracking technologies and affirm you're at least 16 years old or have consent from a parent or guardian.

You can read details in our Cookie policy and Privacy policy.