The EEF view: what are the implications for education research?
The academic publication process makes interpreting research challenging for a number of reasons.
The first is that it takes a long time. The average period it takes to decide whether the research will be published is six to eight weeks, with many articles delayed for months after they are complete.
The second challenge is the incentives created by the publication process. Journals might look for novel articles or interesting results.
This has created what is known as the “file-drawer” effect, whereby studies with null results end up not being published. As a result, when we come to review the evidence base, we might only be seeing a sample of the high-impact results - with the low-impact ones stuck in the file drawer, unpublished.
Some journals are now accepting articles prior to seeing findings to try to combat this problem.
In seeking out new research, the academic publication process can also disincentivise replication studies, which examine whether repeating a study reaps the same findings.
A final challenge of academic publishing is that many of the articles are difficult for teachers to access because they are locked behind online paywalls.
Not all research outputs are published through academic journals. Research funders, think-tanks and big non-governmental organisations, such as the Education Endowment Foundation (EEF) will often commission and publish findings outside of academia. This can mitigate some of the risks, through targeting research effectively, publishing everything, making research free to access and ensuring that it is written in plain language.