How ‘journal clubs’ can help teachers to evaluate pedagogical research
I’m in hospital. Around me are 10 doctors. I’m picking up the gist of their conversation but following precise details is difficult. They’re talking about the advantages of giving blood products to trauma patients while being transferred, rather than the current system of waiting for the patient to reach hospital. The discussion seems to be in favour of transit transfusion.
But there’s a catch. The doctor leading has asked all the others to turn to the back of a clutch of sheets they are each holding and study a particular footnote.
The doctor is saying, “This should have been declared.”
At this point, I should confess I am not in imminent danger and don’t need a transfusion. But I am in hospital with a problem I think these doctors - and the medical profession, generally - can fix. My problem is with a particular phrase. I’ve heard it time and again from many, inside and outside teaching: “Research shows …”
It’s a simple phrase wheeled out by research advocates who sometimes don’t have the faintest idea how research shows anything. The phrase has its permutations; you may be just as likely to encounter “the literature suggests”, “studies indicate” or “there is a growing body of evidence pointing to …”.
Implicit in these phrases is a powerful sense that research is like the red pill from The Matrix: in some way, it will be revelatory. And it certainly can be (as research shows).
Generating resistance
But simply evoking, even referencing, research without a proper explanation of how it comes to its conclusions is a sure way to generate resistance among the keen-witted.
This is why I’m in a hospital: I believe we can learn something from pedagogical practices in medicine. Medicine underwent its rise from craft to profession not just because it grounded practice in research but because doctors are trained in how to critically appraise research methodologies.
One of the main vehicles for training doctors in the skill of critical appraisal is the “journal club”. I’ve wormed my way into a renowned journal club at the Royal Free Hospital in Hampstead, north-west London, in order to understand how such a group works.
Journal clubs take a piece of research, evaluate its strengths and weaknesses and then, if it is found valuable, explore how the research may be applied in practice.
Despite Dylan Wiliam’s recent argument in Tes (bit.ly/WiliamResearch) that classrooms are just too complicated for research, if evidence can’t be used to argue a pedagogical point,what are we left with? Wiliam’s opinions?
Teachers would be more easily won over and supportive if they were trained, like doctors, in the “how” and not just the “what” of educational research. Discussing and unpicking the research that shapes what is thought of as good practice can be of enormous benefit. Knowing how educational studies are designed ought to be central to all teachers’ professional development.
So that is what we did at our school: we set up a journal club based on my experience at the Royal Free.
Each sitting is led by a different teacher, who selects a piece of educational research to explore. So far, we have looked at research into the benefits of recorded audio feedback over written feedback; coaching; and improvements in outcomes when depriving students of their grades.
After reading the research, we meet. The teacher leading the session gives a brief explanation of why the piece was selected, a short overview of its findings, then an evaluation of the methodology. (The only difference between school-based journal clubs and medical ones is that there is less talk about blood.)
A voluntary approach has worked well for us, with around 10-12 staff attending each session (journal clubs generally don’t work well when crammed with unwilling clock-watchers who have been forced to attend, although a mandatory model of participation could be feasible as part of a continuing professional development programme).
Everyone who attends wants to develop praxis led by quality research, not just opinion. There is an appreciation that if teachers cannot evaluate the methodologies used in educational research, they can end up being apostles evangelising pedagogical approaches that have no merit, and may inadvertently deprive students of quality teaching because of the amount of time wasted implementing weakly supported (differentiation) or unreplicable research (growth mindset, anyone?).
Measured and considered
Journal clubs don’t aim to rip apart every bit of educational evidence presented in them and dismiss all pedagogical research as unsubstantiated. Instead, they are about evaluating: is the research valid? And, can this be used at our school? These are the central questions of journal clubs.
The concomitant effect of exploring the evidence in depth is that, rather than being sceptical of educational research, teachers come to a more balanced position on it - neither acolyte nor troglodyte with regards to any one pedagogic approach, but measured and considered about all ideas.
The final and most persuasive reason for running a journal club is that it trains teachers how to conduct their own research. Alongside many other schools, ours is encouraging teachers to conduct research for the purpose of improving some aspect of school life. By talking over the successful and unsuccessful methodologies of other educational studies, teachers are able to collegiately hone research methodologies that are more rigorous than that which has come before.
Journal clubs are about empowering teachers with critical appraisal skills so they can judge at first hand what research shows.
David Gibbons was an English teacher at Merchant Taylors’ School, where the journal club he mentions is based, but is now in post at Eton College
This article originally appeared in the 6 SEPTEMBER 2019 issue under the headline “Just what the doctors ordered”
You need a Tes subscription to read this article
Subscribe now to read this article and get other subscriber-only content:
- Unlimited access to all Tes magazine content
- Exclusive subscriber-only stories
- Award-winning email newsletters
Already a subscriber? Log in
You need a subscription to read this article
Subscribe now to read this article and get other subscriber-only content, including:
- Unlimited access to all Tes magazine content
- Exclusive subscriber-only stories
- Award-winning email newsletters