Just Don’t Call It Research!

In Debates and Polemics, Evidence in Education, Research Evidence by Alex Quigley8 Comments

 

Ask a group of teachers in the staffroom about how research evidence can help them teach and you may well receive a rather sceptical response. I can hear the complaints now: ‘more bloody work’…’box ticking’…’don’t give me ‘action research’, mate’…’another shiny new toy’, and worse. No doubt, given our fatigue with the merry-go-round of curricula change and innovation after innovation, you can understand the doubts and the cynicism.

Wedded to this, research evidence faces being tainted by the selective bias of edu-salesmen looking to make a quick buck with a glossy badge, or politicians looking to adroitly spin an argument. Cherry picking of research evidence is of course rife. Who can blame teachers who are tired and wary of being sold the next ‘outstanding’ evidence-based answer to all their planning and marking and pains and stresses.

In a speech at ResearchEd in 2014, Dylan Wiliam led his session, to a room full of people interested in research evidence, with the stark title: “Why education will never be a research-based profession.” Wiliam shares the issues with deploying research evidence and finding causation with pretty much anything in the classroom. He outlines the limitations of research and the factors that skew findings, such as “Studies with younger children will produce larger effect size estimates” and “Studies with restricted populations (e.g., children with special needs, gifted students) will produce larger effect size estimates.”

Rather that pack up all of this evidence business and close the classroom door, Wiliam offers the observation that teachers should be undertaking ‘disciplined inquiry’, not research:

image

(Slide taken from Dylan Wiliam’s freely shared PPT presentation to be found here)

I’m sure ‘disciplined inquiry‘ could be mangled to mean what we want it to mean, but I very much like Paul Hood’s helpful breakdown of the characteristics of disciplined inquiry:

  1. Meaningful topics are addressed
  2. Systematic, clearly described procedures are employed and described so that readers can follow the logic of the study and assess the validity of the study’s conclusion
  3. There is sensitivity to the errors that are associated with the methods employed and efforts are made to control the errors or consider how they influence the results
  4. Empirical verification and sound logic are valued: and
  5. Plausible alternative explanations are considered 

I like these characteristics because they encourage teachers to apply their practical wisdom – recommended by Wiliam – but in a more disciplined way that we can typically apply in our busy working week, by using  ‘logic‘ and considering ‘plausible alternatives‘.

Can we not then deploy this logic to our evaluation and implementation of new school initiatives and of our teaching practice? By asking better questions of what we do in schools, and taking the time to better evaluate and consider our unique school context, we add greater discipline to our efforts. Perhaps we are not talking so much about teachers acting as pseudo-researchers, but instead we are advocating a disciplined approach to our thinking and actions as teachers.

Perhaps Wiliam would disagree, but I think you could be more ‘sensitive to the errors’ of school implementation by selectively deploying some ‘scientific methods’ when piloting new initiatives: such as asking a precise question about what we want to change; carefully defining a pre and post test; considering having a ‘treatment’ and ‘control group’ where appropriate, and more. We shouldn’t mistake our inquiry with the power of physics, but exercising some controls over our practice can prove useful to teachers and school leaders looking to make the best decisions possible for their students in a devilishly complex context. Such approaches are limited, but they are much better than ‘business as usual’ in schools where we do little more than ‘buy and try’.

We can fend off the limitations of ‘we always do it this way‘ or ‘OFSTED says X‘ by reading research studies, literature reviews and by useful tools like the EEF Toolkit, as long as we develop supports to judge these sources effectively.  We can read the findings of cognitive science and psychology, alongside reading experts and exploring their cited sources (dare I say it – hidden in parentheses – we could even read blogs of teachers). By triangulating these different sources, we can likely enhance our sensitivity for our inevitable errors still further.

Maybe then, we should stop calling it research, with all the connotations that attend that term, and instead use ‘evidence informed practice‘? and ‘disciplined inquiry’. Beyond the the wrangle over labels, perhaps the most important thing is to simply think much harder about our implementation and evaluation. If we agree with Dylan Wiliam that being an ‘evidence based profession’ is problematic, perhaps we can be a better ‘evidence informed’ profession?

 

Want to be better evidence informed or simply find out more? Then Researched York is for you! On the 9th of July, a range of great speakers, including Baroness Estelle Morris, John Tomsett, Phillipa Cordingley, Tom Sherrington, and many more, will talk evidence informed practice…ok – research! Get your ticket HERE.

Comments

  1. It would be great it Dylan William was less quoted like Moses getting his words directly from mount sinai. He is not a particularly well established researcher by the standards of other disciplines with a sparse number of publications. Better we pause for thought before we accept his council of despair.

  2. Generally I feel that the guardians of the word research are too paranoid for anyone’s good. Why could ‘disciplined inquiry’ not be termed research?
    Having said that, I think this is a very sound approach to school improvement, one which I’m hoping to adopt with the creation of a small research coordinator team at my school.
    Being ‘research-based’ is probably an unsound position for any critically aware school – one is vulnerable to the moonshine salesmen. Research-informed is a better thing to be.

    1. Agree with Mark, there is not enough material out there to claim to be research ‘based’, can only be an aspiration at this point

  3. Sorry if some of this is going offat a tangent.
    Teachers don’t have the time to research stuff fully.
    However the ‘blogosphere’ has allowed ordinary teachers to not be at the mercy of managers who think they know best.
    However I confess that human nature says we are always going to warm to the articles that agree with our gut instincts.
    However lets not underestimate gut instincts.
    Make of that what you will

  4. I have always thought “action research” was a bit of a stretch. I mean, what kind of sampling can one do as a teacher? Sure, ethnographers go into the field and do long-term research through relationship-building and observation, but those are in unique populations. As much as I’d like the distinction, I don’t think the kids in my classes comprise a unique population. What I’ve been told was “action research” just kind of seems like thoughtful, reflective teaching that has been well documented.

    Actually, you can read some nice reflection (not research) and look at truly adorable examples of student work over on my blog 🙂

    1. Author

      I will take a look at your blog. I am closely aligned with your comment about thoughtful and reflective teaching, but I reckon being so time poor we don’t do that so well. I think there is a place for ‘disciplined inquiry’ has a place and the terms matter.

Leave a Reply