Classroom Observation

The Continuing Cult Of Classroom Observation

e=mc2andallthat2 Comments

Prisoner: What do you want?
Number Two: Information.
Prisoner: Whose side are you on?
Number Two: That would be telling. We want information . . . information . . . information!
Prisoner: You won’t get it!
Number Two: By hook or by crook, we will.
Prisoner: Who are you?
Number Two: The new Number Two.
Prisoner: Who is Number One?
Number Two: You are Number Six.
Prisoner: I am not a number; I AM A FREE MAN!!!
Number Two: [Laughter]

The Prisoner (1967) opening sequence

The looking glass world of Patrick McGoohan’s 1967 TV series The Prisoner has, I feel, many parallels with modern education. Our careers, our hopes and aspirations, even our very dreams, often depend on numbers . . . information, if you will. Or data as modern educational parlance would have it.

Some of the most important numbers in a teacher’s life are the (now happily defunct) single lesson Ofsted lesson gradings; although, not so happily, many schools still insist on using them for appraisal and performance management.

For the past few years I have mostly been Number Two. However, at times I have been Number Three (because one student copied an answer from another student and I didn’t notice — I kid you not!); and once a Number Four (because I asked the students to copy a model paragraph off the board — “We’ll have no copying in this school, sirrah!”)

“I AM NOT A NUMBER, I AM EXPERIENCED AND SKILLED INDIVIDUAL WHO DESERVES DUE MEASURE OF PROFESSIONAL AUTONOMY!!!” [Cue maniacal laughter from SLTs and the DfE as lightning flashes and thunder roars.]

Rob Coe ably summarises the problems with minimally-trained observers in this blog post. He writes:

…if your lesson is judged ‘Outstanding’, do whatever you can to avoid getting a second opinion: three times out of four you would be downgraded. If your lesson is judged ‘Inadequate’ there is a 90% chance that a second observer would give a different rating.

He mentions that observers tend to overestimate their own observational prowess. If you fall into this camp, and haven’t seen the clip before, do the selective attention test — go on, do it, I dare you!

As Richard Feynman said of the scientific method: “The first principle is that you must not fool yourself and you are the easiest person to fool.” 

Too often, the high stakes observations we undergo end up enforcing educational fads rather than real good practice. As a colleague dryly observed to me the other day: “It shows that with one week’s notice and four hours preparation I can teach a lesson the way they want me to!”

Rob Coe makes some measured and sensible suggestions at the end of his blog post. However, for my part, I will finish with a further quote from The Prisoner and a bit of wishful thinking:

“I will not make any deals with you. I’ve resigned. I will not be pushed, filed, stamped, indexed, briefed, debriefed or numbered. My life is my own. I resign.”
— The Prisoner

Ofsted Is Irrelevant, Sadly

e=mc2andallthat9 Comments

The Borg: Strength is irrelevant. Resistance is futile. We wish to improve ourselves. We will add your biological and technological distinctiveness to our own. Your culture will adapt to service ours.

Capt. Picard: Impossible. My culture is based on freedom and self-determination.

The Borg: Freedom is irrelevant. Self-determination is irrelevant. You must comply.

Capt. Picard: We would rather die.

The Borg: Death is irrelevant.

— Star Trek: The Next Generation, The Best of Both Worlds Part 1 (1990)

There was a time when I would have danced a jig for joy at the thought of Ofsted being irrelevant.

However, that is no longer the case. Ofsted in recent times have taken a most unexpected lurch towards sweet reasonableness and common sense (at least in some aspects of their operations).

This has wrong footed a number of us, I can tell you. Some might argue that it is too little, too late — but late is better than never.

That it is a genuine sea change can be gauged from the fact that Ofsted has felt it necessary to publish an “Ofsted mythbusters” page. Amongst the highlights are: no individual lesson plans are required for inspections; no set amount of lesson observation evidence and no internal individual lesson gradings will be required; and, there is no — repeat, NO! — requirement for any particular type, frequency or volume of pupil book marking or feedback.

And yet, and what have a large number of schools and multi-academy chains chosen to do with this valuable document? That’s right, they have chosen to IGNORE this advice and continue with their previous systems and procedures: the La-la-la!-I’m-not-listening!-La-la-la! stratagem, if you will.

This isn’t a case of Zombie-Ofsted, as I erroneously suggested in previous post. This is a case of research-informed, actually quite sensible educational advice being wilfully and deliberately ignored by a range of educational institutions.

The New Blob* has come into its own and it’s watchwords are:
1. Double and triple marking (using pens of many colours!)
2. Graded lesson observations (#Cause the graders gonna grade, grade, grade, grade, grade!)
3. Outstanding (as in “Are you an outstanding teacher?” — see no.2 above)

Ofsted is truly irrelevant, sadly.

* perhaps Edu-Borg might be a better description

The Curse of Zombie-Ofsted

e=mc2andallthat6 Comments

In his wonderful book, The Mismeasure of Man, Stephen Jay Gould writes of the fallacy

of ranking, or our propensity for ordering complex variation as a gradual ascending scale. Metaphors of progress and gradualism have been among the most pervasive in Western thought . . . ranking requires a criterion for assigning all individuals to their proper status in the single series. And what better criterion than an objective number? . . . one number for each individual . . . to rank people in a single series of worthiness, invariably to find that oppressed and disadvantaged groups — races, classes, or sexes — are innately inferior and deserve their status. In short, this book is about the Mismeasure of Man.

Humankind seems to have an inveterate propensity for sorting the sheep from the goats. There seems to be nothing we enjoy more than placing people, races, genders, things and classes in their allocated place on some putative “Great Chain of Being.”

The Great Chain of Being is a hierarchical worldview developed in mediaeval and Renaissance times but originating from Plato and the neoplatonists. In this view, everyone and everything has its place. An eagle is superior to the “worm eating” robin; the lion is superior to the domestic dog or cat; but those furry familiars have warrant to lord it over the wolf and rabbit because of their greater utility to Man.

In other words, according to this view, Man is the paragon of animals, but is himself subject to the authority of angels and Heaven. All shall be well if each being in the Great Chain knows its place and does its allotted duty.

I believe that the Great Chain of Being is an enduring but largely unconscious idea: we notice its presence like a fish notices the presence of water — that is to say, not at all. Our continuing propensity for ranking is a comfortable habit of thought that, regrettably, all of us slip into as easily as a favourite pair of slippers.

The other fallacy identified by Gould in The Mismeasure of Man is that of

reification, or our tendency to convert abstract concepts into entities (from the Latin res, or thing). We recognize the importance of mentality in our lives and wish to characterize it, in part so that we can make the divisions and distinctions among people that our cultural and political systems dictate.

And so it continues. For example, Regional Schools Commissioner Dominic Herrington recently wrote to a school to ask for evidence that at least 80 per cent of teaching at the school “is rated to be good or better”, including in English and maths (Schoolsweek.co.uk 6/11/15) — to my mind, demonstrating the fallacies of both ranking and reification simultaneously.

For goodness sake, not even Ofsted does that anymore!

However, the practice is, I suspect, still common in a large number of schools as part of their appraisal systems i.e. if you don’t get a “1” or a “2” in any one of your lesson observations then you “fail”.

The depressing truth is that even when Ofsted change their collective mind about an issue in response to evidence and reasonable argument (Yay! Go edu-bloggers!), their previous ideas and systems continue onward with almost undiminished energy, seemingly with a life and mind (or non-mind) of their own: Zombie-Ofsted, if you will.

To be fair to Ofsted, they have attempted to lay these walkers to rest by publishing clear and unequivocal guidance about their expectations about such nonsense as “minimal teacher talk” or “every lesson must include group work” and so on, but even such a well meaning stake-through-the-heart has made seemingly little headway against the strong winds of the Great Chain of Being.

Zombie-Ofsted marches, or lurches, ever onward.

image
Zombie-Ofsted marches -- or lurches -- ever onward

Like so much else in the crazy world of education these days, it makes the mind boggle. Or curdle. Or both.

Wilshaw’s “Block of Wood” Moment?

e=mc2andallthat1 Comment

Old Andrew draws our attention to an apparent turnaround in the Ofsted framework which make them less judgemental of traditional, didactic teaching techniques.

Inspectors must not give the impression that Ofsted favours a particular teaching style. Moreover, they must not inspect or report in a way that is not stipulated in the framework, handbook or guidance. For example, they should not criticise teacher talk for being overlong or bemoan a lack of opportunity for different activities in lessons unless there is unequivocal evidence that this is slowing learning over time.

— Ofsted [1]

I have mixed feelings about Sir Michael Wilshaw, the instigator of this change. On the one hand, I have been dismayed with comments like “if anyone says to you that ‘staff morale is at an all-time low’ you will know you are doing something right.” [2]. On the other, in some speeches it seemed that he was attempting to address the dead hand of trendy “group-work-good, teacher-talk-bad” Ofsted orthodoxy.

In a previous post, I likened Wilshaw to the captain of a supertanker, and asked whether he would be able to rein in the “talk-less-teaching” rottweilers on his staff. Large organisations can have a momentum as stubborn as supertanker and plough onwards in the same direction for mile after mile, whatever the frantic signals from the wheelhouse say.

In this latest iteration of the ever-changing whirligig that is the Ofsted inspection framework, Wilshaw appears to have nailed his colours to the mast. Rather than “T” for “Trendy” it seems that he is flying the “P” for “Pragmatic” flag — anything goes, as long as it works.

And it is a change for the better, as long as inspection teams adhere to the guidance. (How we can judge exactly what works is another can of worms that I don’t propose to dig into here.)

Could this be the defining moment for Wilshaw? Possibly, it could be his “block of wood” moment.

Knowing also that the severities of the past had earned him a certain amount of hatred, to purge the minds of the people and to win them over completely he determined to show that if cruelties had been inflicted they were not his doing but prompted by the harsh nature of his minister. …. [T]hen, one morning, [the minister’s] body was found cut in two pieces on the piazza at Cesena, with a block of wood and a bloody knife beside it. The brutality of this spectacle kept the people of the Romagna for a time appeased and stupefied.

— Niccolo Machiavelli, “New principalities acquired with the help of fortune”, The Prince

 

The reference is to a story about Cesare Borgia and how he calmed a turbulent province by appointing a “cruel and unscrupulous man” to rule as his minister. When the man’s severe methods had secured a measure of peace and calm to the territory, Cesare Borgia dispensed with his services in the very final and bloody way outlined above.

Just to be clear, I am likening Wilshaw to Borgia and saying that he has, essentially, dispensed with the services of the previous “cruel and unscrupulous” style of Ofsted framework in a very public way. OK, so it’s by way of pressing the delete key on a keyboard rather than a bloody knife, but I hope you get my drift.

Every headteacher I have ever worked with has been a consumate politician (which is not automatically a bad thing, by the way), and I cannot help but wonder if this is only a part of a “Great Game” being played out. (Unlikely, I know, but it’s fun to speculate: the more probable, pedestrian truth is that, as a character in All The President’s Men observed, “they’re just not that bright.”)

And so is the teaching profession “appeased and stupefied” by Wilshaw’s action? A little bit, perhaps. For my part, I will wait and see what effect this has on the next round of inspection reports and (perhaps more importantly) internal school observation criteria before I celebrate, but I am, I must confess, faintly encouraged.

And on that cheerful note: Happy New Year!

[1] http://www.ofsted.gov.uk/filedownloading/?file=documents/inspection–forms-and-guides/s/Subsidiary%20guidance.pdf&refer=1

[2] http://www.tes.co.uk/article.aspx?storycode=6145814

Coe, Wilshaw and Ofsted

e=mc2andallthat3 Comments

[T]he community suffers nothing very terrible if its cobblers are bad and become degenerate and pretentious; but if the Guardians of the laws and state, who alone have the opportunity to bring it good government and prosperity, become a mere sham, then clearly it is completely ruined.

— Plato. The Republic 421a (Penguin Classics) (Kindle Locations 2815-2817). Penguin Books Ltd. Kindle Edition.

I am not sure if I agree with Plato about cobblers and the community. As Benjamin Franklin once pointed out: “For want of a shoe…the kingdom was lost.”

However, I think his statement about the Guardians of the state stands. Equally so with the state-appointed guardians of education: Ofsted.

I think Professor Coe (http://www.bbc.co.uk/news/education-24079951) has done the education world a huge service by pointing out that the Ofsted king has no clothes. However, perhaps in the manner of scrupulous academics everywhere, Professor Coe might prefer a more nuanced “the king probably doesn’t have any clothes”.

Coe pointed out that there is no — repeat, no — valid research supporting the “Ofsted model” of classroom observation being either: (a) a reliable tool for assessing teaching quality or effectiveness when cross-referenced with other measures such as student learning gains; or (b) the observation-feedback process leading to an improvement in teaching quality. (See  http://www.youtube.com/watch?v=_-UyGwYHhGY for the section of his talk on classroom observations and http://t.co/AqY7Xqzknw for a link to his slides.)

I don’t know about anyone else but I am staggered by this. As a working teacher who is just about maintaining a precarious foothold on the treacherous scree of middle management, I always thought my seniors and betters had reams of evidence supporting the stuff they were asking us to do. And if they didn’t, well probably their seniors and betters did.

To hear a respected academic say that classroom observation might be “the next Brain Gym” was shocking.

And the Ofsted response? “Tosh and nonsense,” said Sir Michael Wilshaw.  “I don’t know of any headteacher who doesn’t believe that classroom observation isn’t anything other than a help. The fact that we are an inspectorate and we do make judgements has made a huge amount of difference.” According to the TES (13/9/13 p.8):

He said that new figures released this week, showing a 9 percentage point rise in the proportion of schools judged to be good or outstanding, proved that the watchdog’s tougher inspection regime had “galvanised the system”

This is, to my mind, a textbook example of the logical fallacy known as petito principii or “circular reasoning”. The form of this particular logical fallacy is as follows:

Logical Form:

     Claim X assumes X is true.

     Claim X is therefore, true.

Bennett, Bo (2012-02-21). Logically Fallacious: The Ultimate Collection of Over 300 Logical Fallacies (p. 82). eBookIt.com. Kindle Edition.

Let’s see what Wilshaw said again.

  • The inspectorate’s judgements make a huge amount of [presumably positive] difference.
  • Ofsted judgements show that more schools (9 percentage points!) are good or outstanding.

…therefore Ofsted judgements make a huge amount of positive difference.

Now please note that this does not necessarily mean that the conclusion (that Ofsted helps schools improve) is false, but merely that the argument put forward by the Chief Inspector to support that conclusion is fallacious. And it hopefully goes without saying that a fallacious argument is by definition invalid and must be dropped immediately.

The character Chief Brody in the film Jaws once remarked that they needed “a bigger boat”. The Chief Inspector needs a better argument. And in view of the large amount of taxpayers’ money going to support Ofsted, that new argument should be supplied sooner rather than later. As Professor Coe remarked (somewhat plaintively) in his excellent talk: “Just one would be nice.”

H’mm. More rigour, anyone?