materials evaluation

Course review: Evaluating Digital Materials (iTDi)

I recently took the iTDi course on Evaluating Digital Materials, delivered by Pete Sharma.

If you can’t be bothered with the whole review – here’s a summary in, er… wait… 17 words:

Excellent input, great delivery, very active forum, useful take-home resources, real value for money, well worth it!

Overview

The course lasts four weeks. Each week there is a weekend webinar with Pete, and then various follow-up activities such as reading and exploratory tasks related to digital tools. Most tasks involve sharing reflections in the course forum which, I have to say, was really active and thoughts were interesting to read.

In Week 1, Pete orientated us to the topic of Computer Assisted Language Learning with an informative webinar and follow-up resources. The main task after input was for us to choose the tool we were interested in evaluating. With so many participants on the course it meant that the tools selected were extremely varied, and some very topical for my context (such as Kahoot). I chose to evaluate Genially after coming across this on Owain Llewelyn’s blog (ELT Sustainable). (more…)

Coursebook activities and SLA theory – do they match?

According to Tomlinson (2013:12-15), ‘it is generally accepted that [Second Language Acquisition] is facilitated by:

  • a rich and meaningful exposure to language in use
  • affective and cognitive engagement
  • making use of mental resources typically used in L1 communication
  • noticing how the L2 is used
  • giving opportunities for contextualised and purposeful communication in the L2
  • being encouraged to interact
  • being allowed to focus on meaning’

Plus, Tomlinson cites research that suggests language learning is facilitated by motivation, having individual needs catered for, making use of non-linguistic communication and being relaxed (among other things). (more…)

A rant about comprehension questions

On my module in materials development we’ve just looked at reading and listening tasks.

We spoke about what makes good/bad comprehension questions. ‘Plain sense’ questions are seen as pretty ineffective, as they just test familiarity with sentence structure rather than actual understanding. Here’s an example of a plain sense question that I came across on my Dip (at TLI)

Most zins are bosticulous. Many rimp upon pilfides.

Q1. What are most zins?

Q2. What do many rimp on?

Although the text is full of nonsense words you can answer the questions without really understanding it.

I can see why these questions aren’t considered that useful. So why do coursebook writers fall back on them?

I know, it’s really easy to be critical. I’m guilty of writing rubbish questions like this too. Actually, I don’t do it that often. I prefer to write really ambiguous questions which will prompt conversation/debate – these are equally annoying I think!

But these ‘plain sense’ questions… I mean… I came across this activity the other day:

comp

these are from Beyond A2+ (copyright Macmillan), which is actually quite a good coursebook.

Here’s the text, with relevant parts highlighted for each answer:

comp2

I’m not saying the whole activity is pointless. It’s just that some questions are plain sense or focus on simple grammatical relationships.

Q4: To have a healthy heart, how often do we need to exercise?

A: (To have a healthy heart, we should exercise for) 30 minutes at least three times a week

Q5: What happens if we do puzzles?

A: (if we regularly use our brains to do puzzles), we actually become more intelligent

I could give the author the benefit of the doubt I guess. For example, you can still teach some reading strategies related to the questions. In Q4 students could predict the answer based on question stems (e.g. How often = a frequency), then scan the text quickly for the relevant info – if they didn’t already have a massive clue by being given the start of the sentence. Maybe Q5 draws attention to the word ‘intelligent’ as new vocabulary, but you don’t need to know the meaning to answer the comprehension question.

I’m not suggesting how these questions could be improved. That’s not because I’m lazy. It’s because when they were devised they must have been written by a far more experienced teacher and then accepted by a skilled editor, both of whom must have had a clear pedagogical rationale for choosing these questions.

Evaluating course books – checklists

I’m currently studying a module in Materials Development through NILE online. It’s a really worthwhile course so far!

Unit two talked about evaluating materials, specifically course books. We were introduced to a range of checklists that could be used for evaluating a course book, and discussed the pros and cons of each. I can’t imagine everyone would find this topic interesting, but it was really topical for me – in the same week I was given a checklist to evaluate our new course book for teen classes. It gave me the opportunity to reflect on our own evaluation process and suggest some changes if necessary…

What makes a good checklist?

We looked at about six different checklists that were listed in McGrath (2002). In some of my jobs I’ve completed evaluations like this one from Harmer (1991:281) (more…)