When the data doesn鈥檛 work
This week I鈥檝e been running the tutorials for the core first year Health Sciences course. The tutorial is a very light intro into how data is part of communication of health science research, and one of the activities involves the students arranging a set of data cards to investigate relationships between variables. Something happened today that I hadn鈥檛 observed before and I need to talk about it.
The students had been going for a little while on the activity, and I walked over to one group just as they were pulling apart some groupings of cards. I asked them what they were doing and they said 鈥淲e鈥檙e starting again because the one we did didn鈥檛 work.鈥
"What do you mean it didn鈥檛 work?" I asked.
"We we鈥檙e looking at hat wearing and happiness and we didn鈥檛 see anything," they replied.
I was momentarily shocked as the implication on this began to dawn. These students had made a picture that showed there was no relationship, and decided to take it apart because it didn鈥檛 work. That is, in their minds, it only works if there is a relationship!
I said to them I鈥檇 love to have them put their picture back, because it鈥檚 still good to show there isn鈥檛 a relationship. (They didn鈥檛, which made me sad.)
I wonder if they had come to this conclusion just because of their natural thinking, or because their past experience was that if a teacher asks them to look at data then there is always a relationship. Either way it鈥檚 a bit of a dangerous thing to set up because we are in a bit of a crisis in medical publishing where only positive results get published.
Perhaps we need to give students more examples of data working effectively to argue a lack of relationship.