# Spreadsheets, statistics, mathematics and computational thinking

We need to teach all our students how to design, create, test, debug and use spreadsheets. We need to teach this integrated with mathematics, statistics and computational thinking. Spreadsheets can be a valuable tool in many other subject areas including biology, physics, history and geography, thus facilitating integrated learning experiences.

Spreadsheets are versatile and ubiquitous – and most have errors. A web search on “How many spreadsheets have errors?” gives alarming results. The commonly quoted figure is 88%. These spreadsheets with errors are not just little home spreadsheets for cataloguing your Lego collection or planning your next vacation. These spreadsheets with errors involve millions of dollars, and life-affecting medical and scientific research.

# Using spreadsheets to teach statistics

## Use a spreadsheet to draw graphs

One of the great contributions computers make to statistical analysis is the ability to display graphs of non-trivial sets of data without onerous drawing by hand. In the early 1980s I had a summer job as a research assistant to a history professor. One of my tasks was to create a series of graphs of the imports and exports for New Zealand over several decades, illustrating the effect of the UK joining the Common Market (now the EU). It required fastidious drawing and considerable time. (And correcting fluid) These same graphs can now be created almost instantaneously, and the requirement has shifted to interpreting these graphs.

Similarly, in the classroom we should not be requiring students of any age to draw statistical graphs by hand. Drawing statistical graphs by hand is a waste of time. Students may enjoy creating the graphs by hand – I understand that – it is rewarding and not cognitively taxing. So is colouring in. The important skill that students need is to be able to read the graph – to find out what it is telling them and what it is not telling them. Their time would be far better spent looking at multiple graphs of different types, and learning how to report and critique them. They also need to be able to decide what graph will best show what they are looking for or communicating. (There will be teachers saying students need to draw graphs by hand to understand them. I’d like to know the evidence for this claim. People have said for years that students need to calculate standard deviation by hand to understand it, and I reject that also.)

At primary school level, the most useful graph is almost always the bar or column chart. These are easily created physically using data cards, or by entering category totals and using a spreadsheet. Here is a video showing just how easy it is.

## Use a spreadsheet for statistical calculations

Spreadsheets are also very capable of calculating summary statistics and creating hypothesis tests and confidence intervals. Dedicated statistical packages are better, but spreadsheets are generally good enough. I would also teach pivot-tables as soon as possible, but that is a topic for another day.

# Using spreadsheets to teach mathematics

Spreadsheets are so versatile! Spreadsheets help students to understand the concept of a variable. When you write a formula in a cell, you are creating an algebraic formula. Spreadsheets illustrate the need for sensible rounding and numeric display. Use of order of operations and brackets is essential. They can be used for exploring patterns and developing number sense. I have taught algebraic graphing, compared with line fitting using spreadsheets. Spreadsheets can solve algebraic problems. Spreadsheets make clear the concept of mathematics as a model. Combinatorics and Graph Theory are also enabled through spreadsheets. For users using a screenreader, the linear nature of formulas in spreadsheets makes it easier to read.

# Using spreadsheets to teach computational thinking

In New Zealand we are rolling out a new curriculum for information technology, including  computational thinking. At primary school level, computational thinking includes “[students] develop and debug simple programs that use inputs, outputs, sequence and iteration.” (Progress outcome 3, which is signposted to be reached at about Year 7) Later the curriculum includes branching.

In most cases the materials include unplugged activities, and coding using programmes such as Scratch or Java script. Robots such as Sphero and Lego make it all rather exciting.

All of these ideas can also be taught using a spreadsheet. Good spreadsheet design has clear inputs and outputs. The operations need to be performed in sequence, and iteration occurs when we have multiple rows in a spreadsheet. Spreadsheets need to be correct, robust and easy to use and modify. These are all important principles in coding. Unfortunately too many people have never had the background in coding and program design and thus their spreadsheets are messy, fragile, oblique and error-prone.

When we teach spreadsheets well to our students we are giving them a gift that will be useful for their life.

I designed and taught a course in quantitative methods for business, heavily centred on spreadsheets. The students were required to use spreadsheets for mathematical and statistical tasks. Many students have since expressed their gratitude that they are capable of creating and using spreadsheets, a skill that has proved useful in employment.

# Why decimals are difficult

Recently a couple of primary teachers admitted a little furtively to me that they “never got decimals”. It got me wondering about what was difficult about decimals. For people who “get” decimals, they are just another number, with the decimal point showing. Clearly this was not the case for all.

So in true 21st century style I Googled it: “Why are decimals difficult”

I got some wonderfully interesting results, one of which is a review paper by Hugues Lortie-Forgues, Jing Tian and Robert S. Siegler, entitled “Why is learning fraction and decimal arithmetic so difficult?”, which I draw on in this post.

# You need to know

For teachers of statistics, this is important. In particular, students learning about statistics sometimes have difficulty identifying if a p-value of 0.035 is smaller or larger than the alpha value of 0.05. In this post I talk about why that may be. I will also give links to a couple of videos that might be helpful for them. For teachers of mathematics it might give some useful insights.

# Whole numbers and rational numbers

Whole numbers are the numbers we start with when we begin to learn maths – 1, 2, 3, 4,… and 0. Zero has an interesting role of having no magnitude in itself, but acting as a place-filler to make sure we can tell the meaning of a number. Without zero, 2001 and 201 and 21 would all look the same! From early on we recognise that longer numbers represent larger quantities. We know that a salary with lots of zeroes is better than one with only a few. \$1000000 is more than \$200 even though 2 is greater than 1.

Rational numbers are the ones that come in between, but also include whole numbers. All of the following are considered rational numbers: ½, 0.3, 4/5, 34.87, 3¾, 2000

When we talk about whole numbers, we can say what number comes before and after the number. 35 comes before 36. 37 comes after 36. But with rational numbers, we cannot do this. There are infinite rational numbers in any given interval. Between 0 and 1 there are infinite rational numbers.

Rational numbers are usually expressed as fractions (½, 3¾) or decimals (0.3, 34.87).

There are several things that make rational numbers (fractions and decimals) tricky. In this post I focus on decimals

# Decimal notation and size of number

As I explained before, when we learn about whole numbers, we learn a useful rule-of-thumb that longer strings of digits correspond to larger numbers. However, the length of the decimal is unrelated to its magnitude. For example, 10045 is greater than 230. The longer number corresponds to greater magnitude. But 0.10045 is less than 0.230. We look at the first digit after the point to find out which number is bigger. The way that you judge which is bigger out of two decimals is quite different from how you do it with whole numbers. The second of my videos illustrates this.

# Effect of multiplying by numbers between 0 and 1

The results of multiplying by decimals between 0 and 1 are different from what we are used to.

When we learn about multiplication of whole numbers, we find that when we multiply, the answer will always be bigger than both of the numbers we are multiplying.
3 × 4 = 12. 12 is greater than either 3 or 4.
However, if we multiply 0.3 × 0.4 we get 0.12, which is smaller than either 0.3 and 0.4. Or if we multiply 6 by 0.4, we get 2.4, which is less than 6, but greater than 0.4. This can be quite confusing.

## Aside for statistics teachers

In statistics we often quote the R squared value from regression. To get it, we square r, the correlation coefficient, and what is quite a respectable value, like 0.6, gets reduced to a mere 0.36.

# Effect of dividing by decimals between 0 and 1

Similarly, when we divide whole numbers by whole numbers, the answer will be less than the number we are dividing. 100 / 5 = 20. Twenty is less than 100, but in this case is greater than 5.  But when we divide by a decimal between 0 and 1 it all goes crazy and things get bigger! 100/ 0.5 = 200. People who are at home with all this madness don’t notice it, but I can see how it can alarm the novice.

# Decimal arithmetic doesn’t behave like regular arithmetic

When we add or subtract two numbers, we need to line up the decimal places, so that we know that we are adding values with corresponding place values. This is looks different from the standard algorithm where we line up the right-hand side. In fact it is the same, but because the decimal point is invisible, it doesn’t seem the same.

## Method for multiplication of decimals

When you multiply numbers with decimals in, you do it like regular multiplication and then you count the number of digits to the right of the decimal in each of the factors and add them together and that is how many digits to have to the right of the decimal in the answer! I have a confession here. I know how to do this, and have taught how to do this, but I don’t recall ever working out why we do this or getting students to work it out.

## Method for division of decimals

Is this even a thing? My immediate response is to use a calculator. I seem to remember moving the decimal point around in a somewhat cavalier manner so that it disappears from the number we are dividing by. But who ever does long division by hand?

Okay teacher friends – I now see why you find decimals difficult.

The paper talks about approaches that help. The main one is that students need to spend time on understanding about magnitude.

My suggestion is to do plenty of work using money. Somehow we can get our heads around that.

And use a calculator, along with judicious estimation.

Here are two videos I have made, to help people get their heads around decimals.

# There are many good ways to teach mathematics and statistics

Hiding in the bookshelves in the University of Otago Library, I wept as I read the sentence, “There are many good ways to raise children.”  As a mother of a baby with severe disabilities the burden to get it right weighed down on me. This statement told me to put down the burden. I could do things differently from other mothers, and none of us needed to be wrong.

The same is true of teaching maths and stats – “There are many good ways to teach mathematics and statistics.” (Which is not to say that there are not also many bad ways to both parent and teach mathematics – but I like to be positive.)

My previous post about the messages about maths, sent by maths and stats videos, led to some interesting comments – thanks especially to Michael Pye who “couldn’t get the chart out of [his] head”. (Nothing warms a blogger’s heart more!). He was too generous to call my description of the “procedural approach” a “straw-person”, but might have some justification to do so.

His comments (you can see the originals here) have been incorporated in this table, with some of my own ideas. In some cases the “explicit active approach” is a mixture of the two extremes. The table was created to outline the message I felt the videos often give, and the message that is being encouraged in much of the maths education community. In this post we expand it to look at good ways to teach maths.

 Procedural approach Explicit but active approach Social constructivist approach Main ideas Maths is about choosing and using procedures correctly Maths is about understanding ideas and recognising patterns Maths is about exploring ideas and finding patterns Strengths Orderly, structured, safe, cover the material, calm Orderly, structured, safe, cover the material, calm and satisfying Exciting, fun, annoying Skills valued Computation, memorisation, speed, accuracy Computation, memorisation, (not speed), accuracy + the ability to evaluate and analyse Creativity, collaboration, communication, critical thinking Teaching methods Demonstration, notes, practice Demonstration, notes, practice, guided discussion and exploration via modelling. Open-ended tasks, discussion, exploration Grouping Students work alone or in ability grouping Students discuss as a whole class or in mixed-ability groups Role of teacher Fount of wisdom, guide, enthusiast, coach. Fount of wisdom, guide, enthusiast, coach. Another learner, source of help, sometimes annoyingly oblique Attitude to mistakes Mistakes are a sign of failure Mistakes happen when we learn. (high percentage of success) Mistakes happen when we learn. Challenges Boredom, regimentation, may not develop resilience. Boredom, regimentation, could be taught purely to the test Can be difficult to tell if learning is taking place, difficult if the teacher is not confident Who (of the learners) succeeds? People like our current maths teachers Not sure – hopefully everyone! Use of worksheets and textbooks Important – guide the learning Develops mastery and provide assessment for learning. Limits gaps in understanding. Occasional use to supplement activities Role of videos Can be central Reinforce ideas and provide support out of class. Support materials

We agree that speed is not important, so why are there still timed tests and “mad minutes” .

## What is good mathematics teaching?

The previous post was about the messages sent by videos, and the table was used to fit the videos into a context. If we now examine the augmented table, we can address what we think good mathematics teaching looks like.

# For WHOM?

The biggest question when discussing what works in education is “for whom does it work?”  Just about any method of teaching will be successful for some people, depending on how you measure success. Teachers have the challenge of meeting the needs of around thirty students who are all individuals, with individual needs.

## Introversion/extraversion

I have recently been considering the scale from introvert – those who draw energy from working alone, and extraversion – those who draw energy from other people. Contrary to our desire to make everything binary, current thinking suggests that there is a continuum from totally introverted to totally extraverted. I was greatly relieved to hear that, as I have never been able to find my place at either end. I am happy to present to people, and will “work a room” if need be, thus appearing extraverted, but need to recover afterwards with time alone – thus introverted. Apparently I can now think of myself as an ambivert.

The procedural approach to teaching and learning mathematics is probably more appealing to those more at the introverted end of the spectrum, who would rather have fingernails extracted than work in a group. (And I suspect this would include a majority of incumbent maths teachers, though I am not sure about primary teachers.) I suspect that children who are more extroverted will gain from group work and community. If we choose either one of these modes of teaching exclusively we are disadvantaging one or other group.

# Different cultures

In New Zealand we are finding that children from cultures where a more social approach is used for learning do better when part of learning communities that value their cultural background and group endeavour. In Japan it is expected that all children will master the material, and children are not ability-grouped into lowered expectations. Dominant white western culture is more competitive. One way for schools to encourage large numbers of phone calls from unhappy white middle-class parents is to remove “streaming”, “setting”, or “ability grouping.”

# Silence and noise

I recently took part in a Twitter discussion with maths educators, one of whom believed that most maths classes should be undertaken in silence. One of the justifications was that exams will be taken in silence and individually. This may have worked for him, but for some students the pressure not to say anything is stifling. It also removes a great source of learning, their peers. Students who are embarrassed to ask a teacher for help can often get help from others. In fact some teachers require students to ask others before approaching the teacher.

# Moderation

As is often the case, the answer lies in moderation and variety. I would not advocate destroying all worksheets and textbooks, nor mandate frequent silent individual work. Here are some of suggestions for effective teaching of mathematics.

# Ideal maths teaching includes:

• Having variety in your approaches, as well as security
• Aiming for understanding and success
• Trying new ideas and having fun
• Embracing your own positive mathematical identity (and getting help if your mathematical identity is not positive)
• Allowing children to work at different speeds without embarrassment
• Having silence sometimes, and noise sometimes
• Being competent or getting help – a good teaching method done poorly is not a good teaching method

Here are links to other posts related to this:
The Golden Rule doesn’t apply to teaching

Educating the heart with maths and statistics

The nature of mathematics and statistics and what it means to learn and teach them

And thank you again to those who took the time to comment on the previous post. I’m always interested in all viewpoints.

# What has love got to do with maths?

This morning at the Twitter chat for teachers, (#bfc630nz) the discussion question was, How and what will you teach your students about life this year? As I lurked I was impressed at the ideas and ideals expressed by a mixed bunch of teachers from throughout New Zealand. I tweeted:  “I wonder how often maths teachers think about educating the heart. Yet maths affects how people feel so much.”

My teaching philosophy is summed up as “head, heart and hands”. I find the philosophy of constructivism appealing, that people create their own understanding and knowledge through experiences and reflection. I believe that learning is a social activity, and I am discovering that mathematics is a social endeavour. But underpinning it all I am convinced that people need to feel safe. That is where the heart comes in. “People do not care how much you know until they know how much you care.” Relationships are vital. I wrote previously about the nature of teaching statistics and mathematics.

# Teachers are people

In the culture of NZ Maori, when someone begins to address a group of people, they give a mihi, which is an introductory speech following a given structure. The mihi has the role of placing the person with respect to their mountain, their river, their ancestors. It enables the listeners to know who the person is before they begin to speak about anything else. I am not fluent in te reo, so do not give a mihi in Maori (yet), but I do introduce myself so that listeners know who I am. Learners need to know why I am teaching, and how I feel about the subject and about them. It can feel self-indulgent, thinking surely it is about the subject, not about me. But for many learners the teacher is the subject. Just look at subject choices in high school students and that becomes apparent.

Recently I began studying art at an evening class. I am never a passive learner (and for that reason do feel sympathy for anyone teaching me). Anytime I have the privilege of being a learner, I find myself stepping back and evaluating my responses and thinking of what the teacher has done to evoke these responses. Last week, in the first lesson, the teacher gave no introduction other than her name, and I felt the loss. Art, like maths, is emotionally embedded, and I would have liked to have developed more of a relationship with my teacher, before exposing my vulnerability in my drawing attempts. She did a fine job of reassuring us that all of our attempts were beautiful, but I still would like to know who she is.

# Don’t sweeten the broccoli

I suspect that some people believe that maths is a dry, sterile subject, where things are right or wrong. Many worksheets give that impression, with columns of similar problems in black and white, with similarly black and white answers. Some attempt to sweeten the broccoli by adding cartoon characters and using bright colours, but the task remains devoid of adventure and creativity. Now, as a child, I actually liked worksheets, but that is probably because they were easy for me, and I always got them right. I liked the column of little red ticks, and the 100% at the end. They did not challenge me intellectually, but I did not know any better. For many students such worksheets are offputting at best. Worksheets also give a limited view of the nature of mathematics.

I am currently discovering how narrow my perception of mathematics was. We are currently developing mathematical activities for young learners, and I have been reading books about mathematical discoveries. Mathematics is full of creativity and fun and adventure, opinion, multiple approaches, discussion and joy. The mathematics I loved was a poor two-dimensional faded version of the mathematics I am currently discovering.I fear most primary school teachers (and possibly many secondary school maths teachers) have little idea of the full potential of mathematics.

Some high school maths teachers struggle with the New Zealand school statistics curriculum. It is embedded in real-life data and investigations. It is not about calculating a mean or standard deviation, or some horrible algebraic manipulation of formulae. Statistics is about observing and wondering, about asking questions, collecting data, using graphs and summary statistics to make meaning out of the data and reflecting the results back to the original question before heading off on another question. Communication and critical thinking are vital. There are moral, ethical and political aspects to statistics.

# Teaching mathematics and statistics is an act of social justice

I cannot express strongly enough that the teaching of mathematics and statistics is a political act. It is a question of social justice. In my PhD thesis work, I found that social deprivation correlated with opportunities to learn mathematics. My thoughts are that there are families where people struggle with literacy, but mostly parents from all walks of life can help their children with reading. However, there are many parents who have negative experiences around mathematics, who feel unable to engage their children in mathematical discussions, let alone help them with mathematics homework. And sadly they often entrench mathematical fatalism. “I was no good at maths, so it isn’t surprising that you are no good at maths.”

Our students need to know that we love them. When you have a class of 800 first year university students it is clearly not possible to build a personal relationship with each student in 24 contact hours. However the key to the ninety and nine is the one. If we show love and respect in our dealings with individuals in the class, if we treat each person as valued, if we take the time to listen and answer questions, the other students will see who we are. They will know that they can ask and be treated well, and they will know that we care. When we put time into working out good ways to explain things, when we experiment with different ways of teaching and assessing, when we smile and look happy to be there – all these things help students to know who we are, and that we care.

As teachers of mathematics and statistics we have daunting influence over the futures of our students. We need to make sure we are empowering out students, and having them feel safe is a good start.

# Why people hate statistics

This summer/Christmas break it has been my pleasure to help a young woman who is struggling with statistics, and it has prompted me to ask people who teach postgraduate statistical methods – WTF are you doing?

Louise (name changed) is a bright, hard-working young woman, who has finished an undergraduate degree at a prestigious university and is now doing a Masters degree at a different prestigious university, which is a long way from where I live and will remain nameless. I have been working through her lecture slides, past and future and attempting to develop in her some confidence that she will survive the remainder of the course, and that statistics is in fact fathomable.

# Incomprehensible courses alienating research students

After each session with Louise I have come away shaking my head and wondering what this lecturer is up to. I wonder if he/she really understands statistics or is just passing on their own confusion. And the very sad thing is that I KNOW that there are hundreds of lecturers in hundreds of similar courses around the world teaching in much the same way and alienating thousands of students every year.

And they need to stop.

Here is the approach: You have approximately eight weeks, made up of four hour sessions, in which to teach your masters students everything they could possibly need to know about statistics. So you tell them everything! You use technical terms with little explanation, and you give no indication of what is important and what is background. You dive right in with no clear purpose, and you expect them to keep up.

Frequently Louise would ask me to explain something and I would pause to think. I was trying to work out how deep to go. It is like when a child asks where babies come from. They may want the full details, but they may not, and you need to decide what level of answer is most appropriate. Anyone who has seen our popular YouTube videos will be aware that I encourage conceptual understanding at best, and the equivalent of a statistics drivers licence at worst. When you have eight weeks to learn everything there is to know about statistics, up to and including multiple regression, logistic regression, GLM, factor analysis, non-parametric methods and more, I believe the most you can hope for is to be able to get the computer to run the test, and then make intelligent conclusions about the output.

There was nothing in the course about data collection, data cleaning, the concept of inference or the relationship between the model and reality. My experience is that data cleaning is one of the most challenging parts of analysis, especially for novice researchers.

# Use learning objectives

And maybe one of the worst problems with Louise’s course was that there were no specific learning objectives. One of my most popular posts is on the need for learning objectives. Now I am not proposing that we slavishly tell students in each class what it is they are to learn, as that can be tedious and remove the fun from more discovery style learning. What I am saying is that it is only fair to tell the students what they are supposed to be learning. This helps them to know what in the lecture is important, and what is background. They need to know whether they need to have a passing understanding of a test, or if they need to be able to run one, or if they need to know the underlying mathematics.

Take for example, the t-test. There are many ways that the t-statistic can be used, so simply referring to a test as a t-test is misleading before you even start. And starting your teaching with the statistic is not helpful. We need to start with the need! I would call it a test for the difference of two means from two groups. And I would just talk about the t statistic in passing. I would give examples of output from various scenarios, some of which reject the null, some of which don’t and maybe even one that has a p-value of 0.049 so we can talk about that. In each case we would look at how the context affects the implications of the test result. In my learning objectives I would say: Students will be able to interpret the output of a test for the difference of two means, putting the result in context. And possibly, Students will be able to identify ways in which a test for the difference of two means violates the assumptions of a t-test. Now that wasn’t hard was it?

# Like driving a car

Louise likes to understand where things come from, so we did go through an overview of how various distributions have been found to model different aspects of the world well – starting with the normal distribution, and with a quick jaunt into the Central Limit Theorem. I used my Dragonistics data cards, which were invented for teaching primary school, but actually work surprisingly well at all levels! I can’t claim that Louise understands the use of the t distribution, but I hope she now believes in it. I gave her the analogy of learning to drive – that we don’t need to know what is happening under the bonnet to be a safe driver. In fact safe driving depends more on paying attention to the road conditions and human behaviour.

# Assumptions

Louise tells me that her lecturer emphasises assumptions – that the students need to examine them all, every time they look at or perform a statistical test. Now I have no problems with this later on, but students need to have some idea of where they are going and why, before being told what luggage they can and can’t take. And my experience is that assumptions are always violated. Always. As George Box put it – “All models are wrong and some models are useful.”

It did not help that the lecturer seemed a little confused about the assumption of normality. I am not one to point the finger, as this is a tricky assumption, as the Andy Field textbook pointed out. For example, we do not require the independent variables in a multiple regression to be normally distributed as the lecturer specified. This is not even possible if we are including dummy variables. What we do need to watch out for is that the residuals are approximately modelled by a normal distribution, and if not, that we do something about it.

You may have gathered that my approach to statistics is practical rather than idealistic. Why get all hot and bothered about whether you should do a parametric or non-parametric test, when the computer package does both with ease, and you just need to check if there is any difference in the result. (I can hear some purists hyperventilating at this point!) My experience is that the results seldom differ.

# What post-graduate statistical methods courses should focus on

Instructors need to concentrate on the big ideas of statistics – what is inference, why we need data, how a sample is collected matters, and the relationship between a model and the reality it is modelling. I would include the concept of correlation, and its problematic link to causation. I would talk about the difference between statistical significance and usefulness, and evidence and strength of a relationship. And I would teach students how to find the right fishing lessons! If a student is critiquing a paper that uses logistical regression, that is the time they need to read up enough about logistical regression to be able to understand what they are reading.They cannot possibly learn a useful amount about all the tests or methods that they may encounter one day.

If research students are going to be doing their own research, they need more than a one semester fly-by of techniques, and would be best to get advice from a statistician BEFORE they collect the data.

# Final word

So here is my take-home message:

Stop making graduate statistical methods courses so outrageously difficult by cramming them full of advanced techniques and concepts. Instead help students to understand what statistics is about, and how powerful and wonderful it can be to find out more about the world through data.

# Maths is right or wrong – end of discussion  – or is it?

In 1984 I was a tutor in Operations Research to second year university students. My own experience of being in tutorials at University had been less than inspiring, with tutors who seemed reserved and keen to give us the answers without too much talking. I wanted to do a good job. My induction included a training session for teaching assistants from throughout the university. Margaret was a very experienced educational developer and was very keen for us to get the students discussing. I tried to explain to her that there really wasn’t a lot to discuss in my subject. You either knew how to solve a set of linear equations using Gauss-Jordan elimination or you didn’t. The answer was either correct or incorrect.

I suspect many people have this view of mathematics and its close relations, statistics and operations research.  Our classes have traditionally followed a set pattern. The teacher shows the class how to do something. The class copies down notes and some examples into their books, and then they individually work through exercises in the textbook – generally in silence. The teacher walks around the room and helps students as needed.

Prizes can help motivate students to give answers in unfamiliar settings

So when we talk about discussion in maths classes, this is not something that mathematics and statistics teachers are all familiar with. I recently gave a workshop for about 100 Scholarship students in Statistics in the Waikato. What a wonderful time we had together! The students were from all different schools and needed to be warmed up a little with prizes, but we had some good discussion in groups and as a whole. One of the teachers  commented later on the level of discussion in the session. Though she was an experienced maths teacher she found it difficult to lead discussion in the class. I am sure there are many like her.

## It is important to talk in maths and stats classes

It is difficult for many students to learn in solitary silence. As we talk about a topic we develop our understanding, practice the language of the discipline and experience what it means to be a mathematician or statistician. Explaining ideas to others helps us to make sense of them ourselves. As we listen to other people’s thinking we can see how it relates to what we think, and can clear up misconceptions. Some people just like to talk, (who me?) and find learning more fun in a cooperative or collaborative environment. This recognition of the need for language and interaction underpins the development of “rich tasks” that are being used in mathematics classrooms throughout the world.

I have previously stated that “Maths learning should be communal and loud and exciting, not solitary, quiet and routine.”

## Classroom atmosphere

One thing that was difficult at the Scholarship day was that the students did not know each other, and came from various schools. In a regular classroom the teacher has the opportunity of and responsibility for setting the tone of the class. Students need to feel safe. They need to feel that giving a wrong answer is not going to lead to ridicule. Several sessions at the start of the year may be needed to encourage discussion. Ideally this will become less necessary over time as students become used to interactive, inquiry-based learning in mathematics and statistics through their whole school careers.

Number talks” are a tool to help students improve their understanding of number, and recognise that there are many ways to see things. For example, the class might be shown a picture of dots and asked to explain how many dots they see, and how they worked it out. Several different ways of thinking will be discussed.

Children are encouraged to think up multiple ways of thinking about numbers  and to develop discussion by following prompts, sometimes called “talk moves”. Talk moves include revoicing, where the teacher restates what she thinks the student has said, asking students to restate another students reasoning, asking students to apply their own reasoning to someone else’s reasoning (Do you agree or disagree and why?), prompting for further participation (Would someone like to add on?), and using wait time (teachers should allow students to think for at least 10 seconds before calling on someone to answer. These are explained more fully in The Tools of Classroom talk.

Google Image is awash with classroom posters outlining “Talk moves”. I have been unable to trace back the source of the term or the list, and would be very pleased if someone can tell me the source,  to be able to attribute this structure.

# Good questions

The essence of good discussion is good questions. Question ping pong is not classroom discussion. We have all experienced a teacher working through examples on the board, while asking students the answers to numerical questions. This is a control technique for keeping students attentive, but it can fall to a small group of students who are quick to answer. I remember doing just this in my tutorial on solving matrices, when I didn’t know any better.

It is not a hard-and-fast rule, but definitely a thing to think about. I like to use True/False quizzes to help uncover misconceptions, and develop use of statistical language. I just about always know the answer to the question, but what I don’t know is how many students know the answer. So  I ask the question not to know the answer, but to know if the students do, and to provoke discussion. Perhaps a more interesting question would be, how many students do you think will say “True” to this statement. It would then be interesting to find out their reasoning, so long as it does not get personal!

## Multiple answers and open-ended questions

Where possible we need to ask questions that can have a number of acceptable answers. A discussion about what to do with outliers will seldom have a definitive answer, unless the answer is that it depends! Asking students to make a pictorial representation of an algebra problem can lead to interesting discussions.

The MathTwitterBlogosphere has many attractive ideas to use in teaching maths.

I rather like “Which one doesn’t belong”, which has echoes of “One of these things is not like the other, one of these things doesn’t belong, can you guess…” from Sesame Street. However, in Sesame Street the answer was usually unambiguous, whereas  with WODB there are lots of ways to have alternative answers. There is a website dedicated to sets of four objects, and the discussion is about which one does not belong. In each case all four can “not belong” for some reason, which I find a bit contrived, but it can lead to discussion about which is the strongest case of not belonging.

## Whole class and group discussion

Some discussions work well for a whole class, while others are better in small groups or pairs. Matching or ordering paper slips with expressions can lead to great discussion. For example we could have a set of graphs of the same data, and order them according to how effective they are at communicating the aspects of the data. Or there could be statements of possible events and students can place them in order of likelihood. The discussion involved in ordering them helps students to clarify the nature of probability. Desmos has a facility for teachers to set up card matching or grouping exercises, which reduces the work and waste of paper.

Our own Dragonistics data cards are great for discussion. Students can be given a number of dragons (more than two) and decide which one is the best, or which one doesn’t belong, or how to divide the dragons fairly into two or more groups.

It can seem to be wasting time to have discussion. However the evidence from research is that good discussion is an effective way for students to learn mathematics and statistics. I challenge all maths and stats teachers to increase and improve the discussion in their class.

# The role of play in learning

I have been reading further about teaching mathematics and came across this interesting assertion:

Play, understood as something frivolous, opposed to work, off-task behaviour, is not welcomed into most mathematics classrooms. But play is exactly what is needed. It is only play that can entice us to the type of repetition that is needed to learn how to inhabit the mathematical landscape and how to create new mathematics.
Friesen(2000) – unpublished thesis, cited in Stordy, Children Count, (2015)

# Play and practice

It is an appealing idea that as children play, they have opportunities to engage in repetition that is needed in mastering some mathematical skills. The other morning I decided to do some exploration of prime numbers and factorising even before I got out of bed. (Don’t judge me!). It was fun, and I discovered some interesting properties, and came up with a way of labelling numbers as having two, three and more dimensions. 12 is a three dimensional number, as is 20, whereas 35 and 77 are good examples of two dimensional numbers. As I was thus playing on my own, I was aware that it was practising my tables and honing my ability to think multiplicatively. In this instance the statement from Friesen made sense. I admit I’m not sure what it means to “create new mathematics”. Perhaps that is what I was doing with my 2 and 3 dimensional numbers.

You may be wondering what this has to do with teaching statistics to adults. Bear with…

## Traditional vs recent teaching methods for mathematics

Today on Twitter, someone asked what to do when a student says that they like being shown what to do, and then practising on textbook examples. This is the traditional method for teaching mathematics, and is currently not seen as ideal among many maths teachers (particularly those who inhabit the MathTwitterBlogosphere or MTBoS, as it is called). There is strong support for a more investigative, socially constructed approach to learning and teaching mathematics.  I realise that as a learner, I was happy enough learning maths by being shown what to do and then practising. I suspect a large proportion of maths teachers also liked doing that. Khan Academy videos are wildly popular with many learners and far too many teachers because they perpetuate this procedural view of mathematics. So is the procedural approach wrong? I think what it comes down to is what we are trying to teach. Were I to teach mathematics again I would not use “show then practise” as my modus operandi. I would like to teach children to become mathematicians rather than mathematical technicians. For this reason, the philosophies and methods of Youcubed, Dan Meyer and other MTBoS bloggers have appeal.

## Play and statistics

Now I want to turn my thoughts to statistics. Is there a need for more play in statistics? Can statistics be playful in the way that mathematics can be playful? Operations Research is just one game after another! Simulation, critical path, network analysis, travelling salesperson, knapsack problem? They are all big games. Probability is immensely playful, but what about statistical analysis? Can and should statistics be playful?

My first response is that there is no play in statistics. Statistics is serious and important, and deals with reality, not joyous abstract ideas like prime numbers and the Fibonacci series – and two and three dimensional numbers.

## The excitement of a fresh set of data

But there is that frisson of excitement as you finally finish cleaning your database and a freshly minted set of variables and observations beckons to you, with SPSS, SAS or even Excel at your fingertips. A new set of data is a new journey of discovery. Of course a serious researcher has already worked out a methodical route through her hypotheses… maybe. Or do we mostly all fossick about looking for patterns and insights, growing more and more familiar with the feel of the data, as if we were squeezing it through our fingers? So yes – my experience of data exploration is playful. It is an adventure, with wrong turns, forgetting the path, starting again, finding something only to lose it again and finally saying “enough” and taking a break, not because the data has been exhausted, but because I am.

## Writing the report is like cleaning up

Writing up statistical analysis is less exciting. It feels like picking up the gardening tools and putting them away after weeding the garden. Or cleaning the paintbrushes after creating a masterpiece. That was not one of my strengths – finishing and tidying up afterwards. The problem was that I felt I had finished when the original task had been completed – when the weeds had been pulled or the painting completed. In my view, cleaning and putting away the tools was an afterthought that dragged on after the completion of the task, and too often got ignored. Happily I have managed to change my behaviour by rethinking the nature of the weeding task. The weeding task is complete when the weeds are pulled and in the compost and the implements are resting clean and safe where they belong. Similarly a statistical analysis is not what comes before the report-writing, but is rather the whole process, ending when the report is complete, and the data is carefully stored away for another day. I wonder if that is the message we give our students – a thought for another post.

# Can statistics be playful?

For I have not yet answered the question. Can statistics be playful in the way that mathematics can be playful? We want to embed play in order to make our task of repetition be more enjoyable, and learning statistics requires repetition, in order to develop skills and learn to differentiate the universal from the individual. One problem is that statistics can seem so serious. When we use databases about global warming, species extinction, cancer screening, crime detection, income discrepancies and similarly adult topics, it can seem almost blasphemous to be too playful about it.

I suspect that one reason our statistics videos on YouTube are so popular is because they are playful.

Helen has an attitude problem

Helen has a real attitude problem and hurls snarky comments at her brother, Luke. The apples fall in an odd way, and Dr Nic pops up in strange places. This playfulness keeps the audience engaged in a way that serious, grown up themes may not. This is why we invented Ear Pox in our video about Risk and screening, because being playful about cancer is inappropriate.

Ear Pox is imaginary disease for which we are studying the screening risk.

A set of 240 Dragonistics data cards provides light-hearted data which yields satisfying results.

When I began this post I did not intend to bring it around to the videos and the Dragonistics data cards, but I have ended up there anyway. Maybe that is the appeal of the Dragonistics data cards –  that they avoid the gravitas of true and real grown-up data, and maintain a playfulness that is more engaging than reality. There is a truthiness about them – the two species – green and red dragons are different enough to present as different animal species, and the rules of danger and breath-type make sense. But students may happily play with the dragon cards without fear of ignorance or even irreverence of a real-life context.

What started me thinking about play with regards to learning maths and statistics is our Cat Maths cards. There are just so many ways to play with them that I can see Cat Maths cards playing an integral part in a junior primary classroom. This is why we created them and want them to make their way into classrooms. Sadly, our Kickstarter campaign was unsuccessful, but we hope to work with an established game manufacturer to bring them to the market by the end of 2017.

And maybe we need to be thinking a little more about the role of play in learning statistics – even for adults! What do you think? Can and should statistics be playful? And for what age group? Do you find statistical analysis fun?

# I’ve been thinking lately….

Sometimes it pays to stop and think. I have been reading a recent textbook for mathematics teachers, Dianne Siemon et al, Teaching mathematics: foundations to middle years (2011). On page 47 the authors asked me to “Take a few minutes to write down your own views about the nature of mathematics, mathematics learning and mathematics teaching.” And bearing in mind I see statistics as related to, but not enclosed by mathematics, I decided to do the same for statistics as well. So here are my thoughts:

# The nature of mathematics

Mathematicians love the elegance of mathematics

Mathematics is a way of modelling and making sense of the world. Mathematics underpins scientific and commercial endeavours as well as everyday life. Mathematics is about patterns and proofs and problem structuring and solution finding. I used to think it was all about the answer, but now I think it is more about the process. I used to think that maths was predominantly an individual endeavour, but now I can see how there is a social or community aspect as well. I fear that too often students are getting a parsimonious view of mathematics, thinking it is only about numbers, and something they have to do on their own. I find my understanding of the nature of mathematics is rapidly changing as I participate in mathematics education at different ages and stages. I have also been influenced by the work of Jo Boaler.

# To learn mathematics

My original idea of mathematics learning comes from my own successful experience of copying down notes from the board, listening to the teacher and doing the exercises in the textbook. I was not particularly fluent with my times-tables, but loved problem-solving. If I got something wrong, I was happy to try again until I nutted it out. Sometimes I even did recreational maths, like the time I enumerated all possible dice combinations in Risk to find out who had the advantage – attacker or defender. I always knew that it took practice to be good at mathematics. However I never really thought of mathematics as a social endeavour. I feel I missed out, now. From time to time I do have mathematical discussions with my colleague. It was an adventure inventing Rogo and then working out a solution method. Mathematics can be a social activity.

# To teach mathematics

When I became a maths teacher I perpetuated the method that had worked for me, as I had not been challenged to think differently. I did like the ideas of mastery learning and personalised system of instruction. This meant that learners progressed to the next step only when they had mastered the previous one. I was a successful enough teacher and enjoyed my work.

Then as a university lecturer I had to work differently, and experimented. I had a popular personalised system of instruction quantitative methods course, relying totally on students working individually, at their own pace. I am happy that many of my students were successful in an area they had previously thought out of their reach. For some students it was the only subject they passed.

# What I would do now

If I were to teach mathematics at school level again, I hope I would do things differently. I love the idea of “Number talks” and rich tasks which get students to think about different ways of doing things. I had often felt sad that there did not seem to be much opportunity to have discussions in maths, as things were either right or wrong. Now I see what fun we could have with open-ended tasks. Maths learning should be communal and loud and exciting, not solitary, quiet and routine. I have been largely constructivist in my teaching philosophy, but now I would like to try out social constructivist thinking.

# Statistics

And what about statistics? At school in the 1970s I never learned more than the summary statistics and basic probability. At uni level it was bewildering, but I managed to get an A grade in a first year paper without understanding any of the basic principles. It wasn’t until I was doing my honours year in Operations Research and was working as a tutor in Statistical methods that things stared to come together – but even then I was not at home with statistical ideas and was happy to leave them behind when I graduated.

# The nature of statistics

Statistics lives in the real world

My views now on the nature of statistics are quite different. I believe statistical thinking is related to mathematical thinking, but with less certainty and more mess. Statistics is about models of reality, based on imperfect and incomplete data. Much of statistics is a “best guess” backed up by probability theory. And statistics is SO important to empowered citizenship. There are wonderful opportunities for discussion in statistics classes. I had a fun experience recently with a bunch of Year 13 Scholarship students in the Waikato. We had collected data from the students, having asked them to interpret a bar chart and a pie chart. There were some outliers in the data and I got them to suggest what we should do about them. There were several good suggestions and I let them discuss for a while then moved on. One asked me what the answer was and I said I really couldn’t say – any one of their suggestions was valid. It was a good teaching and learning moment. Statistics is full of multiple good answers, and often no single, clearly correct, answer.

# Learning statistics

My popular Quantitative Methods for Business course was developed on the premise that learning statistics requires repeated exposure to similar analyses of multiple contexts. In the final module, students did many, many hypothesis tests, in the hope that it would gradually fall into place. That is what worked for me, and it did seem to work for many of the students. I think that is not a particularly bad way to learn statistics. But there are possibly better ways.

I do like experiential learning, and statistics is perfect for real life experiences. Perhaps the ideal way to learn statistics is by performing an investigation from start to finish, guided by a knowledgeable tutor. I say perhaps, because I have reservations about whether that is effective use of time. I wrote a blog post previously, suggesting that students need exposure to multiple examples in order to know what in the study is universal and what applies only to that particular context. So perhaps that is why students at school should be doing an investigation each year within a different context.

# The nature of understanding

This does beg the question of what it means to learn or to understand anything. I hesitate to claim full understanding. Of anything. Understanding is progressive and multi-faceted and functional. As we use a technique we understand it more, such as hypothesis testing or linear programming. Understanding is progressive. My favourite quote about understanding is from Moore and Cobb, that “Mathematical understanding is not the only understanding.” I do not understand the normal distribution because I can read the Gaussian formula. I understand it from using it, and in a different way from a person who can derive it. In this way my understanding is functional. I have no need to be able to derive the Gaussian function for what I do, and the nature and level of my understanding of the normal distribution, or multiple regression, or bootstrapping is sufficient for me, for now.

# Teaching statistics

I believe our StatsLC videos do help students to understand and learn statistics. I have put a lot of work into those explanations, and have received overwhelmingly positive feedback about the videos. However, that is no guarantee, as Khan Academy videos get almost sycophantic praise and I know that there are plenty of examples of poor pedagogy and even error in them. I have recently been reading from “Make it Stick”, which summarises theory based on experimental research on how people learn for recall and retention. I was delighted to find that the method we had happened upon in our little online quizzes was promoted as an effective method of reinforcing learning.

This has been an enlightening exercise, and I recommend it to anyone teaching in mathematics or statistics. Read the first few chapters of a contemporary text on how to teach mathematics. Dianne Siemon et al, Teaching mathematics: foundations to middle years (2011) did it for me. Then “take a few minutes to write down your own views about the nature of mathematics, mathematics learning and mathematics teaching.” To which I add my own suggestion to think about the nature of statistics or operations research. Who knows what you will find out. Maybe you could put a few of your ideas down in the comments.

# Mathematics teaching Rockstar – Jo Boaler

## Moving around the education sector

My life in education has included being a High School maths teacher, then teaching at university for 20 years. I then made resources and gave professional development workshops for secondary school teachers. It was exciting to see the new statistics curriculum being implemented into the New Zealand schools. And now we are making resources and participating in the primary school sector. It is wonderful to learn from each level of teaching. We would all benefit from more discussion across the levels.

## Educational theory and idea-promoters

My father used to say (and the sexism has not escaped me) “Never run after a woman, a bus or an educational theory, as there will be another one along soon.” Education theories have lifespans, and some theories are more useful than others. I am not a fan of “learning styles” and fear they have served many students ill. However, there are some current ideas and idea-promoters in the teaching of mathematics that I find very attractive. I will begin with Jo Boaler, and intend to introduce you over the next few weeks to Dan Meyer, Carol Dweck and the person who wrote “Making it stick.”

My first contact with Jo Boaler was reading “The Elephant in the Classroom.” In this Jo points out how society is complicit in the idea of a “maths brain”. Somehow it is socially acceptable to admit or be almost defensively proud of being “no good at maths”. A major problem with this is that her research suggests that later success in life is connected to attainment in mathematics. In order to address this, Jo explores a less procedural approach to teaching mathematics, including greater communication and collaboration.

## Mathematical Mindsets

It is interesting to  see the effect Jo Boaler’s recent book, “Mathematical Mindsets “, is having on colleagues in the teaching profession. The maths advisors based in Canterbury NZ are strong proponents of her idea of “rich tasks”. Here are some tweets about the book:

“I am loving Mathematical Mindsets by @joboaler – seriously – everyone needs to read this”

“Even if you don’t teach maths this book will change how you teach for ever.”

“Hands down the most important thing I have ever read in my life”

What I get from Jo Boaler’s work is that we need to rethink how we teach mathematics. The methods that worked for mathematics teachers are not the methods we need to be using for everyone. The defence “The old ways worked for me” is not defensible in terms of inclusion and equity. I will not even try to boil down her approach in this post, but rather suggest readers visit her website and read the book!

At Statistics Learning Centre we are committed to producing materials that fit with sound pedagogical methods. Our Dragonistics data cards are perfect for use in a number of rich tasks. We are constantly thinking of ways to embed mathematics and statistics tasks into the curriculum of other subjects.

## Challenges of implementation

I am aware that many of you readers are not primary or secondary teachers. There are so many barriers to getting mathematics taught in a more exciting, integrated and effective way. Primary teachers are not mathematics specialists, and may well feel less confident in their maths ability. Secondary mathematics teachers may feel constrained by the curriculum and the constant assessment in the last three years of schooling in New Zealand. And tertiary teachers have little incentive to improve their teaching, as it takes time from the more valued work of research.

Though it would be exciting if Jo Boaler’s ideas and methods were espoused in their entirety at all levels of mathematics teaching, I am aware that this is unlikely – as in a probability of zero. However, I believe that all teachers at all levels can all improve, even a little at a time. We at Statistics Learning Centre are committed to this vision. Through our blog, our resources, our games, our videos, our lessons and our professional development we aim to empower all teacher to teach statistics – better! We espouse the theories and teachings explained in Mathematical Mindsets, and hope that you also will learn about them, and endeavour to put them into place, whatever level you teach at.

Do tell us if Jo Boalers work has had an impact on what you do. How can the ideas apply at all levels of teaching? Do teachers need to have a growth mindset about their own ability to improve their teaching?

Here are some quotes to leave you with:

## Mathematical Mindsets Quotes

“Many parents have asked me: What is the point of my child explaining their work if they can get the answer right? My answer is always the same: Explaining your work is what, in mathematics, we call reasoning, and reasoning is central to the discipline of mathematics.”
“Numerous research studies (Silver, 1994) have shown that when students are given opportunities to pose mathematics problems, to consider a situation and think of a mathematics question to ask of it—which is the essence of real mathematics—they become more deeply engaged and perform at higher levels.”
“The researchers found that when students were given problems to solve, and they did not know methods to solve them, but they were given opportunity to explore the problems, they became curious, and their brains were primed to learn new methods, so that when teachers taught the methods, students paid greater attention to them and were more motivated to learn them. The researchers published their results with the title “A Time for Telling,” and they argued that the question is not “Should we tell or explain methods?” but “When is the best time do this?”
“five suggestions that can work to open mathematics tasks and increase their potential for learning: Open up the task so that there are multiple methods, pathways, and representations. Include inquiry opportunities. Ask the problem before teaching the method. Add a visual component and ask students how they see the mathematics. Extend the task to make it lower floor and higher ceiling. Ask students to convince and reason; be skeptical.”

All quotes from

Jo Boaler, Mathematical Mindsets: Unleashing Students’ Potential through Creative Math, Inspiring Messages and Innovative Teaching

# Teaching sampling with dragon data cards

## Data cards for teaching statistics

Data cards are a wonderful way for students to get a feel for data. As a University lecturer in the 1990s, I found that students often didn’t understand about the multivariate nature of data. This may well be an artifact of the kind of statistics they studied at school, which was univariate (finding the confidence interval for the mean of a set of numbers) or bivariate at best. And back then, when statistical analysis was done by hand calculation, this was all you could expect. How times have changed!

At the NZAMT (NZ Association of Mathematics Teachers) conference in 2015, both Dick de Veaux and Rob Gould suggested in their keynote addresses that students need to be exposed to multivariate data. Rob endorsed the use of data cards to enable this. Data cards are a wonderful tool for all levels of learning. In the New Zealand “Figure it out” series, there are several lessons that use data cards, generally made by the students themselves. We were inspired by this and have developed a set of 240 data cards with information about dragons, to help teachers and students learn and be successful in their statistical endeavours. In an earlier post I discuss the pros and cons of fictional data.

The Dragonistics data cards are now available to purchase, and we have a range of supporting materials for lessons and activities at various levels. You can find out more about data cards by clicking on this link.

## Teaching Sampling using Dragonistics data cards

A small sample of Dragonistics data cards

The real advantage of using data cards to teach sampling is that it is difficult, and approaching prohibitive, to record and analyse all the information. When you have a spreadsheet of data on a computer, to take a sample is contrived and can confuse students. They wonder why you would not simply analyse all the data for the population.Physically collecting data can take more time than is practical. With the data cards, we know we cannot easily process the data from all 240 or 480 dragons (depending on how many boxes you use.) Sampling then becomes a sensible solution. Different groups of students take different samples, and perform their own analysis, leading to similar, but not identical results. This shows the concept of variation due to sampling in a concrete and memorable way.

Some decades ago I developed a set of counters of four different colours, with data with different means and standard deviations. I used these to teach about the concept of sampling, and the students did ANOVA analysis on them to see if the means of the four groups were the same. This was a good way to teach this principle. However there were two limitations. The first limitation is that the data is not multivariate. There are just two

The old technology – two variables, and no embedded context

variables, colour and the number. And the second limitation is that there was no context. I made up a context to go with it, something around sales I think, as this was for an MBA class, which partly overcame that problem.

I’d like to think that I have learned from all the reading, research, experience, seminars etc on how to teach statistics that I have participated in. Consequently, were I to teach an MBA Quantitative methods class again, I think I would use the Dragon data cards. We have recently produced this lesson plan, that teaches about the concept of sampling and variation due to sampling. Dragon data cards could also be used for teaching about the mechanics of sampling, such as stratification and systematic sampling. There needs to be a story behind the analysis or there is no point to the conclusion. In the lesson previously alluded to, the scenario is that we are building separate shelters for male and female dragons, and it would be useful to have an idea of the relative strengths of male and female dragons.

## Evidence and Distribution

Using data cards gives a wonderful opportunity to explore the concepts of evidence and of distribution. The students lay out their cards in a nice bar chart arrangement, and say, “See  – there is a difference.” Teachers should then ask for evidence. Students need to be able to articulate what evidence there is for the effect they have observed, and place it in context. We have found this to be a useful process when teaching students of all levels.

With regard to distribution, if we work only with numbers, and find the medians of the two groups and observe that the median is higher for one group than the other, this is rather limited information. By observing the distribution of the dragon cards between the two sexes, we can see that there is overlap. It is not a clearcut difference. Additionally we may observe other effects, such as due to colour, which we might like to explore further in another journey around the Statistical Enquiry Cycle.

## Data cards are a win

It is fascinating that the concept of data cards is so new. It seems like an obvious idea, and makes concrete some very tricky abstract ideas. Data cards are useful at almost any level of understanding. As the need for understanding of statistics grows, there has been an emphasis on finding out better ways to teach for understanding. Clearly data cards are a win!