<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:Wingdings;
panose-1:5 0 0 0 0 0 0 0 0 0;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p
{mso-style-priority:99;
mso-margin-top-alt:auto;
margin-right:0cm;
mso-margin-bottom-alt:auto;
margin-left:0cm;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";
mso-fareast-language:EN-US;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-AU" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Hi Mark and anyone else reading ;)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Love these generous response from you and others. I’m starting to realise that having a list discussion that’s open to all is an interesting thing in its own
right. I am very used to two way only communication. It’s made me think about how do you start a debate that’s not just a number of separate conversations?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Anyone else out there in EduList land who would like to contribute a question/comment/knowledge?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Anyway, I’m enjoying the insights into how everyone puts together their exams. It’s funny isn’t it that so many of us teach IT and yet we will all be writing
our own exam/sac questions – lots of duplication or maybe just a chance for us all to be creative?<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Thanks again<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Liam<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">PS. There is more to my email below your comments.<o:p></o:p></span></p>
<p class="MsoNormal"><b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span lang="EN-US" style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> itapps-bounces@edulists.com.au [mailto:itapps-bounces@edulists.com.au]
<b>On Behalf Of </b>Mark KELLY<br>
<b>Sent:</b> Thursday, 29 November 2012 8:22 PM<br>
<b>To:</b> Year 12 IT Applications Teachers' Mailing List<br>
<b>Subject:</b> Re: [Year 12 IT Apps] Questions to test understanding<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">G'day Liam.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<p class="MsoNormal">This topic could become an Edulist topic in its own right. Writing questions is as much art as science, and usually based on lots of experience of how students typically think and respond. Perhaps this is why some exam questions written
by advanced IT academics who don't actually teach 16-17 year olds occasionally go wrong?<o:p></o:p></p>
<div>
<p class="MsoNormal"><span style="color:#1F497D">I love how kids respond – can drive me nuts when they respond in an entirely left field way to what I expected. Gradually tightening that up but there will always be scope for that.
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal">I've just finished writing 2 ITA exams and - thinking back - a lot of my writing was based on predicting what an average kid of mine would read and how he/she* would respond. The challenge is to write questions to differentiate between
D, C, B, and A+ students fairly, and give each of them a chance to show what they know.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="color:#1F497D">Yes.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal">I also learn a lot from classic bad questions I've seen in exams: those that are too easy, removed from the study design, vaguely worded, ambiguous, confusing, incorrect in fact. Some questions are fine, but the suggested answers are the
problem: this is a big problem with VCAA exams since you can't complain about an answer after the exams have been marked.<span style="color:#1F497D"><o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal">But your average exam will have a very few low-level Bloom taxonomy questions: define this word etc. One or two, to settle students' nerves at the start of section A and B. The majority of them, however, should be getting students to
apply their knowledge in a given context, and justifying their opinions.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="color:#1F497D">Yes – comes back to Andrew’s “runs on the board” comment I think with the low-level questions and then moving on.
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal">And I agree with other posters: you need to abide by exam conventions, but also sometimes break out and challenge kids with unexpected (but fair and relevant) means of assessing their understanding.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="color:#1F497D">Any examples you’ld like to share – these types of questions interest me at the moment. The ones that challenge them but aren’t tied up too much into exact recall or semantics.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal">I keep telling my kids all year: your job is to fill your Bucket O' Knowledge with ITA facts. Your payday comes when you select relevant facts from the bucket and apply them to a question in an exam or outcome. It's the judgement you get
marks for, not the memorization of words and definitions.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-family:Wingdings;color:#1F497D">J</span><span style="color:#1F497D"><o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal">Dammit. This post has already started to become a thesis. Time to stop.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="color:#1F497D">No. ;)<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
</div>
<div>
<p class="MsoNormal">Good question, though, Liam. It's one I don't usually think about consciously, but it lurks, unuttered in my exam-writing reptilian brain stem.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Mark<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">-- <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">* (dammit- it's "he" - no girls in my ITA classes since 2008!) <br>
<br>
--<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<p class="MsoNormal">On 29 November 2012 17:29, O'Grady, Liam A <<a href="mailto:o'grady.liam.a@edumail.vic.gov.au" target="_blank">o'grady.liam.a@edumail.vic.gov.au</a>> wrote:<o:p></o:p></p>
<div>
<div>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Hi Everyone,<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">What makes a good exam/test question for IT? Do you have any that you would be happy to share?<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Recently I was writing my yr 11 exams and trying to improve the questions I had that really give kids a chance to show their understanding of IT. The following questions arose in
this process:<o:p></o:p></p>
<p>1.<span style="font-size:7.0pt"> </span>How much should questions be about factual recall and how much about how to apply the knowledge?<o:p></o:p></p>
<p>2.<span style="font-size:7.0pt"> </span>What is a good question?<o:p></o:p></p>
<p>3.<span style="font-size:7.0pt"> </span>How could we write questions that are interesting enough that the kids want to answer them?<o:p></o:p></p>
<p>4.<span style="font-size:7.0pt"> </span>How can we write a good question and make it easy to mark? For example, the question below whilst having scope for more detailed answers could also be harder to mark fairly.<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">One question I came up with is below. This is NOT a model question – just my attempt to get the ball rolling.
<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"><b>Question 7</b><o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">St Mungo’s is a large hospital network with hospitals in all Australian capital cities. All computer servers run from a datacentre in the main hospital in Hobart. These servers
contain all the electronic information used by the hospital. This includes patient medical records, billing details, medical operations scheduling, staff details and the ordering system for medical supplies. All other branches connect to the datacentre via
a VPN connection through the Internet. <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">They are thinking about moving to Cloud Computing because it is very expensive running their own datacentre in terms of staff and hardware. A couple of times recently there have
been power failures in the datacentre which has meant that none of the hospitals could access the information needed to run.<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p style="margin-left:18.0pt;text-align:justify">a)<span style="font-size:7.0pt">
</span>What would you recommend that they do? Justify your recommendation. (4 Marks)<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto"> <o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Cheers<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Liam O’Grady<o:p></o:p></p>
<p class="MsoNormal" style="mso-margin-top-alt:auto;mso-margin-bottom-alt:auto">Brunswick Secondary College<o:p></o:p></p>
</div>
<p><b>Important - </b>This email and any attachments may be confidential. If received in error, please contact us and delete all copies. Before opening or using attachments check them for viruses and defects. Regardless of any loss, damage or consequence, whether
caused by the negligence of the sender or not, resulting directly or indirectly from the use of any attached files our liability is limited to resupplying any affected attachments. Any representations or opinions expressed are those of the individual sender,
and not necessarily those of the Department of Education and Early Childhood Development.<o:p></o:p></p>
</div>
<p class="MsoNormal"><br>
_______________________________________________<br>
<a href="http://www.edulists.com.au" target="_blank">http://www.edulists.com.au</a> - FAQ, resources, subscribe, unsubscribe<br>
IT Applications Mailing List kindly supported by<br>
<a href="http://www.vcaa.vic.edu.au/vce/studies/infotech/itapplications3-4.html" target="_blank">http://www.vcaa.vic.edu.au/vce/studies/infotech/itapplications3-4.html</a> - Victorian Curriculum and Assessment Authority <br><br>
<a href="http://www.vitta.org.au" target="_blank">http://www.vitta.org.au</a> - VITTA Victorian Information Technology Teachers Association Inc <br><br>
<a href="http://www.swinburne.edu.au/ict/schools" target="_blank">http://www.swinburne.edu.au/ict/schools</a> - Swinburne University<o:p></o:p></p>
</div>
<p class="MsoNormal"><br>
<br clear="all">
<o:p></o:p></p>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt">-- <br>
Mark Kelly - <a href="mailto:kel@mckinnonsc.vic.edu.au" target="_blank">kel@mckinnonsc.vic.edu.au</a><br>
Manager of ICT, Reporting, IT Learning Area<br>
McKinnon Secondary College, McKinnon Rd, McKinnon 3204, Victoria, Australia<br>
Phone: +613 8520 9085, Fax +613 9578 9253<br>
VCE IT Lecture Notes: <a href="http://vceit.com" target="_blank">http://vceit.com</a><br>
Moderator: <a href="http://edulists.com.au/itapps/index.htm" target="_blank">IT Applications Edulist</a><br>
--<br>
My personal best for the 100 metre sprint is 11.9 metres.<br>
<br>
<br>
<o:p></o:p></p>
</div>
</div>
<p></p><p><b>Important - </b>This email and any attachments may be confidential. If received in error, please contact us and delete all copies. Before opening or using attachments check them for viruses and defects. Regardless of any loss, damage or consequence, whether caused by the negligence of the sender or not, resulting directly or indirectly from the use of any attached files our liability is limited to resupplying any affected attachments. Any representations or opinions expressed are those of the individual sender, and not necessarily those of the Department of Education and Early Childhood Development.</p>
</body>
</html>