Hi Kevork - a very interesting topic.<br><br>For a range of reasons it is not common for a pure experimental model (treatment and control group etc) to be used in educational settings. Plus, for almost anything involving new technology and students there is a massive Hawthorne effect - in broad terms students (and teachers) feel appreciated because they have been given some new toy and some other students haven't, and this affects their responses. Much of the derived effects have to be obtained from data obtained in real classrooms (with all the extraneous variables that involves) by removing other variables statistically. It's messy.<br>
<br>On top of this there is another question that needs to be considered (in my view anyway). As well as investigating "does this approach work?" we also need to consider "does this approach produce better outcomes than spending the equivalent amount in some other way?" ie an opportunity cost approach.<br>
<br>The question is not as simple as it looks. For example, a school could invest $1 000 000 a year in ICT or instead hire about 17 MORE teachers. Which would produce the best outcome? Could you convince your school of this?<br>
<br>The really interesting part is when you look at one of the approaches used in some Chicago and Washington(DC) public schools, where a different way to use the money was tried. It was, simply, to pay money directly to <b>students </b>based on their educational performance, the so-called "pay for grades" scheme. Improve your results, get extra money - waste your time, get nothing. In some (but not all) settings this has worked remarkably well. See <a href="http://abcnews.go.com/GMA/Parenting/story?id=6371073&page=1">http://abcnews.go.com/GMA/Parenting/story?id=6371073&page=1</a> and <a href="http://abcnews.go.com/Business/story?id=5635010&page=1">http://abcnews.go.com/Business/story?id=5635010&page=1</a> and <a href="http://www.cps.edu/News/Press_releases/2008/Pages/09_11_2008_PR1.aspx">http://www.cps.edu/News/Press_releases/2008/Pages/09_11_2008_PR1.aspx</a><br>
<br>Despite our personal views on the ethics of paying students to achieve, if we are talking about a significant investment in something like ICT and claiming it is an efficient way to improve learning, we need to be able to argue why it is better than (say) a "pay for grades" scheme. At some stage decisions like this fall into the hands of beancounters and (to be fair to them) they want to invest money in the best way.<br>
<br>Your other questions re what actual learning takes place is also very worthwhile, and is the sort of thing that invites personal experiences from teachers to build an overall picture (rather than a traditional research model)<br>
<br><br>Thanks for raising these important areas of discussion,<br><br>Ken<br><br><div class="gmail_quote">On Wed, Sep 5, 2012 at 8:13 AM, Kevork Krozian <span dir="ltr"><<a href="mailto:kevork@edulists.com.au" target="_blank">kevork@edulists.com.au</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div link="blue" vlink="purple" lang="EN-AU"><div><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Hi Folks,<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"> Really interesting discussion. You make a great point Ziad.<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">The barometer I guess for many years has been John Hattie with his extensive work on “effect size” with 2 groups holding everything else as constant as possible except the one difference. <u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Quoting : </span><span style="font-size:10.0pt;font-family:"Verdana","sans-serif"">The most prominent meta-meta-analyst in education is probably <a href="http://www.education.auckland.ac.nz/uoa/home/about/staff/j.hattie" title="John Hattie's home page at the University of Auckland, New Zealand." target="_blank"><span style="font-family:"Times New Roman","serif"">John Hattie</span></a>, whose work draws on "a total of about 800 meta-analyses, which encompassed 52,637 studies, and provided 146,142 effect sizes [...] these studies are based on many millions of students" (Hattie, 2009; 15) - <a href="http://www.learningandteaching.info/teaching/what_works.htm" target="_blank">http://www.learningandteaching.info/teaching/what_works.htm</a> <u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif""><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Actually I recently compiled a long list of resources trying to separate digitization from eLearning</span><span style="font-size:10.0pt;font-family:"Verdana","sans-serif""> – see <a href="http://delicious.com/kkrozian" target="_blank">http://delicious.com/kkrozian</a> <u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif""><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">I would be interested to hear further about what learning actually takes place rather than what application is used. The paper mentioned by Trudy is really worthwhile and I recommend people have a look at it as it does try to balance all the views. <u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">I would also be very interested to hear from schools who have gone iPad 7 – 12 and how they have managed delivery of those studies that require more than what iPads have delivered to date such as VCE IT, media and existing web based flash based resources such as in LOTE, Maths, that have not been upgraded to date. <u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Are any schools using remote desktop from the student iPads to teach any of these classes ?<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Kind Regards<u></u><u></u></span></p><div class="im"><p class="MsoNormal"><span style="font-size:10.0pt;font-family:"Verdana","sans-serif""><br>
<br></span><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Kevork Krozian<u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">Edulists Creator Administrator<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><a href="http://www.edulists.com.au" target="_blank">www.edulists.com.au</a><u></u><u></u></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d">tel: 0419 356 034<u></u><u></u></span></p><p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1f497d"><u></u> <u></u></span></p>
</div><p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"" lang="EN-US">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"" lang="EN-US"> <a href="mailto:elearning-bounces@edulists.com.au" target="_blank">elearning-bounces@edulists.com.au</a> [mailto:<a href="mailto:elearning-bounces@edulists.com.au" target="_blank">elearning-bounces@edulists.com.au</a>] <b>On Behalf Of </b>Ziad Baroudi<br>
<b>Sent:</b> Tuesday, 4 September 2012 10:51 PM</span></p><div class="im"><br><b>To:</b> elearning Teachers' Mailing List<br><b>Subject:</b> Re: [elearning] Query on iPad research ....<u></u><u></u></div><p></p><p class="MsoNormal">
<u></u> <u></u></p><p class="MsoNormal">Many argue that validity in the sense used by scientists cannot exist in most areas of educational research. I once read something written by Seymour Papert in which he says that something such as "using a computer" is not a single variable we can study while keeping all else constant. The whole point of using a computer is that it changes everything. <u></u><u></u></p>
<div><div class="h5"><div><div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">Even when iPads have been around for a long time and meta-research is available on their "effect", we will be looking at an average "effective size" that brings together all kinds of different uses of the device. Two studies, one hugely successful and one hugely unsuccessful, may result in an average effect size that is close to zero. It would be more useful to look into the details of the successful study to see what practices we can adopt.<u></u><u></u></p>
<div><p class="MsoNormal"><u></u> <u></u></p></div><div><p class="MsoNormal">Sincerely,<u></u><u></u></p></div><div><p class="MsoNormal" style="margin-bottom:12.0pt">Ziad.<u></u><u></u></p><div><p class="MsoNormal">On 4 September 2012 21:33, Hutchison, Geoffrey G <<a href="mailto:hutchison.geoffrey.g@edumail.vic.gov.au" target="_blank">hutchison.geoffrey.g@edumail.vic.gov.au</a>> wrote:<u></u><u></u></p>
<p class="MsoNormal">Good luck Kevork on finding valid education research. Very little is valid<br>in the sense that double blind trials are almost non-existent and the use of<br>control groups rare.<br><br>Virtually all education research is anecdotal in terms of evidence, and thus<br>
invalid in terms of true research.<br><br>Geoff Hutchison,<br>McGuire College<u></u><u></u></p><div><p class="MsoNormal" style="margin-bottom:12.0pt"><br><br>On 4/09/12 6:24 PM, "Kevork Krozian" <<a href="mailto:kevork@edulists.com.au" target="_blank">kevork@edulists.com.au</a>> wrote:<u></u><u></u></p>
</div><div><div><p class="MsoNormal" style="margin-bottom:12.0pt">> Hi Folks,<br>><br>> If I may ask a very broad question, is anyone across recent research<br>> covering the impact of iPads and apps in learning<br>
> achievement/improvement at any level ( primary, secondary, tertiary ) ?<br>><br>> Specifically, I am wondering if there is a control group of any type such<br>> as alternate tablets, mobile devices, netbooks, MacBook Air, MacBook Pro<br>
> etc etc.<br>><br>> Additionally I am wondering if a baseline is used in the study such as "<br>> Both groups, control and iPad users entered the study at VELS level x. At<br>> the end of the study the control group was at y and the iPad users were at<br>
> z on the VELS or any other measurement used".<br>><br>> Generalized findings such as students showed improvement in confidence<br>> with the use of technology or could read better ( than what ? not having<br>
> any technology or having a laptop or working in labs ? ) will not be as<br>> useful IMHO.<br>><br>> It is a topic that has come up in discussion and I am looking for both<br>> research as well as anecdotal evidence from schools on the iPad journey if<br>
> I may please.<br>><br>> Kind Regards<br>> Kevork<br>><br>> _______________________________________________<br>> <a href="http://www.edulists.com.au" target="_blank">http://www.edulists.com.au</a> - FAQ, resources, subscribe, unsubscribe<br>
> eLearning Mailing List kindly supported by<br>> <a href="http://www.vcaa.vic.edu.au" target="_blank">http://www.vcaa.vic.edu.au</a> - Victorian Curriculum and Assessment Authority and<br>> <a href="http://www.vitta.org.au" target="_blank">http://www.vitta.org.au</a> - VITTA Victorian Information Technology Teachers<br>
> Association Inc<br><br><u></u><u></u></p></div></div><div><p class="MsoNormal" style="margin-bottom:12.0pt">I<br>
</p></div></div></div></div></div></div></div></div></div></blockquote></div><br>