<HTML>
<HEAD>
<TITLE>Re: [Year 12 IT Apps] When to establish evaluation criteria?</TITLE>
</HEAD>
<BODY>
<FONT FACE="Calibri, Verdana, Helvetica, Arial"><SPAN STYLE='font-size:11pt'>However <BR>
Who does evaluation? The users – the client – the workers. Not the designer, not the coder, not the analyst, etc. <BR>
<BR>
Criteria are all about : does it do what was identified as needing doing? Does it fix the identified problem? / needs? /wants? /desires (written and contracted)? /whatever it was that got the analyst in there in the first place?<BR>
<BR>
you must set the evaluation criteria before you start the design otherwise you will only evaluate the solution you create/design – you might not be evaluating a solution to the problem that you identified in the analysis. <BR>
<BR>
We often tend to create test data that tests what we have designed, not necessarily test key decision points- we have all (I am sure) left out key decisions (in our design) because we worked on the design without referencing the analysis often enough and because our test data and our evaluation criteria were created after the solution and so only tested/evaluated the solution that we made - ---<BR>
<BR>
So, simply put, in reality, we create our evaluation criteria, our test data, and our client acceptance criteria before we start designing so that we do not waste time in the design phase working on things that do not fit with the analysis stage. All design works towards satisfying the tests/evaluation/acceptance. At every step.<BR>
<BR>
If the analysis stage does not identify what constitutes a solution for the client then analyse properly. There is no point in doing anything if you do not understand what the client wants – unless of course you work for free or you are an artist (see Blue Poles as a good example – would that work as a solution in a client focussed environment?).<BR>
I do NOT work for free when creating things for clients. I also do not allow for wastage that is avoidable so do not quote above the needs identified in the analysis; thus I ensure that I identify what they want.<BR>
<BR>
Andrew --<BR>
It must be bedtime so off my hobby horse. Good night<BR>
<BR>
-- <BR>
-- <BR>
</SPAN></FONT><FONT SIZE="4"><FONT FACE="Apple Casual"><SPAN STYLE='font-size:14pt'>Andrew Shortell<BR>
</SPAN></FONT></FONT><FONT FACE="Calibri, Verdana, Helvetica, Arial"><SPAN STYLE='font-size:11pt'><BR>
<a href="mailto:shortell@get2me.net">mailto:shortell@get2me.net</a> <BR>
Heidelberg Teaching Unit<BR>
Ph 9470 3403<BR>
Fax 9470 3215<BR>
<BR>
<BR>
<BR>
<BR>
On 12/09/11 8:27 PM, "Branson, Steven S" <<a href="branson.steven.s@edumail.vic.gov.au">branson.steven.s@edumail.vic.gov.au</a>> wrote:<BR>
<BR>
</SPAN></FONT><BLOCKQUOTE><FONT FACE="Calibri, Verdana, Helvetica, Arial"><SPAN STYLE='font-size:11pt'>I assume “criteria” means criteria for evaluation- not worded well. My thought is that analysis is all about gaining an understanding of the problem and what the client wants. You will have these in the back of your mind, during the analysis process. These will cover what you hope to produce and hence possible criteria, but they will be broad. However until you start designing the solution you can’t develop a full set of criteria that is detailed enough to evaluate the solution.<BR>
<BR>
<BR>
Steven Branson<BR>
<BR>
<BR>
<BR>
<BR>
</SPAN><FONT SIZE="2"><SPAN STYLE='font-size:10pt'><B>From:</B> <a href="itapps-bounces@edulists.com.au">itapps-bounces@edulists.com.au</a> [<a href="mailto:itapps-bounces@edulists.com.au">mailto:itapps-bounces@edulists.com.au</a>] <B>On Behalf Of </B>Mark KELLY<BR>
<B>Sent:</B> Monday, 12 September 2011 8:48 AM<BR>
<B>To:</B> Year 12 IT Applications Teachers' Mailing List<BR>
<B>Subject:</B> [Year 12 IT Apps] When to establish evaluation criteria?<BR>
</SPAN></FONT></FONT><FONT FACE="Times New Roman"><SPAN STYLE='font-size:12pt'> <BR>
Hi all. I'm checking a commercial exam I bought... I'm doubtful about its answer to one question<BR>
<BR>
At which stage should criteria should be established?<BR>
A. Analysis?<BR>
B. Design?<BR>
C. Development?<BR>
D. Evaluation?<BR>
<BR>
The suggested answer is B, but should they not be developed in conjunction with functional requirements during analysis?<BR>
</SPAN></FONT></BLOCKQUOTE><FONT FACE="Times New Roman"><SPAN STYLE='font-size:12pt'><BR>
</SPAN></FONT>
</BODY>
</HTML>