Systematic Outcomes Analysis identifies a number of possible overall monitoring and evaluation schemes. These identify what type of monitoring and evaluation is being done for any piloting phase and what is being done for the full roll-out of the intervention. In particular, if there is a pilot phase, the relationship between the monitoring and evaluation approach for this and for the full roll-out needs to be determined.
The overall monitoring and evaluation scheme used in a particular case can use various combinations of the Systematic Outcomes Analysis building-blocks. Obviously, if parts of earlier building blocks are not appropriate, feasible or affordable then this will limit the possibilities for overall monitoring and evaluation scheme which can be used. The prerequisites for these schemes are set out in the Prerequisites building blocks 5-8 diagram here. It is important that all stakeholders understand which overall monitoring and evaluation scheme is being used. Two typical overall monitoring and evaluation schemes are:
Scheme 1: Full roll-out outcome evaluation plus some non-outcome evaluation
Full roll-out Evaluation[outcome] plus some or all of Outcomes model, Indicators[nn-att], Indicators[att], Evaluation[n-outcome], Evaluation[economic & comparative].
Scheme 2: Pilot outcome evaluation plus additional evaluation AND only additional evaluation on full-roll out
Pilot evaluation Evaluation[outcome] plus some or all of Outcomes model, Indicators[nn-att], Indicators[att], Evaluation[n-outcome], Evaluation[economic & comparative] AND full roll-out limited to some or all of Outcomes model, Indicator[nn-att], Indicator[att], Evaluation[n-outcome], Evaluation[economic & comparative].
Scheme 2, which does not attempt outcome evaluation on full roll-out is used in numerous situations where it is inappropriate, not feasible or too expensive to do outcome evaluation - for instance most of individual medical treatment uses this approach. Attributable indicators are monitored (e.g. patient attendance and sometimes treatment compliance) but no attempt is made to actually establish that any improvement in the patient can actually be attributed to the treatment (as opposed to other factors like placebo or time).
[V1.1.2]