-what kinds of data an evaluator may gather? -what kind of analyses he or she may conduct? -what kind of conclusions he or she may arrive?

What kinds of data an evaluator may gather?

If I where to simply answer this, I would guess anything with qualitative and quantitative findings. Something that has measurable criteria and defensible metrics. I'm sure this could be defined more specifically though.

What kind of conclusions he or she may arrive?

Defensible conclusions, which requires criteria that may be definitive. Basically any conclusion specific to a question or purpose required by stakeholders but not too broad to be defined as research.

Hoping someone else jumps in here. I'm basing this off the reading mostly and trying to avoid things I think are research since we've already concluded those are very different things.

Why are these terms important in evaluation? And what distinguishes them from each other?

It's all about terminology. Why are these terms important in evaluation? And what distinguishes them from each other?

a) Needs Assessment
b) Monitoring
c) Outcome Studies
d) Testing
e) Measurement
f) Assessment

The terms assessment, monitoring, outcome studies, testing, measurement, and assessment all define methods to measure criteria.

Defining criteria is a key component of any evaluation. The measurements and methods used to develop an evaluation closely relate to research. Research and evaluation methodology may also differ in critical ways like how an evaluator or researcher determines if their outcome is successful, who determines criteria, and which criteria are targeted. 

The definitions of terms may also be critical to an evaluation. Evaluations results must include defensible outcomes. Therefor, the stakeholders must be able to agree to the definitions of terms. If a term can be defined in multiple ways, it may be advisable to identify which definition the evaluator(s) would like to use and have a solid understanding of what connotations those terms may have.

According to Rutgers, term a is defined as, "The first step in developing an Extension program is conducting a needs assessment. This systematic approach seeks information from clientele or secondary sources as to a gap or need – a societal, personal, economic, or environmental issue, for instance, that must be addressed and that requires some planned actions to have a positive impact on improving or changing the identified situation. The following resources provide information on conducting needs assessments."

I would be interested to see other sources for these methods from classmates and feedback on their definitions.

• Rutgers, New Jersey Agricultural Experiment Station (Ed.) (2016). Conducting Needs Assessments: Program Evaluation Resources.http://njaes.rutgers.edu/evaluation/resources/needs-assessment.asp

Unique Domains of Knowledge and Skills for Evaluators

Author: Suhan Yao Date: Monday, February 1, 2016 3:24:15 PM CST Subject: Question # 1_Matheson_Skills for Evaluators

Unique Domains of Knowledge and Skills for Evaluators

In the Matheson article, it is suggested the evaluators must know “how to search for unintended and side effects, how to determine values within different points of view, how to deal with controversial issues and values, and how to synthesize facts and values”. (p 186)

How is it possible to develop these skills? (You can talk about all of the skills or choose one or more)

In my response, I will discuss contradictory statements by Mathison. Quote  Scriven, who originally was interviewed for the referenced article in question, and answer the questions:

• Which methods would not be good for evaluating unintended side effects
• How to determine values within different points of view
• How to synthesize facts and values

Stakeholders' Perspectives

“A distinguishing feature of evaluation is the universal focus on stakeholder perspectives, ......,and evaluation are judged on if and how stakeholder perspectives are included” (Matheson, 2008).

So how to engage stakeholders and include the stakeholder perspectives during the evaluation process? (You can share your own experiences/stories or talk about the approaches you have heard of/read)

Page 194 of Mathison (2007), "A distinguishing feature of evaluation is the universal focus on stakeholder perspectives, a feature not shared by social science research. And evaluations are judged on if and how stakeholder perspectives are included. While evaluation models are based on different epistemological foundations, all evaluation models attend to stakeholder perspectives-the assessments, values, and meanings of the evaluand's stakeholders are essential elements in any evaluation." .... "When research participants are referred to as stakeholders, it is often a reference to whom the data are collected from rather than a consideration of the stakeholder's vested interests. "

What kinds of data an evaluator may gather?

What kinds of data an evaluator may gather?

If I where to simply answer this, I would guess anything with qualitative and quantitative findings. Something that has measurable criteria and defensible metrics. I'm sure this could be defined more specifically though.

What kind of conclusions he or she may arrive?

Defensible conclusions, which requires criteria that may be definitive. Basically any conclusion specific to a question or purpose required by stakeholders but not too broad to be defined as research.

Hoping someone else jumps in here. I'm basing this off the reading mostly and trying to avoid things I think are research since we've already concluded those are very different things.