Question 1
True or False? If program planners and staff members wish to claim success even when a target value is not achieved, then “making meaningful progress” must be quantified.
True
False
Question 2
Which of the following is the process by which the level of attainment by an exemplary program is used as a point of comparison to current level of achievement?
Benchmarking
Dashboarding
Lean Six Sigma
Balanced Scorecard
Question 3
Social desirability, or answering questions in a manner intended to make a favorable impression, is one of the most common forms of what type of bias?
Response bias
Selection bias
Interviewer bias
Reporting bias
Question 4
True or False? The increased awareness of the need to for interventions to be evidence-based has resulted in an increase in the number of meta-analyses and literature syntheses that provide a summary of the effectiveness of interventions for a specific health condition or problem.
True
False
Question 5
What type of samples are used with outcome documentation and outcome assessment designs?
Probability samples
Nonprobability samples
Systematic samples
Nested samples
Question 6
As epidemiologists have become more thoroughly integrated into health services research and actively involved in conducting program evaluations, _________ to examine the relationship between receiving health program interventions and health outcomes has grown.
experimental designs
interventional designs
observational designs
quasi-experimental designs
Question 7
What elements of dosage have the greatest relevance for ongoing monitoring and may vary from the objectives laid out in the plan because of either program or participant factors?
Frequency and strength
Duration and strength
Frequency and duration
Strength and administration credibility
Question 8
True or False? For programs at the direct services level of the public health pyramid, the intended population is also the intended audience and, ideally, the recipients.
True
False
Question 9
What type of analysis explicitly incorporates participants’ preferences for health outcomes?
Break-even analysis
Cost-utility analysis
Cost-benefit analysis
Cost-effectiveness analysis
Question 10
Procedures for dealing with ethical issues and IRB and HIPAA procedures must emanate from what level of the public health pyramid?
Direct services level
Enabling services level
Population services level
Infrastructure level
Question 11
Which of the following relates to how likely it is for the intervention to have a noticeable benefit to participants?
Clinical significance
Intended significance
Statistical significance
Theoretical significance
Question 12
Regression to the mean, which refers to the tendency for the scores of different groups to become more alike over time, is a threat to what study design?
One-group posttest only
Descriptive study
Comparison group posttest only
Two-group pretest/posttest
Question 13
Which of the following refers to the realistic potential for achieving the desired outcome when a treatment or intervention is used in real life?
Effort
Efficacy
Efficiency
Effectiveness
Question 14
What type of data use may be necessary if the evaluation question focuses on outcomes on which data exist from different sources?
Linked data
Primary data
Secondary data
Ordinal data
Question 15
What type of sampling can yield samples that represent the larger population in key attributes believed to affect program outcomes?
Convenience sampling
Quota sampling
Probability sampling
Purposive sampling
Question 16
True or False? A mandate to evaluate a program is usually linked in some way to the funding agencies, whether a governmental body or a foundation.
True
False
Question 17
The difficulty created by _________ is that, with a higher prevalence of the desired health behavior before the program, it becomes more challenging to increase the prevalence of the health behavior.
diffusion
collusion
outliers
manipulation
Question 18
At what level of the public health pyramid can it be difficult to monitor the implementation in a timely manner, which in turn makes it difficult to have a quality improvement process?
Direct services level
Enabling services level
Population services level
Infrastructure level
Question 19
What approach to continuous quality improvement integrates financial performance measures with measures of customer satisfaction, internal processes, and organizational learning?
Benchmarking
Dashboarding
Lean Six Sigma
Balanced Scorecard
Question 20
True or False? Expressed need is a lack, deficit, inadequacy, or excess as defined by experts and health professionals, usually based on a scientific notion of what ought to be or what the ideal is from a health perspective.
True
False
Question 21
True or False? Culture, in the context of health, refers to the numerous ways in which individuals and groups differ in their beliefs, behaviors, values, backgrounds, preferences, and biology.
True
False
Question 22
True or False? The organizational plan specifies how to reach the intended audience and deliver the programmatic interventions and services to that audience.
True
False
Question 23
Which of the following refers to the intentional and systematic distribution of protocol, findings, and recommendations in a manner that makes the information accessible to a specific audience?
Diffusion
Saturation
Dissemination
Implementation
Question 24
What type of variable, sometimes called an intervening variable, is necessary for the relationship between two other variables to exist?
Dependent variable
Antecedent variable
Moderating variable
Mediating variable
Question 25
Which of the following is an empirical inquiry into existing phenomena in their real-life contexts when the boundary between what is being studied and its context is not clearly evident?
Case study
Focus group
Photovoice
Narrative design
Question 26
Which of the following refers generally to the use of multiple methods for the purpose of confirming, disconfirming, or modifying information gained through one of the methods?
Manipulation
Stratification
Triangulation
Appropriation
Question 27
True or False: Existing fiscal resources are generally listed on the income side of a balance sheet or budget because they comprise funding and income generated through fees and billing.
True
False
Question 28
What type of analysis should be part of the basic budgeting process because it allows program managers to select the lowest reasonable expense for a category or to comparison-shop for expenses such as supplies and capital equipment?
Cost-effectiveness analysis
Cost-utility analysis
Cost-benefit analysis
Cost-minimization analysis
Question 29
Findings based on the data from what nonexperimental design can be misleading because the design has two major biases, or threats to the internal validity of the evaluation?
One-group posttest only
Ecological design
Comparison group posttest only
Two-group pretest/posttest
Question 30
True or False? TRACE objectives focus on the actions of participants or on the activities of the program staff members that do not directly cause the effect.
True
False
Question 31
The major advantage of a(n) _________ is that few biases are likely to affect seriously the ability to draw conclusions regarding the program effect, which makes it a very strong design to use with population-focused health programs.
retrospective case-control design
two-group prospective design
multiple-group time-series design
ecological design
Question 32
True or False? Programs that engage voluntarily in evaluations may have good intentions, but their staff often lack the skills and knowledge required to conduct an appropriate evaluation.
True
False
Question 33
The vast majority of health systems and plans already collect key indicators of care and service quality through which of the following performance measures for the Joint Commission?
Capacity Assessment for Title V (CAST-5)
Consumer Assessment of Health Plans (CAHPS)
Healthcare Effectiveness Data and Information Set (HEDIS)
National Public Health Performance Standards (NPHPS)
Question 34
The TRACE (Timeframe, Recipient, Amount of Change or other Effects) objectives that flowed from the effect theory have become the cornerstone of what type of evaluation?
Impact evaluation
Outcome evaluation
Outcome assessment evaluation
Outcome documentation evaluation
Question 35
Which of the following can dramatically influence the results of statistical tests by shifting the mean and increasing the variance?
Bias
Attrition
Outliers
Skip patterns
Question 36
The main technique for increasing what element of scientific rigor is to provide thick descriptions in reports so that others can assess independently the possibility of the findings being applicable to other groups?
Credibility
Transferability
Dependability
Confirmability
Question 37
During the program implementation, the overall budget variance should be no more than _________ of the projected budget for an expense category.
5–10%
10–20%
20–30%
30–40%
Question 38
Which of the following is carried out in part to meet the requirements of funding agencies, specifically to demonstrate the extent of program implementation?
Process monitoring
Implementation assessment
Implementation evaluation
Implementation documentation
Question 39
True or False? A root cause analysis includes a range of possible causes of a problem, and can take the place of a causal theory.
True
False
Question 40
Through _________, the extent to which decision drift has occurred can be assessed and the specific areas in which it occurred be pinpointed.
process evaluation
process monitoring
program monitoring
efficiency assessment
Question 41
What type of qualitative method for planning and evaluation would be useful to gather information from individuals with intellectual disabilities?
Case study
Focus group
Photovoice
Narrative design
Question 42
The major barrier to obtaining a _________ is that evaluators may not have control over who receives the program, especially as the outcome evaluation is not designed during program development.
convenience sample
quota sample
probability sample
purposive sample
Question 43
The vast majority of public health programs are predicated on what principle, making it an integral element of public policy making?
Autonomy
Criticality
Egalitarian
Utilitarian
Question 44
True or False? Applying the property, economics, acceptability, resources, and legality (PEARL) component to prioritizing health problems may not be possible until a substantial amount of information has been collected about the sociopolitical context of the health problem.
True
False
Question 45
Global concerns over the possibility of _________, the spread of diseases over a large portion or an entire population, and the need for greater disaster preparedness have led to the application of ethical principles to population-focused health planning.
outbreaks
endemics
pandemics
systemics
Question 46
Which of the following refers to the extent of which the data are free of errors or multiple indicators of a common phenomenon coincide?
Validity
Reliability
Sensitivity
Specificity
Question 47
True or False? The apolitical approach to planning is one of addressing immediate concerns and, to some extent, having faith that the small, rather disconnected plans and actions will have a cumulative effect on the problem.
True
False
Question 48
Establishing the _________ of a measure through advanced statistical analyses is more typically a research activity rather than an evaluation activity.
validity
reliability
sensitivity
specificity
Question 49
True or False? To ensure that a questionnaire is culturally and linguistically appropriate and understood requires that questionnaire be translated from the primary language into the second language and then translated back into the primary language.
True
False
Question 50
True or False? Externalities can be identified by conducting a so-called thought experiment in which one imagines possible programmatic effects on the intended audience as a whole, regardless of participation.
True
False