Process Evaluation of the UIU MPA Program Activity

Essay Instructions:

This assignment will be submitted to Turnitin™. Instructions REVIEW: Taylor-Powell (1998). Questionnaire Design: Asking Questions with a Purpose UIU MPA Program: Objective: Critically analyze research, including policy and program evaluation research Program Outcome: Develop in our students the ability to form critical judgments that support democratic values. Core Competency: To analyze, synthesize, think critically, solve problems and make decisions. Program managers have some concerns about the program described in assignment 2.1. Specifically, the managers are worried about demand for the program, whether the program will be effective, and if the program can advance social equity as understood by the National Academy of Public Administration. The managers would like you to create three survey questions (one each to measure demand, effectiveness, and equity) to include in a community survey. (Note: Balancing the Four Es; or Can We Achieve Equity for Social Equity in Public Administration? by Norman-Major posted in the unit 3 content area might provide additional context for the concepts of equity and effectiveness.) Be sure to utilize the guidelines in the Report: Questionnaire Report (available under course documents) in developing your questionnaire. Make sure to properly format the survey question--they should look ready to give to someone to survey--so appearance matters. There is no need to create instructions for the survey or provide the respondent with information about the survey. Your task is to create and properly format six survey questions. Your report should follow this format: Title Page: your name, date, and assignment name Background Information: Briefly describe the program activity (properly reference the appendix that includes the logic model). What is the desired output and outcome? How will the program activity help the organization achieve its mission? Section 1: Program Demand 1. Operational definition of program demand. 1A: Create an operational definition using the operational definition template from assignment 1.2. 1B. Explain why the operational definition is a valid (face validity) measure of program demand. 2. Survey question to measure Program Demand 2A. Provide the actual wording of a survey question that is consistent with operational definition 1A. 2B. What makes question 2A a reliable measure of program demand as defined in 1A? 3. Explain how each survey question: 3A. What is the response scale used in question 2A? 3B. What is the level of measurement for the response scale in 3A? 3C. Explain why the scale and level of measurement are appropriate given the purpose of the survey. 3D. How will question 2A help program managers better understand the gap between the current situation and the desired outcome? Section 2: Program Effectiveness 1. Operational definitions of program effectiveness. 1A: Create an operational definition using the operational definition template from assignment 1.2. 1B. Explain why the operational definition is a valid (face validity) measure of program effectiveness as properly understood based on the resources from Norman Major and the National Academy of Public Administration. 2. Survey question to measure Program Effectiveness 2A. Provide the actual wording of a survey question that is consistent with operational definition 1A. 2B. What makes question 2A a reliable measure of program effectiveness as defined in 1A? 3. Explain how each survey question: 3A. What is the response scale used in question 2A? 3B. What is the level of measurement for the response scale in 3A? 3C. Explain why the scale and level of measurement are appropriate given the purpose of the survey. 3D. How will question 2A help program managers better understand the gap between the current situation and the desired outcome? Section 3: Program Equity 1. Operational definitions of program equity. 1A: Create an operational definition using the operational definition template from assignment 1.2. 1B. Explain why the operational definition is a valid (face validity) measure of program effectiveness as properly understood based on the resources from Norman Major and the National Academy of Public Administration. 2. Survey question to measure Program Equity 2A. Provide the actual wording of a survey question that is consistent with operational definition 1A. 2B. What makes question 2A a reliable measure of program equity as defined in 1A? 3. Explain how each survey question: 3A. What is the response scale used in question 2A? 3B. What is the level of measurement for the response scale in 3A? 3C. Explain why the scale and level of measurement are appropriate given the purpose of the survey. 3D. How will question 2A help program managers better understand the gap between the current situation and the desired outcome? Appendix: Logic model from assignment 2.1 (Note: Reference the logic model when creating your explanations for 3D in each section.) Paper Format: Length: not to exceed four pages, single spaced (except between paragraphs - double space)

Essay Sample Content Preview:

A Report on the Process Evaluation of the UIU MPA Program Your name Subject and Section Professor’s Name Date Background Information The objective of the UIU MPA program, as demonstrated in the logic model (See Appendix), is to enhance public service efficiency through course-based scholarships and flexible learning that produces professional and ethical administrators. The outputs include specialized courses, PA 502 and PA 503, internship programs, and professional development activities. These ventures equip the students with practical skills that can aid them in securing jobs within the public service domain. This aspect aligns well with the university's mission of offering accessible, quality education to all individuals with the potential for success in improved lives (Upper Iowa University, 2023). Section 1: Program Demand 1. Program Demand 1A. Operational Definition of Program Demand Program demand within the UIU MPA program can be defined as follows: "It is the degree to which the prospective and current students demonstrate inclination to enrolling and engaging with the courses and activities of the UIU MPA program (Royse et al., 2015)." 1B. Face Validity of the Definition of Operational Definition of Program Demand This operational definition states what to measure (i.e., the successful enrollment and participation rates in certain classes and program activities) but needs details on how to do the measurement. To accomplish this, the time frame (i.e., per semester or academic year) and the metrics (e.g., number of enrollments in PA 502 and PA 503 or attendance at program events) must be included. Furthermore, it could define how these performance measures should perform or grow, that is, whether it should ideally retain or enhance the current rates or achieve specific key performance indicators set by the university. 2. Survey Questions to Measure Demand 2A. The Actual Survey Questions The two survey questions are: 1) What was your reason and/or motivation for considering or applying for the UIU MPA program? Kindly provide further details that might have specifically drawn you to the program. 2) In your own words, please indicate when and how you were informed about the UIU MPA program. This may be by using the internet, people who may tell others about the option, and academic advisors, among others. 2B. What makes question 2A a reliable measure of program demand as defined in 1A? Question 2A is a reliable indication of demand because the question tackles both the self-interest and social factors that may compel or incline potential and current students to consider the program. The question is constructed so that the respondents will provide concrete descriptions of the specific features or products of the program that prospective students are attracted to. Since respondents are invited to state their reasons for their response and specify which and why aspects of the program made them opt for it, evaluators will collect qualitative data that speaks to the perceived utility and the reasons for choosing the program; such data is essential for the evaluation of the program's demand as such information captures factors that influence enrollment and participation, which are foundational to operationalization of demand for the program. Additionally, the responses may show positive or emerging trends concerning the students' interests and preferences in the program. This may guide the program administrators to focus on and refine the specific areas of strength in the program's structural and content configuration that may likely enhance future program patronage. Moreover, it can be used to determine the extent of program demand since it accounts for deep and varied motives, not only those on the surface of intensity. 3. Explanation of Each Survey Question on Program Demand 3A. Response Scale Used Question 2A is a construct with an open-ended response scale, enabling the respondents to provide profound and individual motives for their interest in the UIU MPA program. 3B. Level of Measurement of the Response Scale This open-ended question's measurement type is nominal since it consists of various textual answers grouped into different categories without having a quantitative magnitude. 3C. Appropriateness of the Response Scale and Level of Measurement In the context of the UIU MPA program, program effectiveness can best be explained as the degree to which the program attains its stated objectives by measuring employment rates of graduates, completion rate, and overall success rate in public sector careers. Open-ended questions of nominal scale are appropriate because these allow for the collection of qualitative data on program choice that would not be covered by more limited fixed-response options, w...

Updated on September 4, 2024

Get the Whole Paper!

Not exactly what you need?

Do you need a custom essay? Order right now:

Order