You can join Peregrine here: https://evalpartners.community/peregrine. The negative impact of the pandemic on university staff and students has been recognised [2,3,4,5,6,51]. He lives in Minnesota, where, according to the state's poet laureate, Garrison Keillor, "all the women are strong, all the men are good-looking, and all the children are above . It helps stakeholders understand the strengths and weaknesses of a program. Matheson N.J., Warne B., Weekes M.P., Maxwell P.H. The included papers were published from 2014-2018. Saliva for COVID-19 testing: Simple but useless or an undervalued resource? The service was viewed to be broadly successful as a COVID-19 mitigation approach. Blake H., Knight H., Jia R., Corner J., Morling J.R., Denning C., Ball J.K., Bolton K., Figueredo G., Morris D.E. These are evaluations conducted with the aim of improving the program of interest. Researchers who conducted the interviews (IM, NM) and the researcher leading the data analysis (SS) had no prior relationship with any of the participants and were not involved in any aspect of service delivery. Qualitative (qual) data, consisting of observational findings that identify design features easy or hard to use Quantitative (quant) data, in form of one or more metrics (such as task completion rates or task times) that reflect whether the tasks were easy to perform Qual Research and N.M.; Formal analysis, S.S., I.M. (RQ3) What was the perceived impact of the ATS on the spread of COVID-19? Five reasons why evaluation can help out-of-school time program, The Historical Development of Program Evaluation: Exploring the Past and Present, Social-Emotional Learning and Evaluation in After-School Care: A Working Model. Journal of Youth Development. Qualitative methods that monitor progress are particularly important during the implementation phase of a project. Concurrently, the emergence of variant BA.2.75 resulted in a small number of cases identified in the UK in July 2022 [33]. is Academic lead and co-founder of the ATS. It involves the systematic collection and analysis of data about a specific program to determine whether it successfully achieve its intended objectives. . Itis a useful approach to document stories of impact and to develop an understanding of the factors that enhance or impede impact. Lecture Outline. A strengths-based approach to learning and improvement that involves intended evaluation users in identifying outliers those with exceptionally good outcomes - and understanding how they have achieved these. An Office of the Administration for Children & Families, Identifies advantages and challenges of qualitative approaches, Provides considerations for choosing a qualitative approach, Identifies common qualitative data collection methods and sampling techniques, Provides strategies to minimize bias in qualitative data analysis, Addresses the importance of reporting findings that are trustworthy. ; Writingreview and editing, S.S., I.M., N.M., J.C., J.K.B. Chang J.T., Crawford F.W., Kaplan E.H. Repeat SARS-CoV-2 testing models for residential college populations. Others have shown that regular surveillance testing, alongside other measures (e.g., isolation, contact tracing, quarantine) offers an effective means of identifying breakthrough infections, halting onward transmission, and reducing total caseload [22,53]. It plays a key role in the effectiveness of organisational responses to changing conditions [48], such as the COVID-19 pandemic. Decide who will conduct the evaluation, 5. Challenges to service implementation were the rapidly changing pandemic situation, delays in service accreditation and rollout to staff, ambivalence towards the virus, testing and isolating in the target population, and an inability to provide follow-up support for positive cases within the service. A Qualitative Evaluation of the Barriers and Enablers for Implementation of an Asymptomatic SARS-CoV-2 Testing Service at the University of Nottingham: A Multi-Site Higher Education Setting in England, GUID:C9854843-4138-4352-8C9E-DACEA90CFF6A. We used an interview topic guide, consisting of key open-ended questions and probes, to guide our interviews (Supplementary File S1). Although summative evaluations are often quantitative, they can be qualitative studies, too. These key people might include potential program participants, parents, and community leaders such as the . The interview guide was pilot tested and minor edits were made to improve flow and clarity. (RQ4) What lessons can we learn from ATS implementation to inform future pandemic responses in universities? Jones L.F., Batteux E., Bonfield S., Bhogal J.K., Taylor J., Caiado C., Ramagge J., Weston D. Durham University students experiences of asymptomatic COVID-19 testing: A qualitative study. There were some challenges experienced in engagement between ATS scientists and policy makers throughout the ATS accreditation and implementation, which led to delays and barriers to roll out and upscaling of the ATS novel testing approach. Int J Environ Res Public Health. Following government guidance, the ATS was unable to enforce isolation for those testing positive for COVID-19 and that this in turn created challenges in containing virus outbreaks. An impact evaluation approach based on contribution analysis, with the addition of processes for expert review and community review of evidence and conclusions. Fieldwork Strategies and Observation Methods, 8. While qualitative research is sometimes viewed as a less rigorous add-on to quantitative research, studies utilizing qualitative research methodswhether part of a mixed-methods or as a standalone approachcan be rigorously designed to provide reliable and trustworthy information. A key facilitator to the success of the service was a positive, inclusive leadership team, who were perceived to be approachable and: created a very special atmosphere where it is 100% two-way communication. (Respondent 5). The main methods for collecting data for qualitative program evaluation are: Document analysis - Data collection in qualitative research program evaluation starts with collecting and reviewing documents about the program. Interview length varied from 24 to 80 min (mean: 44 min). Enhancing the Quality and Credibility of Qualitative Analysis. Simple incentives, such as free food or drink for those who were tested, was seen to encourage testing uptake in students. Challenges to service implementation were the rapidly changing pandemic situation and government advice, delays in service accreditation and rollout to staff, ambivalence towards testing and isolating in the target population, and an inability to provide follow-up support for positive cases within the service. Barry G., McCarney C., Farrelly M., Breathnach R., Mooney C., More S.J. The discussion of themes 13 maps to RQ13. Some studies have investigated students views towards the service, or established testing acceptability among service users [27,28,29]. It can be used to gather in-depth insights into a problem or generate new ideas for research. Omicron BA.4 and Omicron BA.5 were declared Variants of Concern in May 2022 and Omicron BA.5 became more prevalent, and subsequently, the dominant SARS-CoV-2 variant by August 2022. and N.M.; Funding acquisition, H.B., J.C., J.K.B. Values coding deals with labeling the values, attitudes and belief systems that are expressed by participants. Evaluative research allows you to test a solution and collect valuable feedback that can help you refine and improve the user experience. It was perceived that, prior to the pandemic, the organisation was incredibly risk averse, with organisational bureaucracy and institutional barriers which hindered or prevented action or decision-making. Holly Blake, Sarah Somerset, [], and Chris Denning. The aim of the current study is to explore the views of service personnel towards the implementation of a SARS-CoV-2 testing service over a sustained period during a pandemic. Findings from evaluative research are key to assessing what works and what doesn't and identifying areas of improvement. (RQ2) What are the barriers and enablers of service implementation? THE BOOK SUGGESTS THAT A PARADIGM OF CHOICES IS REPLACING THE DEBATE AND COMPETITION BETWEEN THE QUALITATIVE AND QUANTITATIVE MEASUREMENT PARADIGMS AND THAT TODAY'S EVALUATOR MUST MATCH RESEARCH METHODS TO PARTICULAR QUESTIONS AND TO DECISIONMAKERS' . If quantitative surveys get results based on numbers and computation, qualitative surveys ask for comments, feedback, suggestions, and other kinds of responses. An approach designed to support ongoing learning and adaptation, which identifies the processes required to achieve desired results, and then observes whether those processes take place, and how. Qualitative evaluation provides you with the ability to gain an in-depth understanding of a program or process. The Action Catalogue is an online decision support tool that is intended to enable researchers, policy-makers and others wanting to conduct inclusive research, to find the method best suited for their specific project needs.. Chapter 6: Research Methods in the "Introduction to Community Psychology" describes the ecological lens in community research, the role of ethics, the . we always saw an uptake in the number of students who were testing when, when it was incentivised., its a great window into human psyche that offering a relatively small treat as it were, gave people a positive reason to, uh, to, to want to donate a, a saliva sample rather than just being told that they had to. Watson D., Baralle N.L., Alagil J., Anil K., Ciccognani S., Dewar-Haggart R., Fearn S., Groot J., Knowles K., Meagher C. How do we engage people in testing for COVID-19? This was a qualitative study using semi-structured interviews [31,32] with university employees involved in the delivery of the University of Nottingham ATS. In conclusion, we identified common themes that have facilitated or hindered the implementation of a SARS-CoV-2 testing service at a university in England. University social responsibility and empathy in organizations during COVID-19 pandemic in Brazil. Qualitative evaluation focuses on understanding the least objective part of a process or experience. There was a sense that the availability of the testing helped people to feel safe, particularly those who were at increased risk from COVID-19, or those with vulnerable family members. I was pushing in those early days that we had opened up the testing service much more quickly to, to staff members better integration of, of the students and the staff early on, and then expanding it out more rapidly to the, the family members.. Blueprint for a pop-up SARS-CoV-2 testing lab. The sample was identified and recruited through the service administrator. In Minney, Garcia, Altobelli, Perez-Brena, and Blunks paper on social-emotional learning and evaluation in after-school care, the researchers evaluated the effectiveness of an after-school program that incorporated social-emotional learning (SEL) into its curriculum. However, the rapidly changing government guidance led to some confusion among staff and students around when, and how, people should test. A small number of participants felt that there was a missed opportunity to roll the ATS out at a national level. SS generated initial codes which were refined and added to as interviews were revisited over time. The data are not publicly available due to their containing information that could compromise the privacy of research participants. Good evening. (Patton, 2001), 2. I'll be dead before . Focus the qualitative evaluation report. The operation of a SARS-CoV-2 testing service was seen to protect the university population and extend wider societal benefit through provision of testing support for partner organisations to achieve mutually beneficial goals associated with containing the spread of COVID-19 (e.g., working in partnership with, and supporting the NHS, local government, Public Health Englandwe are all in it together). A modeling study to inform screening and testing interventions for the control of SARS-CoV-2 on university campuses. There was higher testing frequency observed among students registered for healthcare degrees, and this was associated with the requirements of their course of study (i.e., testing being a requirement to attend placements): students who were on placements so, especially medics and nursing, midwifery, those students tested regularly with us as did the vets. (Respondent, 15). COVID-19 is a major global public health burden, associated with high morbidity and mortality [1]. Routine, Cost-Effective SARS-CoV-2 Surveillance Testing Using Pooled Saliva Limits Viral Spread on a Residential College Campus. Interviews were conducted online, audio-recorded, and transcribed. Qualitative Evaluation Checklist Michael Quinn Patton Adams W.C. Anecdotal evidence These records preserve descriptions of noteworthy events or student efforts. Informed verbal and written consent was obtained from all participants involved in the study. Analyzing Your Qualitative Evaluation Results Webinar A research design that focuses on understanding a unit (person, site or project) in its context, which can use a combination of qualitative and quantitative data. Internationally, regular testing regimens have been shown to be cost-effective, reduce infection rates and increase confidence in safety among staff and students in other educational settings (i.e., kindergarten to 12th grade (K-12) schools in the United States) [9,10]. ACF has partnered with JBA to conduct the DOHVE project. Brook C.E., Northrup G.R., Ehrenberg A.J., Doudna J.A., Boots M., Consortium I.S.-C.-T. Optimizing COVID-19 control with asymptomatic surveillance testing in a university environment. Hu W., Zhang S., Liu S. Red Tape and Community Workers Proactive Behavior During COVID-19: Applying the Job DemandsResources Model. is behavioural advisor to the ATS. Carter N., Bryant-Lukosius D., DiCenso A., Blythe J., Neville A.J. File S1: Interview topic guide; File S2: Participant characteristics. We are not currently aware of any instructor resources for this text. This is part of our Essential Guide To Qualitative Coding | Start a Free Trial of Delve | Take Our Free Online Qualitative Data Analysis Course.