Examining Qualitative and Quantitative studies with CASP (2023)

Share this:

FacebookFacebook logoTwitterTwitter logoRedditReddit logoLinkedInLinkedIn logoWhatsAppWhatsApp logo

Critical Appraisal Skills Programme/CASP (Public Health Resource Unit, 2007) a reader should equip with in order to make sense of scientific research. The CASP is to help a reader develops critical skills so as to be sensitive of scientific research and, therefore, to think reasonably about any research encountered (Public Health Resource Unit, 2007). Both quantitative and qualitative researches can be appraised by using the CASP. Each of the CASP guidelines has ten questions in which validity, relevance and results of appraised research have been covered. This assignment has been divided into two parts. The first part quantitative paper written by Ho et al, (2006) will be appraised. The second part qualitative paper written by Liu and Liehr (2009) will then be appraised. All findings will be summarized finally.

Get Help With Your Essay

(Video) Critical Appraisal Tools: CASP for Qualitative Studies-Part 1

If you need assistance with writing your essay, our professional essay writing service is here to help!

Essay Writing Service

1. Did the study ask a clearly focused question?

PICOT is used for answering the question 1 and it is a framework that healthcare professionals can use to formulate effective clinical questions in a step-by-step manner (Melnyk & Fineout-Overholt, 2010). The population of the study was all the subjects should have one tattoo at least. 120 Chinese subjects with 144 tattoos were recruited for the study. The intervention of the study was half of the subjects were applied Contractubex gel while others were applied nothing. The purpose to do so was to check the efficacy of the gel. The comparison of the study was study and control groups are used for comparison as a result of finding out the efficacy of Contractubex gel. The outcome of the study was the gel should be effective in preventing scarring after the subjects receiving laser removal of tattoos. The research has shown that the number of subjects in Contractubex group with scarring were significantly lower than in control group. The time of the study was the treated areas were assessed 3 months after the last treatments. In short, the research has asked a clearly focused question- Use of onion extract, heparin, allantoin gel in prevention of scarring in Chinese patients having laser removal of tattoos: a prospective randomized controlled trial. So the answer is “Yes”.

2. Was this a randomized controlled trial (RCT) and was it appropriately so?

A type of scientific experiment most commonly used in validating the effectiveness of health issue, say, pharmaceuticals (e.g. gel), can be regarded as RCT (Gallin & Ognibene, 2007). It involves the random allocation of different interventions to the subjects. Furthermore, as long as the numbers of subjects are adequate, randomization is an effective method to produce a random and unpredictable sequence of allocations. Regarding to the Ho et al (2006) research, they must adopt RCT. Two evidences can be shown to support my stance. First, it was testing the efficacy of Contractubex gel intervention (health issue) provided by doctors to subjects with tattoo. Second, the 120 subjects were randomly assigned to either Contractubex or Control group at equal probabilities. In suitability, it was the right research approach for the researched question because it was going to compare result after receiving Contractubex gel with a control group. In short, RCT is the appropriate method and correct approach to conduct this research, as there were two groups that were allocated randomly, the study group received intervention and the control group did not receive intervention and the answer is “Yes”.

3. Were participants appropriately allocated to intervention and control groups?

The answer is “Yes”. Answer of question 2 has mentioned that the 120 subjects were allocated into the two groups randomly. In research term, complete randomization has been adopted. Complete randomization means each tattooed subject was randomly assigned to either of the groups. It is simple and optimal in the sense of validity to prevent accidental bias (Gallin & Ognibene, 2007). In randomization procedure, the researchers adopted fifty-fifty basis allocation (60 subjects in Contractubex group and 60 subjects in Control group). In this research stratification can be observed. Stratification means developing strata for sampling (Gallin & Ognibene, 2007). 60 subjects in control group and 60 subjects in study group is a typical example of stratification. The purpose to do so is that since most statistical tests, say, the paired student’s t test are most reliable when the groups being compared have equal subjects (Gallin & Ognibene, 2007), it is desirable for the randomization procedure to generate similarly-sized groups. In short, as all participants were assigned to Contractubex and Control groups appropriately.

4. Were participants, staff and study personnel ‘blind’ to participants’ study group?

The above parties understood the details of the research. Ho et al (2006) paper mentioned that “informed consent” was obtained from all subjects. “Informed consent” is a process of communication between a subject and doctor that results in the subject’s authorization or agreement to undergo a specific medical intervention (Berg et al, 2001). On the one hand, blinded research can avoid bias. However, it is impossible for some treatments. For example, treatments where active participation of the subjects are necessary (e.g. regularly receiving laser therapy with the application of the gel). In research personnel, certainly they understood the details of the research, for instance, employing Q-switched laser systems as well as its spot size and repeat rate and pulse duration. They were unable to perform the research successfully otherwise. Nonetheless, whether the control group received placebo gel and the assessor of the scars knew the research details or not did not mention. In brief, open trial (the above parties understood the details of the treatment) instead of blind trial was employed and the answer seems “No”.

5. Were all of the participants who entered the trial accounted for at its conclusion?

Originally, there were 60 subjects in the control group and 60 subjects in the study group. However, there were 8 out of 60 subjects in the study group quitted the research. 5 out of 8 simply defaulted follow-up and 3 out of 8 stopped using the gel due to adverse effect. In the control group, there were 5 out of 60 subjects quitted the research. 4 out of 8 simply did not follow-up and 1 out of 8 stopped using the gel due to have a baby. Although, there were a few subjects quitting from the research due to personal affairs, the groups’ size still remained similar (52 in Contractubex and 55 in Control groups) and the researchers have already reported such discrepancy. In other words, intention to treat was used as it is a strategy for the analysis of RCT that compares subjects in the groups to which they were originally randomly assigned (Gallin & Ognibene, 2007) and the answer is “Yes”.

(Video) Quantitative vs. Qualitative Research: The Differences Explained | Scribbr 🎓

6. Were the participants in all groups followed up and data collected in the same way?

In the former, the subjects were followed up from 13 to 20 months with a mean of 15.5 + 2.6 months. The importance of the follow up was to review the probability of scar formation after applying the gel. Likely, the research personnel followed up the subjects after the last laser treatment. However, the same amount of attention to the subjects from the research personnel becomes questionable because the researchers did not describe how to review the subjects. More elaborately, how much time the researchers spend on each subject for review? In addition, performance bias may occur. For instance, if research personnel know which group subjects are in, they may treat subjects differently (Gallin & Ognibene, 2007). In this aspect, “can’t tell” seems appropriate. In the latter, “Yes” in terms of data collection in the same way, the researchers should collect the data during clinical observation. Clinical observation is the research personnel directly observe any changes during the study period and then record the changes. Data analysis can be done by using statistical software (e.g. SAS). In short, the answers were “Yes” in the way of data collection only. The amount of attention to the subjects needs the research personnel further clarification otherwise performance bias may be suspected.

7. Did the study have enough participants to minimize the play of chance?

The meaning of the play of chance can be explained by the following example, taking a comparison of the Contractubex group with the control group in which 4 subjects scar formation with the Contractubex group and 6 subjects scar formation with the control group. It would be incorrect to conclude that the Contractubex group was better than the Control group. It is because if the comparison was repeated, the numbers of subjects who formed scar might be same (5 against 5). However, 7 subjects scar formation with the gel and 16 subjects without the gel, chance becomes a less likely explanation for the difference. In Ho et al (2006) study, numbers of subjects were enough to lessen the play of chance. Sample size can be determined by a formula by inputting population size and confidence level as well as margin of error and response distribution. On the one hand, significant difference between the two groups was observed. Power calculation can facilitate the research personnel determines how large of a sample the research personnel needs to make precise statistical conclusions (Gallin & Ognibene, 2007). Therefore, statistical significance was the robust evidence to prove the play of chance impossible.

8. How are the results presented and what is the main result and

9. How precise are these results?

Comparison of the intervention and control groups using the p-value has been presented. The main finding was that the application of the gel was useful to prevent scar formation after laser removal of tattoos. In accuracy of the results, p-value <.05 can be regarded as statistically significant that scar removal with the application of the gel was not by chance. The results can be considered to be quite precise.

10. Were all important outcomes considered so the results can be applied?

The research proved that the gel was effective, safe, and easy to apply in the prevention of scarring in Chinese subjects having laser removal of tattoos. Nonetheless, 100% scar removal is not guaranteed after using the gel. The results revealed that there were a few subjects who still have scarring. In addition, permanent hypopigmentation and transient hyperpigmentation can be noted. On the other hand, you may argue that the results may be affected by a political factor, that is a pressure from the pharmaceutical company, Ho et al (2006) have indicated that no significant interest with commercial supporters at the beginning of the research. In short, the research provides a reliable reference to healthcare professionals that the gel is recommended to be used in dark skin patients receiving laser treatments of tattoos.

Ten questions have been answered to help me make sense of quantitative research. Also, ten questions are used to help me make sense of qualitative research. Qualitative research is a generic term for investigative methodologies described as ethnographic, naturalistic, field, or participant observer research. It underscores the importance of looking at variables in the natural setting in which they are found (Sliverman, 2004).

1. Was there a clear statement of the aims of the research?

Qualitative PICOT is a framework that healthcare professionals can use to formulate effective clinical questions in a step-by-step manner (Melnyk & Fineout-Overholt, 2010).The population of the study was the six nurses who had experiences in taking care of SARS patients. The issue of the study was identifying instructive messages to guide nursing practice in future epidemics by in-depth interview of the six Chinese nurses who cared for SARS patients. The context of the study was where the study takes place. The research mainly takes place in Beijing. The outcome of the study was the research gave specific direction to enhance potential for a well-prepared nursing workforce in future epidemics. The time of the study was the SARS outbreaks between 11/2002-5/2004 and data were collected in 2003 within the three months following the nurses’ quarantine necessitated by caring for SARS patients.. In brief, the answer is “Yes”.

2. Is a qualitative methodology appropriate?

Qualitative research is to study things in their natural settings, attempting to make sense of, or to interpret, phenomena in terms of the meanings people bring to them. It is intended to penetrate to the deeper significance that the subject of the research ascribes to the topic being researched (Denzin, 2005). Interviews, observations and case studies are commonly used for data collection and then analyse the data. Samples are usually small and are often selected purposively. Qualitative research uses detailed descriptions from the participants as ways of examining specific issues under study. The research method employed by the researchers was appropriate because the following criteria were matched- detailed description instead of statistical software were used and number of participants was quite small- only six. In addition, the researchers adopted phenomenology. The phenomenological approach is to describe accurately a person’s ‘lived’ experience in relation to what is being studied (i.e. the six Chinese nurses caring for SARS patients) (Denzin & Lincoln, 2005). In short, the answer is “Yes”.

(Video) Critical Appraisal with CASP Part 1

Find Out How UKEssays.com Can Help You!

Our academic experts are ready and waiting to assist with any writing project you may have. From simple essay plans, through to full dissertations, you can guarantee we have a service perfectly matched to your needs.

View our services

3. Was the research design appropriate to address the aims of the research?

Appropriate method (i.e. in-depth interview) for conducting the research was used. In-depth interview is a kind of qualitative research technique that involves conducting intensive individual interviews (i.e. the six nurses) with a small number of respondents to explore their views on a particular idea (i.e. sharing in caring SARS patients). In the study, the researchers asked participants about their experiences and insights regarding to the caring for SARS patients, the thoughts they have concerning nursing care, challenge, and outcomes as well as about any changes the participants perceive in themselves as a result of their involvement in the study (Denzin & Lincoln, 2005). In addition, rich contextual information can be obtained and the research personnel can ask the six nurses to elaborate their sharing in details through the in-depth interview. So the answer is “Yes”

4. Was the recruitment strategy appropriate to the aims of the research?

Six nurses were invited to share their experiences in caring for SARS patients. The six nurses were no objections and voluntary to share their encounter after enquired by research personnel. In other words, a reader should not suspect their willingness of participation. The recruitment strategy was appropriate, because if reward-based (e.g. bonus to interviewees) and compulsory-based recruitment were offered to potential interviewees, the accuracy and reliability of data should be suspected. To achieve the aims of the research, nurses were voluntary to share their stories and they provided detailed descriptions with little prompting were important to the aims of the research. In other words, it starts with a purpose in mind and the sample is selected to include interested party (i.e. nurses with experience in caring of SARS patients) and exclude those who do not suit the purpose and purposive sampling was used (Denzin & Lincoln, 2005). So the answer is “Yes”.

(Video) Critical Appraisal Skills Programme CASP

5. Were the data collected in a way that addressed the research issue?

To collect data, a storypath approach was used. Research personnel recorded what the six nurses presented by a tape recorder. Seven inquiry phases were associated with storypath approach, including gathering the story, reconstructing the story, connecting it to the literature, naming the complicating challenge, describing the story plot, identifying movement toward resolving, and gathering additional stories (Denzin & Lincoln, 2005). In application, specific questions were asked by the research personnel, for instance, challenge the nurses were facing during caring for SARS victims, how the experience influence your hopes and dreams in the coming future. The data collection methods must observe the ethical principles of research. In short, the answer is “Yes”.

6. Has the relationship between researcher and participants been adequately considered?

This research paper mentioned that the stories of the six nurses were collected by two Chinese investigators, It was hard to say that any potential bias and influence occurred because the research personnel simply mentioned that they were responsible for gathering the stories from the participants and supporting activities, say, properly use of tape recording. Apparently, the relationship between the research personnel and participants were nothing, but participants may be influenced by the research team or in professional term- reflexivity. Reflexivity requires an awareness of the researcher’s contribution to the construction of meanings throughout the research process, and an acknowledgment of the impossibility of remaining ‘outside of the six nurses’ while conducting research. In short, the answer of this question is “Yes”.

7. Have ethical issues been taken into consideration?

Oral consent is a kind of ethical issue. Kozier et al, 2004 define the consent is an essential part of the research process, and as such entails more than obtaining a signature on a form (Kozier et al, 2004). Research personnel must educate potential subjects to ensure that they can reach a real informed choice about whether or not to participate in the research. Consent must be given freely and with no coercion as well as based on a clear understanding of what participation involves. On the one hand, the above study has been approved by the University’s ethics committee. The committee is responsible for reviewing, on request, ethical or moral questions that may come up during the study. In brief, the answer is “Yes”.

8. Was the data analysis sufficiently rigorous?

In-depth description of the analysis process was shown in Liu & Liehr (2009) paper. The authors described every phase elaborately and in step-by-step pattern. There were total 5 phases of the content analysis for the nurses caring for SARS patients. The content shared by the six nurses was similar because of geographical reason and the consistent format of the interview. Such arrangement provided convincing analysis to a reader. In fact, thematic analysis was employed by the researchers. It means focuses on identifiable themes (i.e. sharing of nursing care of SARS patients) and data is analysed by theme. This type of analysis is highly inductive, that is, the themes emerge from the data and are not imposed upon it by the research personnel (Denzin & Lincoln, 2005). In short, the answer is “Yes”.

9. Is there a clear statement of findings?

It is crystal clear that there were three core qualities (personal challenge, essence of care and self-growth) the researchers found. Each quality was described in-details with concrete example of the original words from the six nurses. In addition, instructive messages for guidance during future epidemics were also provided. The findings were highly related to the research question. In brief, a clear statement of the findings was clear and evidences were provided to support each quality the answer is “Yes”.

10. How valuable is the research?

The researchers discovered three core qualities and instructive messages regarding to SARS patients caring. Such discovery greatly increases preparedness by attending the messages including structured support, disease/protection-related information systems and the power of military spirit. Maybe the above components can be further researched so as to obtain greater improvements. In addition to enhance preparedness and identify new areas where researches are necessary, the findings are universal applicable. Healthcare frontline staff may face the problems when caring for SARS patients, say, lack of resources. Clinical leader may find the importance of structured support and collaborative spirit to relieve the staff pressure. In short, the value of this research is valuable.

Conclusion

To sum up, the CASP guidelines can appraise both quantitative and qualitative researches. The guidelines include ten questions in which provide comprehensive evaluation of the above studies. The guidelines are particular useful in appraising health and social researches. Furthermore, the CASP guidelines aim to enable readers to develop the skills to find out and make sense of research evidence, helping them to put knowledge into practice. (Word count: 3212)

(Video) Critical Analysis of Qualitative Research

Share this:

FacebookFacebook logoTwitterTwitter logoRedditReddit logoLinkedInLinkedIn logoWhatsAppWhatsApp logo

FAQs

Is CASP for qualitative or quantitative? ›

The CASP tool is a generic tool for appraising the strengths and limitations of any qualitative research methodology. The tool has ten questions that each focus on a different methodological aspect of a qualitative study (Box 1).

Why use CASP tool for quantitative research? ›

Critical appraisal skills enable you to systematically assess the trustworthiness, relevance and results of published papers. The Critical Appraisals Skills Programme (CASP) has over 25 years of significant and unrivalled expertise in the delivery of training to healthcare professionals.

What is the best critical appraisal tool for quantitative research? ›

Critical Appraisal Tools
  • Randomised Controlled Trial (RCT)
  • Cohort.
  • Diagnostic.
  • Case Control Studies.
  • Cross Sectional Studies.
  • Economic Studies.
  • Other Quantitative.
  • Qualitative.

What are the limitations of using CASP tool? ›

The main limitation of using CASP in this way is the lack of two important outcome-level criteria, those of the consistency of the results and possible publication bias.

What is critical appraisal for quantitative research? ›

Critical appraisal describes the process of analyzing a study in a rigorous and methodical way. Often, this process involves working through a series of questions to assess the “quality” of a study by examining its strengths and limitations.

What are two commonly used tool in quantitative analysis? ›

The two most commonly used quantitative data analysis methods are descriptive statistics and inferential statistics.

What is the most common tool used in quantitative research? ›

Survey research is the most common and widely used tool for quantitative research. Surveys are used to gather data by asking relevant questions to the respondents who are thought to have the relevant information we are seeking to acquire.

Why is critical appraisal important in qualitative research? ›

Critical appraisal helps to reduce the burden and allow you to focus on articles that are relevant to the research question, and that can reliably support or refute its claims with high-quality evidence, or identify high-level research relevant to your practice.

How to do critical appraisal of qualitative research? ›

Critical appraisal involves (i) filtering against minimum criteria, involving adequacy of reporting detail on the data sampling, -collection and-analysis, (ii) technical rigour of the study elements indicating methodological soundness and (iii) paradigmatic sufficiency, referring to researchers' responsiveness to data ...

Are qualitative or quantitative methods more effective for evaluation? ›

Quantitative methods are useful in that they often take less time to administer than qualitative methods. They are also easier to evaluate and may produce clearer, more objective results.

Which are key principles for critically appraising both quantitative and qualitative studies? ›

What are the key principles for conducting a critical appraisal of a quantitative or qualitative study? Read and critique the entire study. Examine the organization and presentation of the research report. Examine the significance of the problem being studied.

Can CASP be used for cross sectional study? ›

Many critical appraisal tools exist for various types of study (e.g. CASP , CEBM and AMSTAR) but there is no validated tool for cross-sectional studies, which are common in the veterinary literature.

Is CASP a risk of bias tool? ›

Classifying quality (or risk of bias) as high, moderate or low, based on the CASP tool would be perfectly acceptable. The dominant opinion these days is that scores can be misleading, and it is better to report the actual domains where there are biases.

Is CASP a data extraction tool? ›

Use a recognised data extraction template, such as CASP, which you can adapt for your own review.

What differs when appraising qualitative versus quantitative studies? ›

Qualitative and Quantitative Research

In general, quantitative research seeks to understand the causal or correlational relationship between variables through testing hypotheses, whereas qualitative research seeks to understand a phenomenon within a real-world context through the use of interviews and observation.

What are the qualitative and quantitative methods in evaluation procedures? ›

Quantitative data includes specific measurements and outcomes gathered from surveys, claims data, cost reports, and other numeric measures. Qualitative data may be gathered from interviews and focus groups of program participants and supportive agencies and individuals.

What is critical appraisal of qualitative and quantitative research? ›

Critical appraisal of quantitative and qualitative studies involves a final evaluation to determine the credibility of the study findings and any implications for practice and further research (see Box 12-1). Adding together the strong points from multiple studies slowly builds a solid base of evidence for practice.

What is the first step in the critical appraisal process for a qualitative study? ›

First, you need to assess whether your patient or patient population is similar to those in the study. There are likely to be differences, but you must determine what the important differences are and if it will impact the effectiveness on your patient population.

How do you appraise quantitative research articles? ›

How to appraise quantitative research articles
  1. Problem statement. ...
  2. Literature review. ...
  3. Methods. ...
  4. Sample selection. ...
  5. Study design. ...
  6. Data collection. ...
  7. Statistical analysis. ...
  8. Results and discussion of findings.
Jan 11, 2007

Is critical discourse analysis qualitative? ›

Critical discourse analysis (CDA) is a qualitative analytical approach for critically describing, interpreting, and explaining the ways in which discourses construct, maintain, and legitimize social inequalities.

Is critical analysis qualitative? ›

A critical analysis of a qualitative study considers the “fit” of the research question with the qualitative method used in the study. Although the specific criteria for proper application of each methodological approach vary somewhat, there are sufficient similarities among the approaches to discuss them in general.

Is a clinical audit quantitative or qualitative? ›

QUANTITATIVE & QUALITATIVE DATA

Clinical audit is usually concerned with gathering quantitative data, sometimes referred to as 'hard data'.

What is critical appraisal in qualitative research? ›

Critical appraisal is “the process of systematically examining research evidence to assess its validity, results and relevance before using it to inform a decision” (Hill & Spittlehouse, 2003).

Videos

1. A hands on introduction to using the CASP checklist to appraise systematic reviews (Dr Becky Gould)
(Cochrane UK)
2. 1. Introduction to critical appraisal
(Cochrane Mental Health)
3. HS2405 AssessmentTask1 Group4 Maru
(John Crowther)
4. How to CRITIQUE a research paper, article, journal (Critical Appraisal using CASP tool) EPISODE 1
(Dr B - Naija Dentist)
5. How to criticize quantitative research - Part 1 & 2
(Chee-Wee Tan)
6. Critical Appraisal of a Qualitative Study
(Andrew Booth)

References

Top Articles
Latest Posts
Article information

Author: Terence Hammes MD

Last Updated: 17/09/2023

Views: 5697

Rating: 4.9 / 5 (69 voted)

Reviews: 92% of readers found this page helpful

Author information

Name: Terence Hammes MD

Birthday: 1992-04-11

Address: Suite 408 9446 Mercy Mews, West Roxie, CT 04904

Phone: +50312511349175

Job: Product Consulting Liaison

Hobby: Jogging, Motor sports, Nordic skating, Jigsaw puzzles, Bird watching, Nordic skating, Sculpting

Introduction: My name is Terence Hammes MD, I am a inexpensive, energetic, jolly, faithful, cheerful, proud, rich person who loves writing and wants to share my knowledge and understanding with you.