|Ahead of print publication
Reliability and Validity Testing of the FAMCARE-2 Scale: Thai Translation
Ladarat Ooraikul1, Virapun Wirojratana2, Rochana Phuackchantuck3, Payuree Chompukeaw1, Chiraporn Khaisuwan1
1 Nursing Department, Faculty of Medicine, Chiang Mai University, Chiang Mai, Thailand
2 Department of Fundamental Nursing, Faculty of Nursing, Mahidol University, Nakhon Pathom, Thailand
3 Research Administration Section, Faculty of Medicine, Chiang Mai University, Chiang Mai, Thailand
|Date of Submission||21-Oct-2019|
|Date of Acceptance||14-Jan-2020|
|Date of Web Publication||15-May-2020|
Nursing Department, Faculty of Medicine, Chiang Mai University, Chiang Mai, Thailand
Source of Support: None, Conflict of Interest: None
Objective: Measuring the satisfaction of family caregivers regarding the palliative care provided to their family members is very important for quality improvement in the palliative care system. The aim of this study was to test the psychometric properties (i.e., reliability and validity) of the FAMCARE-2 Scale: Thai Translation for measuring family caregiver satisfaction. Methods: A forward–backward translation process was utilized to produce the 17-item FAMCARE-2 Scale: Thai Translation. The questionnaire and the demographic data form were hand-delivered to the primary family caregivers of 66 palliative care patients of the inpatient wards at Maharaj Nakorn Chiang Mai Hospital, Faculty of Medicine, Chiang Mai University, on the patient discharge date. Internal consistency reliability testing of the FAMCARE-2 Scale: Thai Translation was assessed by calculating the Cronbach's alpha coefficient. Factor analysis was used to test construct validity. Results: The FAMCARE-2 Scale: Thai Translation showed a high level of internal consistency (Cronbach's alpha coefficient of 0.94) and an item-to-total correlation coefficient of 0.13–0.77. Factor analysis of FAMCARE-2 revealed a four-factor structure: management of physical symptoms and comfort, patient care and sharing information, symptoms and side effects, and family and patient support.Conclusions: The FAMCARE-2 Scale: Thai Translation was found to be a valid psychometric tool for measuring family caregiver satisfaction within the Thai context of palliative care.
Keywords: FAMCARE-2, family caregiver satisfaction, palliative care
|How to cite this URL:|
Ooraikul L, Wirojratana V, Phuackchantuck R, Chompukeaw P, Khaisuwan C. Reliability and Validity Testing of the FAMCARE-2 Scale: Thai Translation. Asia Pac J Oncol Nurs [Epub ahead of print] [cited 2020 May 28]. Available from: http://www.apjon.org/preprintarticle.asp?id=284443
| Introduction|| |
Palliative care has become a top priority national service in Thailand, and measuring the quality of care is important. One approach for assessing quality of care is determining the satisfaction expressed by family members. Satisfaction has been identified as a good indicator of quality of care and whether interventions provided are beneficial. Satisfaction is commonly used for this purpose in international studies of palliative care.
Studies have indicated that primary family members are closest to palliative care patients and know the symptoms and feelings of the patients. Their response to, and assessment of, the treatment and care provided to these patients are important and should be carefully considered. Their perspectives about palliative care are valuable in measuring the quality of palliative care provided.
In our setting, Chiang Mai University Hospital, we have developed a palliative care model, the Suandok Palliative Care Model. It is based on the Palliative Performance Scale version 2 Thai Translation. The Multidisciplinary Palliative Care Team at Chiang Mai University Hospital was established in 2008 and implemented the Suandok Palliative Care Model the same year. The model provides guidelines for physical, psycho-social, and spiritual care. We believe it is important to measure the quality of palliative care that is provided to the patients and family members in order to continuously find ways to improve the palliative care provided. This enables us to identify and correct our shortcomings and build on our strengths. In addition to the patients, we consider family members to be recipients of care. If they are dissatisfied with the quality of care provided, this may impact their health and the performance of their care functions. It may have a negative influence on the decisions they make concerning the treatment and care of their family members. However, the palliative care team had not previously employed a standardized assessment tool to measure the satisfaction of family members with the palliative care provided to their relatives.
The FAMCARE-2 Scale has been identified as a useful tool in measuring the satisfaction of family members with the palliative care provided to their relatives. It was developed to measure the degree to which primary family members were satisfied with the health care received by the palliative care patients and the family with respect to information giving, availability of care, psychological care, and physical patient care., The FAMCARE-2 Scale has been shown to be a useful outcome measurement for clinicians in the caregiver satisfaction domain., It is a reliable tool that captures the level of satisfaction of caregivers with the palliative care services in hospital and nonhospital settings. FAMCARE-2 Scale can improve knowledge about the perceived quality of care offered by specialist palliative care services, and is reported to have excellent psychometric properties.
There is no Thai translation of the FAMCARE-2 Scale. Hence, the aim of this study was to translate and test the reliability and validity of Thai version of the FAMCARE-2 Scale. The main research questions addressed were:
- What are the psychometric properties of the Thai translation of the FAMCARE-2 Scale?
- What are the factors that affect family caregiver satisfaction?
| Methods|| |
This study used a descriptive research design including the steps of translation of the FAMCARE-2 Scale and testing of its internal consistency (reliability) and content and construct validity.
FAMCARE-2 Scale includes 17 items which measure the family caregivers' satisfaction with the care received by both the patient and the caregivers in palliative care. FAMCARE-2 Scale has four components of care: management of physical symptoms and comfort, provision of information, family support, and patient psychological care. Each FAMCARE-2 item is a five-point Likert scale with the following responses: very satisfied, satisfied, undecided, dissatisfied, and very dissatisfied. The family members can select an additional option,&%#8220;not relevant to my situation.” The scale's internal consistency in the original FAMCARE-2 study measured with Cronbach's alpha coefficient was 0.93 with item total correlations ranging from 0.49 to 0.72.
Translation of FAMCARE-2 Scale: Thai Translation
This study used the forward–backward translation process. Permission from the tool's author was obtained before the translation process. The authors translated the original FAMCARE-2 Scale into Thai and confirmed the accuracy with back translations by two translators. In the first step, two researchers, both native Thai speakers, fully fluent in English, independently translated the English version into Thai. The two researchers then compared the FAMCARE-2 Scale: Thai Translation to the original English version and reached consensus on a final Thai translation. The Thai translation was then back-translated into English by an associate professor from Chulalongkorn University Language Institute. Although not part of standard translation approaches to ensure the Thai version was an accurate rendition of the original FAMCARE-2 concepts, the back-translated version was sent to the developer of FAMCARE-2 for review. The developer found the back-translated version to be an accurate rendition of the original FAMCARE-2 questionnaire and found no problem with it.
Testing psychometric properties of the FAMCARE-2 Scale: Thai Translation
Content validity of the FAMCARE-2 Scale: Thai Translation was determined by three experts including a physician specialized in palliative care, nursing instructor in palliative care, and the nursing administrator in palliative care. Content validity indicates whether the items on the scale appear to measure the relevant concept(s). The experts were asked to agree or disagree with items in the questionnaire as being relevant to measuring palliative care satisfaction and comment in each item. Content validity index (CVI) was calculated by the average proportion of items on an instrument that achieves a rating of 3 or 4 on a 4-point relevance scale by the content experts.
Internal consistency and construct validity, as well as the answers to the second research question, were determined the following administration of the FAMCARE-2: Thai Translation to family members of palliative care inpatients. Internal consistency provides an indication of whether the scale items measure the same concept, whereas construct validity indicates whether an instrument measures the construct(s) it purports to measure.
Participants and setting
The participants were chosen through purposive sampling. The inclusion criteria included the ability to read Thai, aged 18 or older, and identified as the primary family caregivers of the palliative care patients. The participants were drawn from the orthopedic wards, the surgery wards, and the medical wards in Chiang Mai University Hospital.
The sample size calculation was derived from Walter et al. and used a fixed alpha of 0.05 from two observations with reliability values of R0 = 0.8 (acceptable) and R1 = 0.9 (expected), indicating a minimum sample size of n = 49. Hence, the sample size was set to increase at all 66.
FAMCARE-2 Scale: Thai Translation questionnaire and demographic data form: sex, age, education, career, income, and relationship were hand-delivered by research assistant nurses to the primary family caregivers of 66 palliative care patients from the inpatient wards at Chiang Mai University Hospital, Faculty of Medicine, Chiang Mai University, on the discharge date of each patient. The primary family caregivers of 66 palliative care patients gave informed consent and agreed to answer the questionnaire.
They were contacted for participation between March 2015 and November 2016.
Ethical approval of this study was approved by the Ethics Committee, Faculty of Medicine, Chiang Mai University, before data collection. Each potential participant was informed about the purpose of the study, what his/her involvement would entail, confidentiality and anonymity issues, voluntary involvement, and the right to withdraw at any time without repercussions. All participants who consented to participate were asked to sign a consent form.
All analyses were performed using IBM SPSS Statistics for Windows, Version 22.0. Armonk, NY: IBM Corp data analysis software (IBM). Descriptive statistics were used to analyze all data. The internal consistency of the FAMCARE-2 Scale: Thai Translation was measured using Cronbach's alpha coefficient and item-total score correlation. Construct validity was measured through factor analysis using principal component extraction and promax rotation with Kaiser-Meyer-Olkin (KMO) and Bartlett's test. In translating FAMCARE-2 Scale document from English into Thai, it became necessary to change some numbers of the items in the four-factor analysis to make them more appropriate for the Thai version. This is further explained under&%#8220;Factor Analysis.”
ANOVA was also used to investigate the factors that were associated with the scores of FAMCARE-2 Scale. The variables of education level, career, income, and relationship were used in the analysis.
| Results|| |
The selected demographic characteristics of family caregivers and diseases of the patients are presented in [Table 1]. All the 66 family caregivers who were asked to complete the Thai-translated FAMCARE-2 Scale did so. Forty-eight females and 18 males completed the questionnaire. Their mean age was 45.76 years (standard deviation [SD] = 12.43). The majority had loved ones with cancer.
|Table 1: Participant selected demographic characteristics (n=66) and satisfaction scores (possible range 17-85)|
Click here to view
Content validity analysis
The CVI of the FAMCARE-2 Scale: Thai Translation was high with a coefficient of 0.96.
The FAMCARE-2 Scale: Thai Translation achieved a high level of internal consistency. Cronbach's alpha coefficient of the total score was 0.94, and the item-to-total correlation coefficients ranged from 0.13 to 0.77.
[Table 2] shows the four factors of the FAMCARE-2 Scale: Thai Translation. The KMO was 0.88 and Bartlett's test was significant with P = 0.001, indicating that factor analysis for the data was appropriate.
Factor analysis of the FAMCARE-2 Scale: Thai Translation revealed a four-factor structure: management of physical symptoms and comfort, patient care and sharing information, symptoms and side effects, and family and patient support. Factor 1: management of physical symptoms and comfort was described in items 1, 4, 6, 7, 13, 15, and 16. Factor 2: patient care and sharing information was in items 5, 8, 11, 14, and 17. Factor 3: symptoms and side effects was in items 3 and 12. Factor 4: family and patient support was in items 2, 9, and 10.
Factor 1: The content of factor 1 containing item 1 (“The patient's comfort”) which had factor loading 0.766, item 4 (“The way in which the palliative care team respects the patient's dignity”) which had factor loading 0.742, item 6 (“Speed with which symptoms are treated”) which had factor loading 0.740, item 7 (“Palliative care team's attention to the patient's description of symptoms”) which had factor loading 0.628, item 13 (“The way the family is included in treatment and care decisions”) which had factor loading 0.449, item 15 (“How effectively the palliative care team manages the patient's symptoms”) which had factor loading 0.357, and item 16 (“The palliative care team's response to changes in the patient's care needs”) which had factor loading 0.362.
Factor 2: The content of factor 2 containing item 5 (“Meetings with the palliative care team to discuss the patient's condition and plan of care”) which had factor loading 0.466, item 8 (“The way in which the patient's physical needs for comfort are met”) which had factor loading 0.893, item 11 (“The practical assistance provided by the palliative care team (e.g. bathing, home care, respite”) which had factor loading 0.470, item 14 (“Information given about how to manage the patient's symptoms”) which had factor loading 0.677, and item 17 (“Emotional support provided to the patient by the palliative care team”) which had factor loading 0.626.
Factor 3: The content of factor 3 containing item 3 (“Information given about the side effects of treatment”) which had factor loading 0.623 and item 12 (“The doctor's attention to the patient's symptoms”) which had factor loading 0.712.
Factor 4: The content of factor 4 containing item 2 (“The way in which the patient's condition and progress have been explained by the palliative care team”) which had factor loading 0.509, item 9 (“Availability of the palliative care team to the family”) which had factor loading 0.854, and item 10 (“Emotional support provided to family members by the palliative care team”) which had factor loading 0.507.
The results showed that some items in the study did not load onto the subscales found in the original FAMCARE-2 in English.
[Table 3] shows the structure of the four factors together with the mean score and standard deviation for each item within each subscale, which was considered high.
|Table 3: Conceptual structure of the FAMCARE-2 Scale: Thai Translation based on survey data analysis|
Click here to view
Family member satisfaction with care
[Table 4] shows the responses to each of the FAMCARE-2 Scale: Thai Translation items. The highest score was for item,&%#8220;The doctor's attention to the patient's symptoms” (74.2%), and the second highest score was for item&%#8220;The way the family is included in treatment and care decisions” (68.2%). The items with the most family members indicating lower levels of satisfaction concerned the provision of information about symptom management (10.6%), provision of emotional care (6.1%), meeting patients' physical needs (6.1%), providing practical assistance (6.1%), and availability of the palliative care team members (6.1%).
|Table 4: Responses to each of the FAMCARE-2 Scale: Thai Translation items|
Click here to view
The factor that most affected family caregiver satisfaction with palliative care was education level using ANOVA.
[Table 5] shows the significant differences when respondents were categorized based on educational levels. Secondary school graduates and bachelor's degree graduates were both less satisfied with care than primary school graduates but did not differ significantly from each other. There was no statistically significant difference in the satisfaction with palliative care based on the career identification, income, and relationship of caregivers. The mean score of total scale of the FAMCARE-2 Scale: Thai Translation was 4.52, and SD was 0.40 which was considered high.
|Table 5: The significant differences of FAMCARE-2 scores when respondents were categorized based on education level|
Click here to view
| Discussion|| |
Our study tested the reliability and validity of the FAMCARE-2 Scale: Thai Translation. Factor analysis of the FAMCARE-2 Scale: Thai Translation revealed a four-factor structure (i.e., management of physical symptoms and comfort, patient care and sharing information, symptoms and side effects, and family and patient support) similar to the original FAMCARE-2 in English. The difference between the FAMCARE-2 Scale: Thai Translation and the original FAMCARE-2 in English was that some items were in different factor structures. For example, items 8 and12 in the original FAMCARE-2 in English were in the management of physical symptoms and comfort, but item 8 (The way in which the patient's physical needs for comfort are met) in the FAMCARE-2 Scale: Thai Translation was in patient care and sharing information. Furthermore, item 12 (The doctor's attention to the patient's symptoms) was in symptoms and side effects in the FAMCARE-2 Scale: Thai Translation. It might be that English words have several meanings in Thai, whereas the Italian version of FAMCARE-2 has a single-factor structure.
Several items point to areas where improvements could be made in our provision of palliative care. The study found a statistically significant relation between the education level of the family members and the FAMCARE-2 Scale: Thai Translation. Primary school graduates indicated greater satisfaction than the secondary school graduates and bachelor's degree graduates. This same relationship has been found in other studies in which respondents with lower education levels expressed greater satisfaction with care received.
During the administration of the questionnaire, it was found that respondents with lower education levels, primary school only, more frequently asked for assistance to fully understand the meaning of some items. For instance, some family members were unable to initially understand what was meant by the term how effectiveness in item 17. Likewise, the term&%#8220;dignity” in item 4 was not understood by some respondents with lower education level and required further explanation. Therefore, we should explain items 4 and 17 more clearly to the family members with primary school education. Finally, it was noted that some primary school education level respondents expressed difficulty in maintaining concentration while answering all 17 items. Further research and study in this area is warranted to make the FAMCARE-2 Scale appropriate for all respondents, regardless of education level.
| Limitation and Recommendation|| |
Thai Translation has 17 items. It might be too many items for the family members to complete on the discharge date of the palliative care patients. They may be too preoccupied in listening to the discharge instructions from the nurses and might not concentrate to answer the FAMCARE-2 Scale: Thai Translation. Therefore, we should develop a shorter version of the tool or administer it on another date.
Thai Translation should add an open-ended question for additional comments. Open-ended questions allow the respondents to add comments about what they believe is important and may not be covered in the questionnaire items.
| Conclusion|| |
The FAMCARE-2 Scale: Thai Translation is reliable and valid for measuring the family caregiver satisfaction with palliative care with Thai speaking individuals. Four subscales such as management of physical symptoms and comfort, patient care and sharing information, symptoms and side effects, and family and patient support were identified. In our facility, family member satisfaction regarding palliative care was high overall, although areas were identified that will require improvements.
The authors would like to acknowledge the funding support of the Faculty of Medicine, Chiang Mai University, Chiang Mai, Thailand. We also thank the family caregivers of the palliative care patients who participated in this study.
Financial support and sponsorship
This study was financially supported by the Faculty of Medicine, Chiang Mai University, Chiang Mai, Thailand.
Conflicts of interest
There are no conflicts of interest.
| References|| |
Nadin S, Miandad MA, Kelley ML, Marcella J, Heyland DK. Measuring family members' satisfaction with end-of-life care in long-term care: Adaptation of the CANHELP lite questionnaire. Biomed Res Int 2017;2017:4621592.1-17.
D'Angelo D, Punziano AC, Mastroianni C, Marzi A, Latina R, Ghezzi V, et al
. Translation and testing of the Italian version of FAMCARE-2: measuring family caregivers' satisfaction with palliative care. J Fam Nurs 2017;23:252-72.
Doorenbos AZ, Juntasopeepun P, Eaton LH, Rue T, Hong E, Coenen A. Palliative care nursing interventions in Thailand. J Transcult Nurs 2013;24:332-9.
Nawacharoen W. Palliative care in Chiang Mai: University hospital. In: Chewasakulyong B, editors. Textbook of Palliative Care. Chiang Mai: Klangviang Printing; 2013. p. 13-6.
Sanagoo A, Moghadam AA, Hazini A, Gashb EA, Jouybari LM, Mojarad FA. The comparison of family member's satisfaction of palliative care and standard care for patients with incurable cancer. Crit Care Nur 2016;9:e6243.
Aoun S, Bird S, Kristjanson LJ, Currow D. Reliability testing of the FAMCARE-2 scale: Measuring family carer satisfaction with palliative care. Palliat Med 2010;24:674-81.
Kristjanson LJ. Validity and reliability testing of the FAMCARE Scale: Measuring family satisfaction with advanced cancer care. Soc Sci Med 1993;36:693-701.
Beaumont C, Nekolaichuk C. Famcare and Famcare-2 Guidelines. Edmonton: Palliative and End-of-Life Institute Health Services Centre, Grey Nuns Hospital; 2012.
Brislin RW. Back-translation for cross-culture research. J Cross Cult Psychol 1970;1:185-216.
Polit DF, Beck CT. The content validity index: Are you sure you know what's being reported? Critique and recommendations. Res Nurs Health 2006;29:489-97.
Walter SD, Eliasziw M, Donner A. Sample size and optimal designs for reliability studies. Stat Med 1998;17:101-10.
Nunnally JC. Psychometric Theory. 2nd
ed. New York: McGraw-Hill; 1978. p. 244-5.
Tabachnick BG, Fidell LS. Using Multivariate Statistics. 4th
ed. Boston, MA: Allyn and Bacon; 2007.
[Table 1], [Table 2], [Table 3], [Table 4], [Table 5]