|Year : 2017 | Volume
| Issue : 1 | Page : 57
Construct and criterion validity of the pedsQL™ 4.0 instrument (Pediatric Quality of Life Inventory) in Colombia
Ana Carolina Amaya-Arias, Juan Pablo Alzate, Javier H Eslava-Schmalbach
Clinical Research Institute, School of Medicine, Universidad Nacional de , Bogotá, Colombia
|Date of Submission||30-May-2016|
|Date of Acceptance||29-Mar-2017|
|Date of Web Publication||24-Aug-2017|
Ana Carolina Amaya-Arias
Clinical Research Institute, Carrera 45 No 26-85 - Edificio Uriel Gutiérrez, Bogotá
Source of Support: None, Conflict of Interest: None
Background: This study aimed at determining the validity of the Pediatric Quality of Life Inventory 4.0 (PedsQL™ 4.0) for the measurement of health-related quality of life (HRQOL) in Colombian children. Methods: Validation study of measurement instruments. The PedsQL™ 4.0 was applied by convenience sampling to 375 pairs of children and adolescents between the ages of 5 and 17 and to their parents-caregivers, as well as to 125 parents-caregivers of children between the ages of 2 and 4 in five cities of Colombia (Bogota, Medellin, Cali, Barranquilla and Bucaramanga). Construct validity was assessed through the use of exploratory and confirmatory factor analysis, and criterion validity was assessed by correlations between the PedsQL™ 4.0 and the KIDSCREEN-27. Results: The instrument was applied to 375 children (ages 5–18) and 125 parents of children between the ages of 2 and 4. Factor analysis revealed four factors considered suitable for the sample in both the child and parent reports, whereas Bartlett's test of sphericity showed inter-correlation between variables. Scale and subscales showed proper indicators of internal consistency. It is recommended not to include or review some of the items in the Colombian version of the scale. Conclusions: The Spanish version for Colombia of the PedsQL™ 4.0 displays suitable indicators of criterion and construct validity, therefore becoming a valuable tool for measuring HRQOL in children in our country. Some modifications are recommended for the Colombian version of the scale.
Keywords: Child, outcome assessment (health care), PedsQL™4.0, psychiatric status rating scales, quality of life, validation studies
|How to cite this article:|
Amaya-Arias AC, Alzate JP, Eslava-Schmalbach JH. Construct and criterion validity of the pedsQL™ 4.0 instrument (Pediatric Quality of Life Inventory) in Colombia. Int J Prev Med 2017;8:57
|How to cite this URL:|
Amaya-Arias AC, Alzate JP, Eslava-Schmalbach JH. Construct and criterion validity of the pedsQL™ 4.0 instrument (Pediatric Quality of Life Inventory) in Colombia. Int J Prev Med [serial online] 2017 [cited 2020 Aug 11];8:57. Available from: http://www.ijpvmjournal.net/text.asp?2017/8/1/57/213661
| Introduction|| |
In recent years, there has been a remarkable increase in research into quality of life as a health indicator in medical specialties, thus becoming an important variable to be considered in cost-utility analysis of interventions in chronic diseases.
Different definitions and ways of rating quality of life have been proposed from a health perspective. In this sense, quality of life has been defined as the value placed upon duration and conditions of life to the extent that it is modified and weakened by injury, illness, treatment, functional states, perceptions, and social opportunities.
This new perception is known as health-related quality of life (HRQOL) which refers to a state of health, in accordance with the definition issued by the World Health Organization, and the influence of variations in each dimension of an individual's perspective and life expectancy.
In the hallmark of research carried out to address HRQOL, general and specific instruments have been developed to assess the perception of patients and their caregivers about their well-being or deterioration as a result of their health-disease process. This is true for the PedsQL™ 4.0 scale, an instrument that has shown adequate markers of validity and reliability , having been endorsed and validated in many Spanish-speaking countries ,, and translated into numerous languages. Such a translation of the instrument has been employed in our country, yet no study has been carried out to verify its validity.
The transcultural validation of this type of instrument sets the way for improvement in the quality of HRQOL measurement and enables systematization of its observation as well as proper interaction and communication between researchers working on the same problem. In this sense, this study attempted to determine the criterion and construct validity of the PedsQL™ 4.0 for measuring HRQOL in Colombian children.
| Methods|| |
The inclusion criteria for the present study were: Colombian children and adolescents aged 2–18 years and their parents-caregivers, who received outpatient care or hospitalization at a secondary or tertiary health facility in the cities of Bogota, Barranquilla, Cali, Medellin and Bucaramanga, and who voluntarily participated in the study.
The only exclusion criterion was incapacity for completing the instruments due to illiteracy, cognitive impairment, or sensory disturbances.
Health care facilities where the PedsQL™ 4.0 was administered were selected by convenience sampling in the five cities stated above, and selection criteria were secondary/tertiary level of care and voluntary participation in the study.
Observational validation of measurement instruments consisting of the following phases:
Phase 1: Construct validity
Construct validity was evaluated using exploratory factor analysis. As a strategy for extracting factors the following criteria were used: Eigen value >1, Barlett test and Kaiser–Meyer–Olkin test, comparing with the main component extraction process to determine the scale domains. A Varimax orthogonal rotation was performed to improve the interpretability of the factors after assessing the low correlation between items. Furthermore, a confirmatory factor analysis was undertaken with the calculation of the following fit indexes: Comparative fit index, normed fit index, root mean square error of approximation (RMSEA), goodness of fit index.
In this phase, a convenience sampling was performed: the sample size was determined to be 5 subjects per item, and accounting for possible missing data, for a total of 125 subjects. Considering the fact that the instrument has some variations when applied in four age groups and that it is administered to the minor and his/her caregiver, for those groups aged 5 years or older the equivalent of this sample size was collected for each group as follows: One hundred and twenty-five caregivers of children aged 2–4 years; 125 children aged 5–7 years and their parents-caregivers; 125 children aged 8–12 years and their parents-caregivers and 125 children aged 13–17 years and their caregivers.
Phase 2: Criterion validity
To assess criterion validity (concurrent validity) the KIDSCREEN-27 scale was applied simultaneously to children aged 8–17 years. This scale was selected due to its validation in our country and the fact that it is designed to measure HRQOL in children aged 8–18 years. The study performed in our country found that KIDSCREEN-27 has good psychometric standards. The Spearman correlation coefficient between the two subscales was calculated taking into account they are ordinal variables.
A sample size of 46 was calculated to detect a correlation of 0.4, with a significance level of 0.05 and 80% power. Given the fact that the relative efficiency of Spearman's rank correlation compared to Pearson's correlation was 0.91, a correction was made to adjust the power when calculating Spearman's coefficient, that means 50 children were required (for two age groups) for a total of 100 (50 children aged 8–12 years and 50 children aged 13–17 years).
This sample was taken strictly in a sequential fashion under the order of application, in each of the above-mentioned groups, until completion of the required sample size.
The Pediatric Quality of Life Inventory ™ (PedsQL™ 4.0) was originally developed in the English language by Varni et al., The generic module evaluates four dimensions: Physical functioning (8 items), emotional functioning (5 items), social functioning (5 items), and school functioning (5 items), for a total of 23 items using a five-point Likert scale. Higher scores indicate better HRQOL and, in addition to the subscales, it is possible to create a Psychosocial Health Summary Score (resulting from the mean of the emotional, social, and school functioning subscales).
The scale has four versions according to the child's age as follows: 2–4 years (toddlers), 5–7 years (young children), 8–12 years (children) and 13–18 years (teenagers). Furthermore, there is an additional format to be administered to parents or caregivers of children aged 5–18 years known as the parent-proxy report. Administration of the PedsQL™ 4.0 takes 10–15 min and its psychometric properties have been verified in different languages and contexts, with good standards of reliability and validity.,,,,,
KIDSCREEN-27 includes 27 items (using a 5-point Likert-scale) that measure 5 HRQOL dimensions: Physical well-being (5 items); psychological well-being (7 items); autonomy and parent relations (7 items); social support and peers (4 items); school environment (4 items). As to the exploratory factor analysis, validation performed in Colombia showed six categories validated also in the confirmatory factor analysis. Internal consistency was above 0.7 in all dimensions. In all domains the intraclass correlation coefficient was higher than 0.87 pertaining interobserver reliability and >0.8 as to intraobserver reliability.
The administration procedure of the scale was standardized through practitioner training and heterogeneous sampling in five different cities granted it included children with different health problems which consulted for outpatient services or hospitalization.
| Results|| |
The PedsQL™ 4.0 was administered to 375 children aged 5–18 years and their parents, as well as to 125 parents of children aged 2–4 years. The sample included pairs for each age group (50% of boys and 50% of girls). Each age group corresponded to 25% of the sample and 20% of the sample was measured in each city, fulfilling the standards purported for the sample contrived.
Two hundred and forty-five children presented acute illnesses (49%) and 255 presented chronic illnesses (51%). The most common diagnoses by percentages were: Oncologic and hematologic diseases (12%), asthma (8%), dengue fever (7%), other chronic diseases (19%), and other acute diseases (21%). Nearly 34% of the children had some physical limitation, and 22% was not enrolled in school activities at the time of evaluation due to their health problem.
Phase 1: Construct validity
Exploratory factor analysis
The exploratory factor analysis for the child report was conducted to obtain four factors that explained for 100% of the variance and showed an Eigen value ≥ 1; assessment of the sample's adequacy using the Kaiser–Meyer–Olkin test indicated that the variables measured common factors when obtaining an index of 0.847, and Bartlett's test of sphericity showed a significance level of <0.0001 with Chi-square distribution of 4414.3 and 253 degrees of freedom, suggesting that variables are inter-correlated. [Table 1] depicts the rotated matrix for the child report.
|Table 1: Factor loadings corresponding to Varimax orthogonal rotation with four factors from the Pediatric Quality of Life Inventory 4.0 child report|
Click here to view
[Table 1] shows the physical and school functioning subscales with proper markers of internal consistency (alphas = 0.821 and 0.969, respectively), both clustered as originally purported. The emotional functioning subscale only includes three of its items in one domain, the emotional item 5 is not grouped in any domain, and emotional item 4 is grouped with the items of the physical functioning subscale. As for the social functioning subscale, three of its items are grouped in a common domain, and the other two are grouped in the physical functioning subscale (social 4 and 5).
When reviewed in terms of wording, items of the emotional and social subscales that were clustered in the physical functioning subscale might be interpreted as if evaluating physical aspects related to mobility (I have trouble sleeping, I do things that others can do, and I keep up when I play with others). On the other hand, children might have difficulty understanding item 5 of the emotional subscale (which is not clustered), since they may portray poor insight on future expectations.
The exploratory factor analysis for the parent report was conducted to obtain four factors that explained for 96% of the variance and showed an Eigen value ≥ 0.8; assessment of the sample's adequacy using the Kaiser–Meyer–Olkin test indicated that the variables measured common factors when obtaining an index of 0.844; Bartlett's test of sphericity showed a significance level of <0.0001 with Chi-square distribution of 2892.7 and 253 degrees of freedom, suggesting that variables are inter-correlated. [Table 2] depicts the rotated matrix for the parent report.
|Table 2: Factor loadings corresponding to Varimax orthogonal rotation with four factors from the Pediatric Quality of Life Inventory 4.0 parent-proxy report|
Click here to view
The results for the physical and social functioning subscales are similar for the parent report, whereas the emotional functioning subscale grouped four of its items and left item 5 unclustered, as was the case for the child report. Unlike the child report, items were not clustered in one domain; two of its items were grouped into the physical functioning subscale (school 4 and 5), given the fact that both items could potentially assess physical functioning aspects in the child report.
Confirmatory factor analysis
The child report's confirmatory factor analysis replicated the four-factor model purported in the exploratory factor analysis. [Table 3] depicts a proper fit on the RMSEA as well as the factor loadings for each item, both for the 4 multidimensional scale and the generic core scale which explains the quality of life construct.
[Figure 1] depicts the resulting scale based on exploratory factor analysis. The results of the scale's fit indices are presented in [Table 3].
|Figure 1: Confirmatory factor analysis (children and parents); four multidimensional scale-based model for the “quality of life” construct|
Click here to view
The four-factor model was also tested in the parent report as purported in the exploratory factor analysis. In this version proper fit was not found in any of the indices [Table 3] and [Figure 1]. Unlike the child report, items for the physical subscale were not grouped in one factor and items 1, 2, and 3 for the social subscale were clustered accounting for a domain in the core scale for both models.
Phase 2: Criterion validity
[Table 4] depicts the results of the Spearman's correlation coefficient between the PedsQL™ 4.0 and the KIDSCREEN-27 for determining the scale's criterion validity.
|Table 4: Spearman correlation coefficient between the Pediatric Quality of Life Inventory 4.0 and the KIDSCREEN-27 scales|
Click here to view
The results demonstrate there is an intermediate relationship between the physical functioning and the physical well-being subscales, as well as the emotional functioning and psychological well-being subscales. Total scores also displayed an intermediate correlation.
The social functioning subscale was not related to either the autonomy and parent relations or the social support and peers subscales.
| Discussion|| |
The size and characteristics of the sample in this study enhances its heterogeneity and the representativeness of the results, especially when considering the fact that unlike other validations of this scale in which healthy children were included  or the sample sizes were smaller,, this study included children with acute and chronic diseases in five Colombian cities.
Reliability results were acceptable for both the parent-proxy and child report in the generic core and dimension subscales, this is consistent with the original version of the scale and the Argentinian and Spanish validations.,
During the scale's validation process, specifically for construct validity, it was found that in both reports the “quality of life” construct was explained by four dimensions in both the exploratory and confirmatory factor analysis, along with measures of sampling adequacy. However, the scales did not show the acceptable goodness of fit. This could be because some items (emotional 3, 4, 5, for both scales; school 4 and 5 for parents and social 5 for children) presented a high uniqueness factor. For this reason, it should be considered not to include them in the Colombian version, modify their wording or reformulate the way in which the emotional, school, and social subscales are constructed. These findings are similar to those made in the Spanish validation, specifically in the school functioning and physical well-being dimensions. In the case of the “health care satisfaction” module belonging to the Uruguayan validation, applicability problems were encountered.
Regarding criterion validity, the results revealed a positive linear relationship between the PedsQL™ 4.0 and the KIDSCREEN-27 scales for both the total scores and subscale scores, except in the case of the social factor subscale, in which Spearman's rank correlation coefficient was not statistically different from 0. These results might be related to how each subscale measured these domains as they focus on different aspects. For example, the social functioning subscale of PedsQL™ 4.0 focuses on how hard it is for the child to interact with his/her peers, while the KIDSCREEN-27 focuses on the social support the child receives from his/her family or peers.
For further studies, it is expected that an assessment is performed in children with chronic disease in terms of their quality of life, taking into account the transition between subscales to verify if the changes are due to the subscale or the medical condition itself. Moreover, other items could be potentially included, such as the use of available technological advances (mobile devices, virtual games, physical activities, etc.) that may prove useful to enhance the perception of quality of life by children with chronic illness and their parents.
At present, it is recognized that the measurement of quality of life in children is of the utmost importance and is a factor to be considered in clinical decision making. Therefore, it is necessary to make available different instruments in Colombia validated for assessing children with different pathologies.
| Conclusions|| |
In conclusion, the validation process for the PedsQL4.0™ scale for Colombia displayed acceptable validity, revealing a different structure from the authors' original proposal, especially with regards to the social, emotional, and school aspects of the instrument.
We thank all institutional health service providers that allowed us access to their facilities for data collection: Fundación Hospital de la Misericordia (Bogotá, D.C), Hospital Universidad del Norte (Barranquilla), Fundación Club Noel (Cali), Clínica Universitaria Bolivariana (Medellín) y el Hospital Universitario de Santander (Bucaramanga).
Financial support and sponsorship
Conflicts of interest
There are no conflicts of interest.
| References|| |
Simón M. Manual de Psicología de la Salud: Fundamentos, Metodología y Aplicaciones. Madrid: Biblioteca Nueva; 1999.
Gómez VM, Sabeh E. Calidad de Vida. Evolución del Concepto y su Influencia en la Investigación y la Práctica. Instituto Universitario de Integración en la Comunidad, Facultad de Psicología, Universidad de Salamanca; 1999. p. 1-6.
Varni JW, Seid M, Rode CA. The PedsQL: Measurement model for the pediatric quality of life inventory. Med Care 1999;37:126-39.
Varni JW, Seid M, Kurtin PS. PedsQL 4.0: Reliability and validity of the Pediatric Quality of Life Inventory version 4.0 generic core scales in healthy and patient populations. Med Care 2001;39:800-12.
González-Gil T, Mendoza-Soto A, Alonso-Lloret F, Castro-Murga R, Pose-Becerra C, Martín-Arribas MC. The Spanish version of the health-related quality of life questionnaire for children and adolescents with heart disease (PedsQL (TM)). Rev Esp Cardiol (Engl Ed) 2012;65:249-57.
Roizen M, Rodríguez S, Bauer G, Medin G, Bevilacqua S, Varni JW, et al.
Initial validation of the Argentinean Spanish version of the PedsQL 4.0 Generic Core Scales in children and adolescents with chronic diseases: Acceptability and comprehensibility in low-income settings. Health Qual Life Outcomes 2008;6:59.
Fernández G, Dallo M, Durán C, Caperchione F, Gutiérrez S, Dapueto JJ. Cuestionario sobre Calidad de Vida Pediátrica (PedsQL) versión 4.0: Fase inicial de la adaptación transcultural para Uruguay. Arch Pediatr Urug 2010;81:91-9.
Sánchez R, Echeverry J. Validating scales used for measuring factors in medicine. Rev Salud Publica (Bogota) 2004;6:302-18.
Tinsley H, Tinsley D. Uses of factor analysis in counseling psychology research. J Couns Psychol 1987;34:414-24.
Quintero CA, Lugo LH, García HI, Sánchez A. Validación del cuestionario KIDSCREEN-27 de calidad de vida relacionada con la salud en niños y adolescentes de Medellín, Colombia. Rev Colomb Psiquiatr 2011;40:470-87.
Bonett D, Wright T. Sample size requirements for estimating pearson, kendall and spearma correlations. Psychometrika 2010;65:23-8.
Felder-Puig R, Frey E, Proksch K, Varni JW, Gadner H, Topf R. Validation of the German version of the pediatric quality of life inventory (PedsQL) in childhood cancer patients off treatment and children with epilepsy. Qual Life Res 2004;13:223-34.
Gheissari A, Farajzadegan Z, Heidary M, Salehi F, Masaeli A, Mazrooei A, et al.
Validation of persian version of PedsQL™ 4.0™ generic core scales in toddlers and children. Int J Prev Med 2012;3:341-50.
Tsuji N, Kakee N, Ishida Y, Asami K, Tabuchi K, Nakadate H, et al.
Validation of the Japanese version of the pediatric quality of life inventory (PedsQL) cancer module. Health Qual Life Outcomes 2011;9:22.
Lau JT, Yu XN, Chu Y, Shing MM, Wong EM, Leung TF, et al.
Validation of the Chinese version of the pediatric quality of life inventory (PedsQL) cancer module. J Pediatr Psychol 2010;35:99-109.
Kook SH, Varni JW. Validation of the Korean version of the pediatric quality of life inventory 4.0 (PedsQL) generic core scales in school children and adolescents using the rasch model. Health Qual Life Outcomes 2008;6:41.
[Table 1], [Table 2], [Table 3], [Table 4]