Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Search in posts
Search in pages
Filter by Categories
Book Review
Brief Report
Case Letter
Case Report
Case Series
Commentary
Current Issue
Editorial
Erratum
Guest Editorial
Images
Images in Neurology
Images in Neuroscience
Images in Neurosciences
Letter to Editor
Letter to the Editor
Letters to Editor
Letters to the Editor
Media and News
None
Notice of Retraction
Obituary
Original Article
Point of View
Position Paper
Review Article
Short Communication
Systematic Review
Systematic Review Article
Technical Note
Techniques in Neurosurgery
Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Search in posts
Search in pages
Filter by Categories
Book Review
Brief Report
Case Letter
Case Report
Case Series
Commentary
Current Issue
Editorial
Erratum
Guest Editorial
Images
Images in Neurology
Images in Neuroscience
Images in Neurosciences
Letter to Editor
Letter to the Editor
Letters to Editor
Letters to the Editor
Media and News
None
Notice of Retraction
Obituary
Original Article
Point of View
Position Paper
Review Article
Short Communication
Systematic Review
Systematic Review Article
Technical Note
Techniques in Neurosurgery
Generic selectors
Exact matches only
Search in title
Search in content
Post Type Selectors
Search in posts
Search in pages
Filter by Categories
Book Review
Brief Report
Case Letter
Case Report
Case Series
Commentary
Current Issue
Editorial
Erratum
Guest Editorial
Images
Images in Neurology
Images in Neuroscience
Images in Neurosciences
Letter to Editor
Letter to the Editor
Letters to Editor
Letters to the Editor
Media and News
None
Notice of Retraction
Obituary
Original Article
Point of View
Position Paper
Review Article
Short Communication
Systematic Review
Systematic Review Article
Technical Note
Techniques in Neurosurgery
View/Download PDF

Translate this page into:

Original Article
7 (
1
); 13-22
doi:
10.4103/0976-3147.172170

Hindi translation and evaluation of psychometric properties of Craig Hospital Inventory of Environmental Factors instrument in spinal cord injury subjects

Department of Physiotherapy, ISIC Institute of Rehabilitation Sciences, New Delhi
Centre for Physiotherapy and Rehabilitation Sciences, Jamia Millia Islamia, New Delhi, India

Address for correspondence: Asst Prof. Majumi Mohamad Noohu, Centre for Physiotherapy and Rehabilitation Sciences, Jamia Millia Islamia, New Delhi, India. E-mail: mnoohu@jmi.ac.in

Licence

This is an open access article distributed under the terms of the Creative Commons Attribution-NonCommercial-ShareAlike 3.0 License, which allows others to remix, tweak, and build upon the work non-commercially, as long as the author is credited and the new creations are licensed under the identical terms.

Disclaimer:
This article was originally published by Medknow Publications & Media Pvt Ltd and was migrated to Scientific Scholar after the change of Publisher.

Abstract

Introduction:

The Craig Hospital Inventory of Environmental Factors instrument (CHIEF) is one of the few tools to assess the environmental barriers. The purpose of this study was to translate long and short CHIEF into Hindi language, and to determine its validity and reliability.

Design and Setting:

The study design was observational case series with repeated measures. It was carried out at Indian Spinal Injuries Centre New Delhi, a specialized center for rehabilitation for spinal cord injury.

Methods:

The CHIEF instrument was translated from English to Hindi based on the Beaton guidelines for the cross-cultural adaptation of health status measures. The Hindi version of the CHIEF instrument was then administered on a convenience sample of 30 spinal cord injured subjects. Its content validity, internal consistency, test-rest reliability (intraclass correlation coefficient [ICC] 2,1), standard error of measurement (SEM), and minimum detectable change (MDC) were determined for both the longer and shorter version.

Results:

The mean ± SD of total of Hindi-CHIEF instrument, longer version was 1.44 ± 0.82 and total score of the shorter version was 1.07 ± 0.66. The content validity determined by the content validity ratio was found to be 1 for all the items except item number 5, 11, and 12. The content validity index was 0.97 for the longer version and for the shorter version it was 0.98. Internal consistency, Cronbach's α value was found to be 0.92 and test-retest value (ICC 2,1) was 0.80 (P < 0.001). The MDC was found to be 0.99 and SEM was 0.36 for the longer version. The Cronbach's α was 0.731, ICC 2,1 was 0.63 (P < 0.001), SEM was 0.24, and MDC was 0.66 for the shorter version.

Conclusion:

The Hindi translated version of the CHIEF scale has acceptable content validity and reliability. It can be used to assess environmental barriers perceived by spinal cord injury patients.

Keywords

Barriers
participation
reliability
spinal cord injury
validity

Introduction

Spinal cord injury can lead to motor and sensory deficit along with bowel and bladder dysfunction. It can cause activity limitation and participation restriction.[1] It is well-known that the environment is a major domain of well-being or quality of life.[2] Successful community integration in spinal cord injured can be defined as being part of the mainstream of family and community life, fulfilling normal roles and responsibilities, and being an active and contributing member of one's social groups and society as a whole following rehabilitation interventions.[34] The interaction between the individual and the environment play a key role in determining the level of participation in society.[2] According to the International Classification of Functioning, Disability and Health by WHO, the environment barriers are considered to be important, because the “social participation” of people with impairments would be facilitated by the prevention and reduction of environmental barriers.[5]

To obtain a clearer understanding of environmental barriers faced by patients after spinal cord injury and to better assess the effect of intervention programs, a standardized assessment of environmental factors is essential. The 25-item self administered Craig Hospital Inventory of Environmental Factors (CHIEF) developed by Whiteneck et al., is a common tool used to assess environmental barriers in people with spinal cord injury and other disabilities. It has demonstrated good psychometric properties in samples of people with and without disabilities. CHIEF addresses both the frequency and magnitude of the environmental barriers encountered, and covers five different domains (i.e., physical, attitudinal, service, productivity, and policy) of barriers that hinder people from doing what they need and want to do. In contrast to other environment assessment tools, the CHIEF instrument was designed as a shorter inventory of only environmental barriers not facilitators. The CHIEF instrument has a shorter version also which was developed from the longer version by retaining 12 questions.[6]

With a population of more than 1 billion and the national language being Hindi, a majority of people speak Hindi in India. Apart from India, there is large number of Indians who are settled in various parts of the world and have Hindi as their mother tongue. The prevalence of spinal cord injury in India is high,[7] and there is no of tools for assessing environmental barriers for such a large Hindi-speaking population in their native language. Clinically, having standardized assessment tools available in Hindi with proven psychometric properties will assist the clinicians in providing culturally sensitive assessment to clients who do not understand English. Hence, this study aimed to translate the commonly used CHIEF instrument to Hindi language and to determine its validity and reliability for assessing environmental barriers in spinal cord injured.

Methods

A convenience sample of 30 subjects with spinal cord injury who met the inclusion and exclusion criteria were recruited from Indian Spinal Injuries Centre, New Delhi. The study was approved by the Institute's Research Review and Ethics Committee. Permission was taken from the original developers to translate the CHIEF instrument from English to Hindi. Inclusion criteria for selection were subjects with spinal cord injury of duration more than 1 year[8] (American Spinal Injury Association [ASIA] Scale A, B, C, and D) and those who were able to read and understand Hindi. Subjects diagnosed with any medical, psychiatric illness, or any other neurological impairment which might hamper his/her participation in the study was excluded.

The Beaton translation guidelines was used for the translation of CHIEF instrument.[9] The instrument was translated into Hindi by a translation committee, which comprised two translators working as professional translators. All the translators had Hindi as their native language and a very good command over English. Translator 1 and 2 translated the instrument into Hindi, translators 3 and 4 back-translated the scale into English. This back translation was produced by two persons with the source language (English) as their mother tongue. A moderator was appointed to coordinate the whole process, and was involved in both, the forward translation and the back translation processes. The instrument was then reviewed by the Expert Review Committee. The comments and suggestions of the Review Committee were then sent back to the translators for corrections into the next intermediate Hindi version of the instrument. Then, the final translated copy was ready to be used for pilot testing. After pilot testing phase, the Hindi translated version of the CHIEF instrument, Hindi-CHIEF (H-CHIEF) instrument, was administered on a sample of 30 spinal cord injured subjects. The H-CHIEF instrument was again administered to the subjects after 1 week to test test-rest reliability, intraclass correlation coefficient (ICC) (2,1). The scores obtained in the retest was compared with the first score to calculate the ICC (2,1). Twenty-five subjects were available to refill the CHIEF instrument for the 2nd time.

An interview was conducted among the participants to find out the problems with the H-CHIEF instrument. The suggestions were incorporated in the final translated Hindi version tool, and the scale was sent to a panel of 10 rehabilitation experts to determine the content validity. The short version of the H-CHIEF scale was prepared by selection of 12 questions from the longer version.

Three methods of scoring each item were done as proposed by the original developers.[10] The frequency with which barriers encountered were scored on a 5-point scale (0 - never; 1 - less than monthly; 2 - monthly; 3 - weekly; and 4 - daily), a 3-point scale (0 - no problem because the barrier was never encountered; 1 - a little problem; and 2 - a big problem) were used to measure the magnitude of the barrier. A frequency-magnitude product score was calculated as the product of the frequency score and the magnitude score. Total scores across the 25 items were calculated as the averages frequency-magnitude product score across all the scale items. A greater impact of environmental barriers was indicated by larger average frequency-magnitude product of all the items. The H-CHIEF is given in appendix 1.

Validity

Content validity was determined by calculating the content validity ratio (CVR). It determined, if the skill or knowledge measured by this item was: essential (score = 1); useful, but not essential (score = 0), and not necessary (score = −1). CVR was calculated for each item based on a formula developed by Lawshe's.[11] The rating of the scale was done by a panel of 10 experts in the field of neurological rehabilitation.

Reliability

The evaluation of internal consistency, test-rest reliability (ICC 2,1), standard error of measurement (SEM), and minimum detectable change (MDC) was done for both the longer and shorter version.

Statistical analysis

Statistical Package for Social Sciences (SPSS, IBM) for windows version 19 was used for the data analysis. Content validity was calculated using the CVR formula and content validity index (CVI) was also calculated. Reliability analysis was done for internal consistency by calculating the Cronbach's α value, test-retest reliability by ICC 2,1. The SEM and MDC were also determined as part of reliability analysis. The level of significance was set at P ≤ 0.05.

Content validity

CVR = (Ne − N/2)/(N/2) (Ne - number of experts rated on item as essential, N - total no. of experts in the panel).

Calculated CVR were then compared to the levels required for statistical significance. A minimum CVR value of 0.62 was necessary for statistical significance based on 10 panelists,[11] and the CVI was simply calculated as the mean of the CVR values of the retained items. A minimum score of 0.78 is required in CVI for the scale to be rated as having excellent content validity.[12]

Internal consistency

Evaluation of internal consistency (ICC) of H-CHIEF instrument for long and short version reliability was done by calculating the Cronbach's α.[1314] An α value ≥ 0.9 is considered excellent and ≤ 0.5 is unacceptable.[15]

Test-retest reliability

ICC 2,1; two-way random, absolute agreement, of measurements 1 and 2 were computed for determining the test-rest reliability. Test-retest reliability was considered to be acceptable if the ICC was > 0.75 and considered to be very good if the ICC was > 0.9.[16]

Standard error of measurement

The SEM was chosen as a measure of absolute reliability and was calculated by the formula, SEM = SD × (√1 − ICC), where SD is the standard deviation. A high SEM indicates a high level of error and indicates nonreproducibility of the measurements.[16]

Minimum detectable change

The MDC at 95% confidence was calculated to provide clinical interpretation, using the equation, MDC = SEM × 1.96× 2 = 2.77 × SEM.[17]

Results

The demographic characteristics of the subjects (mean ± SD) such as age, time since injury and frequency distribution (n) of type of paralysis, and ASIA scale levels is tabulated in Table 1. The mean ± SD, of individual items of H-CHIEF instrument, a total score of the longer version (1.44 ± 0.82), and a total score of the shorter version (1.07 ± 0.66) is given in Table 2. The (mean ± SD) of the subscales (attitudes/support, services and assistance, physical and structural, policies subscale work, and school subscale) of the H-CHIEF was also calculated and given in Table 3.

Table 1 Demographic details of the sample (n=30)
Table 2 Mean±SD of individual and total scores across the 25 items (frequency-magnitude) for test-retest evaluation
Table 3 The (mean±SD) of the subscales H-CHIEF instrument

The content validity determined by the CVR was found to be 1 for all the items except item no. 5, 11, and 12 whose value was 0.8. The CVI was calculated as a mean of the CVR values of the 25 items of the scale which was 0.97 and for the shorter version it was 0.98 [Table 4].

Table 4 Content validity for the H-CHIEF instrument

Internal consistency calculated by Cronbach's α value was found to be 0.92 and test-retest value (ICC 2,1) was 0.80 (P < 0.001). The MDC was found to be 0.99 and SEM was 0.36 for the longer version. The Cronbach's α was 0.731, ICC 2,1 was 0.63 (P < 0.001), SEM was 0.24, and MDC was 0.66 for the shorter version. The mean ± SD of longer version and a shorter version for the total score obtained for test-retest reliability determination is given in Table 2.

Discussion

The CHIEF scale was designed to quantify environmental barriers perceived by people with disabilities. It helps in identifying major dimensions of the environment that may impede participation by people with disability such as accessibility, accommodation, resource availability, social support, and equality. It should be noted that the CHIEF does not measure environments and their characteristics objectively, but elicits a characterization of the severity of perceived barriers to social participation, as reported by individuals with a disability.[6]

Several measures have been developed to quantify environmental facilitators (i.e., factors that increase participation) or barriers (i.e., factors that reduce participation) in people with disabilities such as the 84-item measure of the quality of the environment (MQE), the 61-item facilitators and barriers survey (FABS), and Quebec environmental assessment.[81314]

However, these questionnaires are quite lengthy and require a long period of time for completion, which may not be feasible in daily clinical practice, particularly in community rehabilitation settings where the patient to therapist ratio is often high. Moreover, the MQE does not address the frequency of encountering environmental obstacles.[8] The FABS, on the other hand, has shown only low to moderate internal consistency and test-retest reliability.[13] CHIEF also takes less time to administer compared with MQE and FABS as the items to be answered is less.

The results of the study had shown that H-CHIEF instrument possess good psychometric proprieties an assessment tool. The mean total value obtained was slightly higher than the previous reporting, which was 1.26[10] where as in this study it is 1.44. The subscale scores ranged from 0.91 ± 0.66 to 1.91 ± 0.95, the highest being for attitudes/support area. This indicates that the problem faced by the people with spinal cord injury which impede their movement is affected to a larger extent by the attitude and support in the community. The least problem is encountered in the service and assistance area.

The content validity determined by the CVR was found to be very high for both the versions of the scales. This indicates that the contents of scale appropriately measure the barriers and extent of the impact on the functioning. Quantitative reviews were conducted for determination of the content validity of the instrument. During the quantitative review of the scale, none of the items of the scale were rated as “not essential” by the reviewers. Items 5, 11, and 22 were rated as “useful but not essential” by the reviewers. The CVR indicated good content validity of the scale. In the qualitative review, the raters stated no discrepancies or issues over any of the items.

Internal consistency calculated by Cronbach's α, test-retest value (ICC 2,1) and MDC were found higher for the longer version and SEM was smaller for the short version. Internal consistency reliability shows high-reliability score as that of the original scale and Chinese version.[26] The test-retest value was also high as that of the previous reporting.[6] Small estimations of SEM for both versions of the scales indicate that scores obtained were reproducible again. MDC provides an assessment of a relative improvement or deterioration. It would be beneficial to the clinician to determine whether there was true change over time with intervention.[18] The SEM was very small for both the versions of the scale indicating that the scores obtained are steady and reproducible again.

Better evaluation leads to better and accurate outcomes. The H-CHIEF will help the clinicians and rehabilitation team members of the spinal cord injured to measure the environmental barriers perceived by the spinal cord injury patients and help them to make realistic goals for the patients. The development of the scale in Hindi ensures that it would be easy to understand and comprehend the scale. A large number of people live in rural hinterlands of India; the particular scale will be highly useful in assessing the barriers they face in everyday life. They will be asked about their problem in native language, and this will be very effective as the meaning of the questions will not be lost during self-translations by the examiner. The H-CHIEF can also be used to make international comparisons and cross-cultural research studies.

The translation of the CHIEF into Hindi was done by Beaton manual guidelines. The Beaton manual is an accepted and widely used procedure for translation. The estimation of content validity and internal consistency was only done. Further studies can be done to calculate other psychometric properties of the scale.

Conclusion

The long and short Hindi CHIEF instrument has been found to have adequate content validity, internal consistency, test-retest reliability, and SEM on spinal cord injured population. The instrument can be used to assess environmental barriers perceived by spinal cord injury patients.

Financial support and sponsorship

Nil.

Conflicts of interest

There are no conflicts of interest.

References

  1. , , , , , , . International standards for neurological and functional classification of spinal cord injury. American Spinal Injury Association. Spinal Cord. 1997;35:266-74.
    [Google Scholar]
  2. , , , . Measuring environmental barriers faced by individuals living with stroke: Development and validation of the Chinese version of the Craig Hospital Inventory of Environmental Factors. J Rehabil Med. 2012;44:740-6.
    [Google Scholar]
  3. , , , . Quality of life, social participation, appraisals and coping post spinal cord injury: A review of four community samples. Spinal Cord. 2006;44:95-105.
    [Google Scholar]
  4. , . Community integration conceptual issues and measurement approaches in rehabilitation research. Top Spinal Cord Inj Rehabil. 1998;4:1-15.
    [Google Scholar]
  5. International Classification of Functioning, Disability and Health (ICF) Available from: http://www.who.int/classifications/icf/en/
    [Google Scholar]
  6. , , , , , , . Quantifying environmental factors: A measure of physical, attitudinal, service, productivity, and policy barriers. Arch Phys Med Rehabil. 2004;85:1324-35.
    [Google Scholar]
  7. , , . Demographic profile of traumatic spinal cord injuries admitted at Indian Spinal Injuries Centre with special emphasis on mode of injury: A retrospective study. Spinal Cord. 2012;50:745-54.
    [Google Scholar]
  8. , , , . Measure of the quality of the environment – Version 1.0. Lac St-Charles, Quebec, Canada: CQCIDIH; .
    [Google Scholar]
  9. , , , , . Guidelines for the process of cross-cultural adaptation of self-report measures. Spine (Phila Pa 1976). 2000;25:3186-91.
    [Google Scholar]
  10. Craig Hospital Inventory of Environmental Factors (CHIEF) Manual, Version 3.0. Craig Hospital; April. . Available from: https://www.craighospital.org/uploads/CraigHospital ChiefManual.pdf
    [Google Scholar]
  11. , . A quantitative approach to content validity. Pers Psychol. 1975;28:563-75.
    [Google Scholar]
  12. , , . The content validity index: Are you sure you know what's being reported?. Critique and recommendations. Res Nurs Health. 2006;29:489-97.
    [Google Scholar]
  13. , , , , . A subjective measure of environmental facilitators and barriers to participation for people with mobility limitations. Disabil Rehabil. 2008;30:434-57.
    [Google Scholar]
  14. , . Documenting environmental factors for preventing the handicap creation process: Quebec contributions relating to ICIDH and social participation of people with functional differences. Disabil Rehabil. 1995;17:145-53.
    [Google Scholar]
  15. , , . Cronbach's alpha. BMJ. 1997;314:572.
    [Google Scholar]
  16. , . Quantifying test-retest reliability using the intraclass correlation coefficient and the SEM. J Strength Cond Res. 2005;19:231-40.
    [Google Scholar]
  17. , , . Interpreting change scores of tests and measures used in physical therapy. Phys Ther. 2006;86:735-43.
    [Google Scholar]
  18. , , , , , . Minimal detectable change scores for the Wolf Motor Function Test. Neurorehabil Neural Repair. 2009;23:662-7.
    [Google Scholar]

Appendix 1

Show Sections