The DSS Health Care Engagement Index (HCEI)™
The DSS Health Engagement Index™ (HCEI™) is a metric that measures consumer involvement in their personal health care and the health care system overall:
- It is well known that wellness and disease management programs can positively impact member health, expenditures on services and claims experience.
- It is also known that unless you get members engaged in their personal health care then they are unlikely to take advantage of wellness and disease management programs.
- Higher levels of engagement translate into higher levels of participation in your programs, programs offered by others and personal health regimens.
Our extensive work in health and wellness for health plans and other health care organizations and the analysis of others led us to these conclusions. These conclusions, in turn, led us to develop the DSS Health Engagement Index™ where we:
- Capitalized on our many years of experience understanding the health care consumer and the factors that contribute to their active engagement in health care decisions.
- Did specialized research and a number of exploratory surveys.
- Used solid science, advanced statistical modeling and four underlying constructs (health literacy, knowledge, attitudes and behavior) to build the DSS Health Care Engagement Index™.
- Analyzed more than 10 million consolidated claims records in relation to the index.
- Refined the index over the past year and produced reduced and detailed forms.
- Have reported the Index for the past three quarters for the country as a whole and for various subpopulations of interest, including seniors, minorities, the uninsured, etc.
™Health Care Engagement Index and HCEI are trademarks of Decision Support Systems, LP.
We identified four underlying constructs for the health care engagement described below.
The DSS Health Care Engagement Index™ scale was developed using the Domain Sampling Model(1) :
- Specify domain of construct. Using past research, literature search and expert opinion, the primary and secondary domains of health care engagement were defined. The theoretical model of the engagement process includes four major sub-domains or constructs: Literacy, Knowledge, Attitudes and Behaviors. The theoretical model outlines a clear hierarchy between these four constructs. Health care literacy precedes knowledge, knowledge affects health care attitudes and attitudes impact health care behaviors over time.
- Generate sample of items. Over 100 new and previously tested items expected to be associated with these constructs were generated for testing.
- Collect data. The sample items, along with cost data, plan information and respondent characteristics were organized into a questionnaire. The questionnaire was administered to a simple random sample of U.S. adults 18 and older.
- Purify measure. Cronbach’s Alpha, Guttman Split-Half Coefficient, Intraclass correlation and factor analysis were employed to test the consistency of the items in each sub-domain and the strength of their correlations. The lowest performing items on each sub-domain were removed and the statistical tests were rerun until a stable set of items remained that met the minimum criterion for inclusion.
- Collect data. A second wave of data collection was conducted using the revised scale items and a similar random sampling approach.
- Assess reliability. The same statistical measures used to purify the initial survey items were rerun to insure the consistency of the items in the second wave of data collection. Split-half reliability tests were run between the first and second wave of data to further test the reliability of these measures.
- Access validity. The hypotheses used to identify and define the initial constructs were validated by comparing correlations between the index and self-stated ratings of engagement, health care involvement and health insurance value, as well as hypothesized correlations with characteristics such as education level, health plan selection and health status. Furthermore, the engagement index survey was administered to a targeted group of health plan members so that claims data could be appended to results for all survey respondents. The claims data validated the overall construct of engagement as it relates to expenditures on preventive care and adherence to recommended care and treatment amongst those chronic conditions.
- Final index. A weighted average of the four constructs is used to calculate the final DSS Health Care Engagement Index™. Actual positive behaviors are assigned more weight than attitudes, knowledge or health literacy. The DSS Health Care Engagement Index™ contains 41 response items in its detailed form and 16 in its reduced form (R squared of 0.91 predicting detailed form score).
- Develop norms. Norms have been developed for the DSS Health Care Engagement Index™ by conducting multiple waves of data collection with large samples in each wave. The index is scaled from 0 to 100 for easy interpretation, with a normal distribution and an initial mean around 50 through the first few waves of data collection.
- Categorizing the index. The DSS Health Care Engagement Index™ was subdivided into various contiguous groups to determine the optimal number of categories and the break-points for each category or segment. Analyzing the distribution of the index and employing ANOVA and CHAID, the optimal break-points were determined to be around the 30th, 60th and 90th percentiles. These boundaries were adjusted slightly to produce four categories based on: 0 – 39, 40 – 59, 69 – 79 and 80 – 100 points on the DSS Health Care Engagement Index™.
 Gilbert A. Churchill, Jr., “A Paradigm for Developing Better Measures for Marketing Constructs,” Journal of Marketing Research, 16:1. (Feb., 1979), pp. 64-73.
Overall results for the DSS Health Care Engagement Index™ for the last 10 quarters are shown in the chart below. Each measurement is based on a national random sample of 800 adults. As one would expect, there has been little movement in the Index over these 10 quarters with all changes well within the range of sampling error (+/- 3.5% @ 95% confidence).
Results for selected demographic groups are shown in the four charts below.
- Age. Results by age are consistent across three of the four groups, with a noticeable dip in the 31-44 age group.
- Education. These results show a clear positive correlation with Engagement increasing consistently with education.
- Type of coverage. The uninsured are the least Engaged while those with commercial group coverage are the most.
- Income. Those with incomes <15K are the least Engaged. Engagement increases significantly for those with incomes in the $15K-$34.9K, stays the same for those $$35K-$74.9K and goes up significantly for those $75K or higher.
Future Blogs on Engagement
Future blogs on the DSS Health Care Engagement Index™ will provide more detail on relationships and provide case examples on how the Index has been used.