Abstract
This study explored possible success factors for passing the Certified Health Data Analyst Administration (CHDA) certification exam. According to the American Health Information Management Association (AHIMA), in 2019, only 10 percent of first-time test-takers passed the CHDA exam. Literature review offered insight into factors related to passing certification exams. Sources included existing, relevant peer-reviewed, and published literature since 1990 within 87 educational and health/medicine databases and 62 other articles and journal databases available at the University of South Dakota library. A correlational design was used in the study. Data was retrieved from AHIMA, cleaned, and data analysis was completed using binary logistic regression analysis. The CHDA study results indicate that candidates between ages 30 and 49 are less likely to pass the exam than those ages 50 and above, and those candidates with a master’s degree are more likely to pass the exam than those with an associate or bachelor’s degree. This new information will help improve the exam pass rates, provide a foundation for CHDA exam research, and add new knowledge in the HIM professional body of research.
Keywords: certification exam success factors, certified health data analyst, health information management
Introduction
The purpose of this study is to identify success factors for passing the Certified Health Data Analyst Administration (CHDA) exam. The CHDA credential has been available for 10 years and is intended to communicate the ability to effectively analyze healthcare data.1 It was developed to respond to the workforce needs of healthcare providers following the implementation of electronic health records (EHRs). Healthcare providers need to use large volumes of EHR data to make better decisions2,3 and are developing business intelligence departments to incorporate interactive dashboards and other data analytics reporting capabilities.4-7
Background
The healthcare data analyst role is pivotal in helping healthcare organizations use data in new ways (e.g., research).8-10 The analyst commonly works with interdisciplinary teams to solve problems using health information management (HIM) skills and familiarity with healthcare datasets. According to Spears,11 “the qualities of an excellent data analyst should include core competencies such as understanding relational databases; having knowledge of structured query language (SQL) and basic statistics; being able to tell the story of data through visualization techniques; understanding project management principles; and competencies including soft skills, such as curiosity, analytical thinking, flexibility, principled, passionate, and able to communicate effectively” (p. 36).
Literature Review
Predictors for passing certification HIM credentialing exams included cumulative grade point average (GPA), overall GPA, and course grades; while other disciplines studied additional factors of success, including completion of preparatory courses; age; grit; deliberately practicing; participating in a mentoring program; and GRE performance.12-23
The conceptual theoretical model for this study reflected the four unique characteristics of the advanced practice certification exam test-taker (Figure 1): prior work experience, current work setting, prior credentials and prior learning.
The HIM advanced practice certification exam model framework depicts the primary success factors tested during the study to determine impact on passing the CHDA certification exam. With there being no prior studies on the CHDA exam, the research team thought best to start at the point of data collection, the application to sit for the exam, to create a foundation for future studies.
Methodology
The study design was quantitative with an ex post facto, correlational approach.24 Data included 11 years of information that was collected from first-time test-takers on the American Health Information Management Association (AHIMA) CHDA certification exam from January 1, 2009, to December 31, 2019.
Data Collection
Upon approval by the University of South Dakota Institutional Review Board, the study began. Individual consent was not required for use of pre-existing, archival data. There were 1,032 first-time CHDA takers (January 1, 2009, through December 31, 2019) in the dataset. Cases with age 70 or greater were considered outliers by statistical and practical definition and were removed. Data from 214 cases were missing or unknown and were removed from the study during the data-cleaning process, with 818 cases used for data analysis.
Predictor variables included age, (current) highest education, prior credentials, (current) work setting, and (current) job category. The criterion variable was a dichotomous pass-or-fail result on the certification exam, which was also collected from AHIMA. Age was segmented into the following response categories: Less than 20; 20-29; 30-39; 40-49; and over 50.25
Data Analysis
Data analysis was carried out using the SPSS Grad Pack 26.0.26-28 Categorical variables were automatically re-coded to allow comparisons across all variables in the study in one block. Pass rates for each year were validated by comparison of published AHIMA reports. Descriptive statistics were created for each variable to include percent, valid and cumulative percent of responses for all years of combined data after data was cleaned. Data analysis continued with binary logistic regression.60,61 Regression coefficient estimates, model fit, confidence intervals, and odds ratios were calculated. The level of significance (α) for the study was set to 0.05; the power to detect an effect at 0.80, and a medium effect size of 0.5 was chosen prior to receipt of data. G*Power analysis showed that a sample of 721 students was required for the study to achieve the desired effect.29,30
Stepwise regression models were calculated to ensure the best fitting model was selected. The categorical study variables with multiple response levels were automatically recoded by SPSS26 to allow comparison across the study variables in one block. The Omnibus Test of Model Coefficients and Hosmer and Lemeshow Test results were compared. Classification tables were reviewed for all three models. The standard model indicated the highest predicted percentage correct (60.4 percent) for passing the exam with an overall correct prediction rate of 63.7 percent. The Hosmer and Lemeshow Test values for the standard regression model showed a good model fit, χ2(8, N = 818) = 4.369, p = .822. The -2 Log likelihood (1020.471a), Cox & Snell R-Square (.125), and Nagelkerke R-Square (.167) results indicated consistency with the standard model selection. Hypothesis testing of individual predictors followed model selection.
Results
Recall that we posited a relationship between first-time test-taker age and passing the CHDA certification exam. Logistic regression results are depicted in Table 1 and indicate that age category 30-39 results and age category 40-49 results were inversely significant. Individuals 30-49 years old were less likely to pass the exam compared with test-takers aged 50 and above.
Our second question considered the relationship between first-time test-taker highest educational degree and passing the CHDA certification exam. Results are shown in Table 2 and indicated
statistically significant inverse relationships for those who had a master’s degree. Test-takers with a master’s degree were more likely to pass the exam than those with an associate or baccalaureate degree.
The third question considered the relationship between first-time test-taker work setting and passing the CHDA certification exam. Analysis showed no relationship between passing the CHDA exam and the work setting of the test-takers compared to those who were unemployed (shown in Table 3). Those who were unemployed in the study were as likely to pass the exam as those working in any of the job settings evaluated.
The fourth question concerned the relationship between first-time test-taker additional credentials and passing the CHDA certification exam. The regression results for AHIMA credentials (CCA, CCS, CCS-P, CDIP, RHIT, CHPS, RHIA, CHTS-TS, CHTS-CP, CHTS-TR, CHTS-PW, CHTS-IM, CHTS-IS, and CPHI) as predictors of first-time success showed inversely significant results for participants who had the CCA credential. The results are shown in Table 4. Having an entry-level or advanced practice HIM credential did not increase the likelihood of passing the CHDA exam. Having the CCA credential decreased the likelihood of passing the exam.
Serendipitous Results
Job level category data was analyzed (see Table 5) to determine if there was a relationship between first-time test-taker current job level and passing the CHDA certification exam. Binary logistic regression showed no relationship to passing the CHDA exam. The job titles evaluated in the study, in comparison to those who were unemployed, showed that having a job in the HIM field did not increase the likelihood of passing the exam.
The probability of passing the CHDA exam was calculated based on the odds ratio and is shown in Table 6 for comparison with actual results. Based on the model accuracy rate of 63.7 percent, the probability for passing the exam was higher than the test-takers actually experienced. The test-takers with a doctorate degree were expected to be more likely to pass the exam than those with a master’s degree. Test-takers working in the HIM field were expected to be more likely to pass the exam than those who were unemployed. The test-takers with credentials including CCS, RHIA, CHTS-CP, CHTS-PW, CHTS-IS, and CPHI were expected to be more likely to pass the exam than the actual results experienced in the study.
Summary of Results
This study was conducted to identify success factors for passing the CHDA exam. In 2018, the pass rate for the CHDA certification exam was 26 percent. This study utilized a quantitative, ex post facto, correlational approach.31 Data included 11 years of information collected from first-time test-takers on the AHIMA CHDA certification exam from January 1, 2009, to December 31, 2019. The data was analyzed to discern factors for success on the CHDA exam.
While the amount of research conducted on the topic in the HIM field is limited, many disciplines have completed studies identifying factors for success consistent with HIM studies, including cumulative GPA; overall GPA; course grades; and completion of preparatory courses and frequent testing.32-34
Binomial logistic regression was used to explore the relationship between first-time examinee age, (current) highest educational degree, (current) work setting, and having additional credentials with passing the CHDA certification exam. Eligibility for the exam was modified at least one time during the years studied, with the associate degree having been removed from eligibility criteria by the Commission on Certification for Health Informatics and Information Management (CCHIIM). Current job category data was included in the data received from AHIMA and was included in data analysis, as well as several additional other HIM credentials for which exams have been discontinued. Highest educational degree, work setting, job category, and credentials variables included test-taker current information rather than information on date of the exam since the member database is always available for updates by members. The age variable was re-calculated by the research team to reflect the age at exam testing. The exam has been modified throughout the time frame of the data used for the study.
Results indicated that candidates between ages 30 and 49 were less likely to pass the exam compared to those age 50 and above. Those with the highest level of an associate or bachelors’ degree were less likely to pass the CHDA exam compared with those who held a master’s degree or above. Candidates that earned a CCA credential also had lower chances of passing the exam. Candidates current job level did not have a significant relationship with passing the exam compared with those who were unemployed.
Summary
Years of experience data for first-time test-takers was unavailable and may have revealed important information about the necessary amount and type of experience required to pass the exam. Having only an associate degree or bachelor’s degree appears to decrease the odds of passing the exam, indicating more education is required. There is question about the alignment of learning resources available to test-takers to learn exam content at the depth required on the exam.
The historically low pass rates on the CHDA exam may have limited the identification of statistically significant factors for exam success in this study. Fifty-four percent of first-time test-takers failed the exam during the 11-year study time frame. Higher pass rates may show statistically significant findings within the variables studied. Thus, a replication study including data with higher pass rates (70 percent) on the exam, consistent with AHIMA exam pass rates, may reveal additional predictors.
There is no prior research published on the CHDA exam, and a limited amount of research on HIM factors for success on credentialing exams that apply to an advance practice credentialing exam. Identified success factors important in passing exams for multiple disciplines included GPA, overall GPA, and having the experience of passing a critical exam prior to taking a certification exam. The CHDA exam is not directly associated with a specific educational degree or certificate program offered by universities, making the GPA and overall GPA variables irrelevant for this advanced practice credentialing exam.
As the pass rate on the exam increases, all aspects of the proposed conceptual framework model should be studied further for confirmation or modification and potential addition of other important factors. The study results confirmed that the exam is an advanced practice exam that requires a master’s degree or above education level, confirming the prior learning component of the proposed HIM advanced practice model is a significant indicator for passing the exam. The probability calculations for passing the exam indicate the advance practice model is accurate in identifying key factors for passing the CHDA exam even though test-taker results were different in this study.
With the low pass rates, the eligibility criteria for the CHDA exam should be re-evaluated to assure alignment with the workplace skill needs. Realignment may include restricting the exam to those candidates who have a master’s level education and above. An alternative strategy may be adjusting the exam questions and the psychometrics to provide those who meet current eligibility criteria with a higher likelihood of passing the exam. There is a need for additional support mechanisms by potential test-takers who are less than 50 years old or who have less education than a master’s degree. Internship opportunities, mentoring by those performing the job duties of a healthcare data analyst, and additional or adjusted exam preparation materials may need to be incorporated to support the growth of the health data analyst skill set needed by the workplace.
Future research should include a study of the amount and type of work experience needed for the health data analyst role including a better understanding of the variety of work settings hiring these professionals. With the changing healthcare environment, it is likely that the skills of a healthcare data analyst have changed drastically since implementation of EHRs. The content outline and support materials need to be analyzed to determine alignment with the CHDA exam and workforce needs. Additional topics may include the following list:
- Understanding the training tools and testing strategies utilized to successfully pass the exam.
- Understanding whether internships or on-the-job training have an impact on passing an advanced practice exam.
- Understanding the role, utilization, and impact of mentors.
- Determining whether having non-AHIMA credentials can increase the likelihood of passing the exam.
- Comparing jobs requiring the RHIA credential and health data analyst jobs to evaluate potential critical gaps in data analysis skills on the RHIA credentialing exam.
- Studying other variables to assess and modify the advanced practice framework model.
- Repeat the CHDA study in the future using data after 2019 to re-assess the exam pass rate predictions after adjustments to the exam and the psychometrics have been completed.
There appears to be a significant psychometric, cut score, or other issue evidenced by the extremely low pass rates on the CHDA exam that needs to be investigated further. The workforce is hiring health data analysts, so identifying the issue is critical to further the development of this credential. Ensuring alignment with the Registered Health Information Administrator (RHIA) exam data analytics content should ensure a foundation for skills development for passing the CHDA exam. The high probability that those individuals with the CCS credential and experience can pass the exam causes concern that the exam contains (or at one time contained) too much content focused on diagnosis coding and claims related data analysis questions rather than covering analysis of the entire healthcare record dataset. There is a very small percentage of AHIMA members with an HI/HIM master’s degree or a doctorate degree eligible for this exam. There is a gap between the exam eligibility criteria and the types of individuals that are able to pass the exam. It is important to expand the number of first-time test-takers to ensure it remains financially viable. While it is evident that experience is a requirement to pass the current exam, exactly how much remains unknown. A large portion of first-time test-takers included certified coders, Registered Health Information Technician (RHIT), and RHIA professionals, without success. Perhaps the content within those certification exams needs better alignment with the CHDA exam in order to prepare the foundation for advancement. Probability calculations show those with 50 percent or better probability for passing the exam have at least one of the following characteristics: experience in the HIM field; master’s degree; doctorate degree; CCS credential; or an RHIA credential. Eligibility criteria should be modified to better align with candidates that have a predicted probability of 50 percent or better for passing the exam. The eligibility criteria recommended to be removed until the exam has been revised includes the following: RHIT with three years of healthcare data experience.
Limitations
A limitation of the study may be unknown confounds. A future approach may include a qualitative component to identify these confounds. A second limitation may be the amount of time a test-taker has worked in a specific type of current work setting prior to the exam. A third limitation is the use of an ex post facto, correlational design through which causal relationships cannot be firmly asserted.35-38 A strategy for future study may be to utilize an experimental or mixed-methods design. However, ethical considerations may make this difficult, if not impossible. Researcher bias may impact the study by selecting six ex post facto variables from the first-time CHDA application without incorporating a qualitative component to the study to identify additional confounding success factors. An additional limitation in the study is receiving test-taker data updated by AHIMA members rather than data collected at the time of the first attempt from the test-taker. The sample size is not a limitation of the study. The sample includes data collected over an 11-year period to attain adequate study power.
The information gained in the research process is applicable only to the AHIMA CHDA certification exam and cannot be directly generalized to other HIM, healthcare, or education professional certification exams.
Notes
1. AHIMA. CHDA® Certification. Chicago: AHIMA, 2019. Accessed July 31, 2019. https://www.ahima.org/certification/CHDA.
2. Peltan, Ithan D., Sarah J. Beesley, and Samuel M. Brown. “Can big data deliver on its promises?—Leaps but not bounds.” JAMA Network Open 1, no. 8 (2018): e185694-e185694.
3. Wang, Yichuan, LeeAnn Kung, William Yu Chung Wang, and Casey G. Cegielski. “An integrated big data analytics-enabled transformation model: Application to health care.” Information & Management 55, no. 1 (2018): 64-79.
4. Classen, David, Michael Li, Suzanne Miller, and Drew Ladner. “An Electronic Health Record–Based Real-Time Analytics Program For Patient Safety Surveillance And Improvement.” Health Affairs 37, no. 11 (2018): 1805-1812.
5. Ghazisaeidi, Marjan, Reza Safdari, Mashallah Torabi, Mahboobeh Mirzaee, Jebraeil Farzi, and Azadeh Goodini. “Development of performance dashboards in healthcare sector: key practical issues.” Acta Informatica Medica 23, no. 5 (2015): 317.
6. Munevar, Steven. “Unlocking big data for better health.” Nature biotechnology 35, no. 7 (2017): 684-686.
7. Wilbanks, Bryan A., and Patsy A. Langford. “A review of dashboards for data analytics in nursing.” CIN: Computers, Informatics, Nursing 32, no. 11 (2014): 545-549.
8. Dooling, J. “The role of analyzing healthcare data: health data analysts aggregate, evaluate, and validate information for key healthcare stakeholders.” Journal of AHIMA 85, no. 5 (2014): 54-55.
9. Schneider, Johannes, Joshua Peter Handali, and Jan vom Brocke. “Increasing trust in (big) data analytics.” In International Conference on Advanced Information Systems Engineering, pp. 70-84. Springer, Cham, 2018.
10. Spears, Amanda. “Qualities of an Excellent Healthcare Data Analyst.” Qualities of an Excellent Healthcare Data Analyst/AHIMA, American Health Information Management Association (2018).
11. Spears, Amanda. “Qualities of an Excellent Healthcare Data Analyst.” Qualities of an Excellent Healthcare Data Analyst/AHIMA, American Health Information Management Association (2018).
12. Atsawarungruangkit, Amporn. “Relationship of residency program characteristics with pass rate of the American Board of Internal Medicine certifying exam.” Medical education online 20, no. 1 (2015): 28631
13. Bedno, Sheryl A., Michele A. Soltis, James D. Mancuso, Daniel G. Burnett, and Timothy M. Mallon. “The in-service examination score as a predictor of success on the American Board of Preventive Medicine certification examination.” American Journal of Preventive Medicine 41, no. 6 (2011): 641-644.
14. Beeman, Pamela Butler, and Julie Keith Waterhouse. “NCLEX-RN performance: Predicting success on the computerized examination.” Journal of Professional Nursing 17, no. 4 (2001): 158-165.
15. Bruce, Scott L. “Prediction modeling for graduate athletic training education programs.” (2014).
16. Bruce, Scott L., Elizabeth Crawford, Gary B. Wilkerson, David Rausch, R. Barry Dale, and Martina Harris. “Prediction modeling for academic success in professional master’s athletic training programs.” Athletic Training Education Journal 11, no. 4 (2016): 194-207.
17. Desmarais, Linda, Margaret A. Woble-Valenski, and Eric Oestmann. “Factors influencing physical therapist assistant licensure examination success.” Journal of Physical Therapy Education 25, no. 2 (2011): 36-41.
18. Dolezel, Diane, and Alexander McLeod. “The Odds of Success: Predicting Registered Health Information Administrator Exam Success.” Perspectives in Health Information Management 14, no. Winter (2017).
19. Esparza, Shandra Dawn. Predictors of success on professional credentialing examinations of athletic training undergraduates. Walden University, 2012.
20. Farroll, Jennifer C. “Grit, deliberate practice, and athletic training education: Factors that determine board of certification exam success.” PhD diss., Union University, 2016.
21. Kain, Karen. “Determining characteristics that increase success on the national asthma educator certification exam.” (2010).
22. Krieger, Oscar H. Cognitive Development, Motivation, and Grade Point Average as Predictors of Success on the Board of Certification Exam for Athletic Trainers. Aurora University, 2014.
23. Novalis, Sharon D., Jill M. Cyranowski, and Cathy D. Dolhi. “Passing the NBCOT examination: Preadmission, academic, and fieldwork factors.” The Open Journal of Occupational Therapy 5, no. 4 (2017): 9.
24. Paul D.. Leedy, and Jeanne Ellis Ormrod. Practical research: Planning and design. Pearson Education, 2016.
25. Dolezel, Diane, and Alexander McLeod. “The Odds of Success: Predicting Registered Health Information Administrator Exam Success.” Perspectives in Health Information Management 14, no. Winter (2017).
26. Cronk, Brian C. How to use SPSS®: A step-by-step guide to analysis and interpretation. Routledge, 2019.
27. Green, S. B., and N. J. Salkind. “Using SPSS for Windows and Macintosh, books a la carte.” Pearson 2 (2016): 3.
28. Howell, D. C. “Fundamental statistics for the behavioral sciences Boston.” MA: Cengage Learning (2017).
29. Faul, Franz, Edgar Erdfelder, Axel Buchner, and Albert-Georg Lang. “Statistical power analyses using G* Power 3.1: Tests for correlation and regression analyses.” Behavior research methods 41, no. 4 (2009): 1149-1160.
30. Faul, Franz, Edgar Erdfelder, Albert-Georg Lang, and Axel Buchner. “G* Power 3: A flexible statistical power analysis program for the social, behavioral, and biomedical sciences.” Behavior research methods 39, no. 2 (2007): 175-191.
31. Paul D.. Leedy, and Jeanne Ellis Ormrod. Practical research: Planning and design. Pearson Education, 2016.68.
32. Dolezel, Diane, and Alexander McLeod. “The Odds of Success: Predicting Registered Health Information Administrator Exam Success.” Perspectives in Health Information Management 14, no. Winter (2017).
33. McNeill, Marjorie H., and Lantry L. Brockmeier. “Relationships between academic program variables and success on the registered health information administrator certification examination.” Perspectives in Health Information Management/AHIMA, American Health Information Management Association 2 (2005).
34. Ibid.
35. Howell, D. C. “Fundamental statistics for the behavioral sciences Boston.” MA: Cengage Learning (2017).
36. Oachs, Pamela K., and Amy Watters, eds. Health information management: Concepts, principles, and practice. Chicago, IL: AHIMA, 2016.
37. Salkind, Neil J., and Bruce B. Frey. Statistics for people who (think they) hate statistics. Sage Publications, Incorporated, 2016.
38. Simon & Goes. Ex post facto research. Dissertation and Scholarly Research: Recipes for Success. Seattle, WA: Dissertation Success LCC, 2013.
39. Spohn, R. (2020). Factors Associated with Successfully Passing Health Information Certification Exams (Doctoral dissertation, University of South Dakota).
Author Biographies
Renae Spohn, PhD, MBA, RHIA, CPHI, CPHQ, FAHIMA, FNAHQ, is the director of HIM programs and coordinator of the MSHIIM Program at Dakota State University.
William Schweinle III, PhD, is a biostatistician professor at the University of South Dakota.
Patti Berg-Poppe, PhD, is a chair and physical therapy professor at the University of South Dakota.
Carole South-Winter, EdD, is an assistant professor at the University of South Dakota.
David DeJong, EdD, is the division chair of educational leadership at the University of South Dakota.