Population and Sampling Specifications
Introduction
Population
Defining the population is the first step to estimate a hospital's performance. A population is generally defined as a collection of patients sharing a common set of universally measured characteristics, such as an ICD-10-CM Principal Diagnosis Code or ICD-10-PCS Procedure Code or CPT® Code (For Outpatients only). The Initial Patient Population and diagnosis codes meet this description for the national quality measures. For the purpose of measuring national quality measures, the term “Initial Patient Population” is defined below:
- An “Initial Patient Population” refers to all patients (Medicare and non-Medicare) who share a common set of specified, administratively derived data elements. This may include ICD-10-CM Diagnosis Codes or other population characteristics such as age. For example, the population for the HBIPS discharge measures (e.g., HBIPS-1 and 5) includes all patients having a principal or secondary psychiatric diagnosis code from Appendix A, Table 10.01.
Cases identified as being in the Initial Patient Population for the measure set, or strata (e.g., HBIPS), or Sub-Population (e.g. CSTK) or sampling group (e.g., PC-Mother and Exclusive Breast Milk Feeding measure in PC-Newborns sub-populations) are eligible to be sampled. For the definition of the Initial Patient Population(s) for each measure set, refer to the appropriate Initial Patient Population discussion in the Measure Information section of this manual.
Sampling
Sampling is a process of selecting a representative part of a population in order to estimate the hospital's performance, without collecting data for its entire population. Using a statistically valid sample, a hospital can measure its performance in an effective and efficient manner. Sampling is a particularly useful technique for performance measures that require primary data collection from a source such as the medical record. Sampling should not be used unless the hospital has a large number of cases in the Initial Patient Population because a fairly large number of sample cases are needed to achieve a representative sample of the population. For the purpose of sampling national quality measures, the terms “sample” and “case” are defined as below:
- The “sample” is the fraction of the population that is selected for further study.
- A “case” refers to a single record (or an episode of care [EOC] or event) within the population. For example, during the first quarter a hospital may have 100 patients who had principal or secondary psychiatric diagnosis code associated to the HBIPS-1 and HBIPS-5 measures. The hospital's Initial Patient Population would include 100 cases or 100 patient records for these measures during the first quarter.
To obtain statistically valid sample data, the sample size should be carefully determined and the sample cases should be randomly selected in such a way that the individual cases in the population have an equal chance of being selected. Only when the sample data truly represent the whole population can the sample-based performance measure data be meaningful and useful.
Each hospital is ultimately responsible that sampling techniques applied for their hospital adhere to the sampling requirements outlined in this manual.
Sampling is done by national quality inpatient measure set; however, for Perinatal Care (PC), Stroke (STK) Comprehensive Stroke (CSTK), and Hospital-Based Inpatient Psychiatric Services (HBIPS) are done by strata, sub-population or sampling group. For measures requiring medical record abstraction, sampling must be done using available databases that contain all discharges for the method of sampling being used (i.e, monthly versus quarterly).
Notes:
- Hospitals are NOT required to sample their data. If sampling offers minimal benefit (e.g., a hospital has 80 cases for the quarter and must select a sample of 76 cases) the hospital may choose to use all cases.
- The exemption for not submitting patient-level data when the hospital has five or fewer discharges that fit the denominator criteria for the calendar quarter is no longer applicable for chart-abstracted measures as hospitals are only submitting aggregate data. Hospitals are required to submit aggregate measure data applicable to their patient population and services offered to meet ORYX® Performance Measurement Requirements.
Order of Data Flow
The sampling methodology defined in the
Specifications Manual for Joint Commission National Quality Measures encourages hospitals submitting data for any measure set, except HBIPS, that utilizes the Global Initial Patient Population to use the associated sampling methodology for all measure sets being submitted.
- If the hospital is submitting data to The Joint Commission:
- If the hospital is submitting at least one measure set that uses the Global Initial Patient Population, use sampling methodology number one.
- If the hospital is not submitting any of the measure sets that uses the Global Initial Patient Population, sample each measure set independently using sampling methodology number two.
- If the hospital is submitting HBIPS, sample independently using sampling methodology number two
1. Hospitals Submitting Measure Sets Under the Global Initial Patient Population
For the submission of the Global Initial Patient Population and associated measure sets (i.e., ED, IMM, TOB, and/or SUB) the following data flow or process steps should be used to identify the data for all measure sets or stratum that are being aggregated and submitted to the Joint Commission, including PC, however excluding HBIPS. These process steps are:
Identify Global Cases To Be Abstracted (ED, IMM, SUB, TOB)
- Identify the Global Initial Patient Population. The Global Initial Patient Population is used for the ED, IMM, TOB, and SUB measure sets. This data pull utilizes administrative data such as admission date and discharge date. This identification process must be completed prior to the application of data integrity filter, measure exclusions, and the application of sampling methodology. For specific Global Initial Patient Population definitions, refer to the Global Initial Patient Population in this manual. This data pull is completed once for each hospital. This is not performed for each measure set that utilizes the Global population.
- If the hospital is sampling, use the Global Initial Patient Population identified above and pull the sample of medical records for the ED, IMM, TOB, and/or SUB measure sets using the Sample Size Requirements defined in the Global Initial Patient Population section in this manual.
- Collect or abstract from the identified medical records the general and measure specific data elements that are needed for the measure set. Run the data through the algorithms for the measure sets under the Global Initial Patient Population (ED, IMM, SUB and/or TOB). The count of the number of cases used in this step is collected in the Global Initial Patient Population and Sample Size data elements.
- If the hospital is only submitting the measure sets under the Global Initial Patient Population (i.e., ED, IMM, SUB or TOB), the sampling process is complete.
Identify Cases To Be Abstracted For The Remaining Measure Sets, Strata, and Sub-populations (PC, STK, VTE, CSTK, ASR)
- Identify the Initial Patient Population for the other measure sets, strata or sub-populations (PC, STK, VTE, CSTK, ASR). This data pull utilizes administrative data such as ICD-10-CM Diagnosis Codes and ICD-10-PCS Procedure Codes, admission date, and birthdate. All ICD-10-CM Diagnosis Codes and ICD-10-PCS Procedure Codes included in the Initial Patient Population definition must be applied. This identification process must be completed prior to the application of data integrity filter, measure exclusions, and the application of sampling methodology. For Initial Patient Population discussion of any of the measure sets, refer to the Measure Information section of this manual. The number of cases in the Initial Patient Population of each measure set, strata, and sub-population are collected in the appropriate Initial Patient Population Size data elements.
- If the hospital is not sampling, collect or abstract from the identified medical records the general and measure specific data elements that are needed for the measure set(s), strata or sub-populations. The count of the number of cases used in this step is collected in the Sample Size data elements.
- If the hospital is sampling, use the Initial Patient Population (N) identified above and pull the sample of medical records for the measure set, strata or sub-population using the “Sample Size Requirements” in each of the measures sets in the Measure Information section.
- Using the Global Initial Patient Population identified above, identify and count the number of cases that are also in the other Measure Sets, strata, or sub-populations (e.g., PC, STK or VTE, CSTK, ASR) Initial Patient Population(s). Determine the number of cases that need to be sampled (n) from the cases in the other measure set(s) or stratum(s) Initial Patient Population (N). Use the “Sample Size Requirements” in the appropriate sampling discussion in the Measure Information section of this manual.
- If there are enough Initial Patient Population cases in the Global sample pull to meet the specific initial patient population and sampling requirements for the measure set(s), strata, or sub-populations, then no additional sampling is required. Collect or abstract from the identified medical records the general and measure specific data elements that are needed for the measure set(s), strata, or sub-populations. The count of the number of cases used in this step is collected in the Sample Size data elements.
- If there are not enough Initial Patient Population cases in the Global sample pull to meet the specific initial patient population and sampling requirements for the measure set(s), strata or sub-populations, complete the sample by pulling additional cases from the other measure set(s), strata or sub-populations Initial Patient Population(s). Use the “Sample Size Requirements” in the appropriate Sampling discussion in the Measure Information section of each measure set. Collect or abstract from the identified medical records the general and measure specific data elements that are needed for the measure set(s). The count of the number of cases used in this step is collected in the Sample Size data elements.
Example:
For 4th quarter the Global Initial Patient Population is 1550, 250 for PC-Mothers, and 300 for PC-Newborns sub-populations. If the hospital is sampling, the minimum number of cases that would be required to be sampled would be 306 for Global (ED, IMM, TOB, and/or SUB), 75 for PC-Mothers, and 37 for Exclusive Breast Milk Feeding cases from PC-Newborns sub-populations.
The hospital would pull 306 cases for the Global sample. From those 306 cases the hospital would determine how many of those cases were also in PC-Mothers, or from PC-Newborns sub-populations cases that met the initial patient population criteria for the specific measure set. If there are enough PC-Mothers, and PC-Newborns cases in the Global sample pull to meet the minimum sampling requirements for those measure sets, then no additional sample pull is needed.
If there are not enough cases in the Global sample pull to meet the other measure sets minimum sampling requirements then an additional sample pull is needed. For example, from the Global sample pull there were 20 PC-Mothers, and 5 PC-Newborns cases identified that met the initial population criteria for the specific measure set. As the minimum sample requirements for PC-Mothers is 75, an additional 55 cases would need to be pulled from the PC-Mothers Initial Patient Population. As the minimum sample requirements for Exclusive Breast Milk Feeding measure is 37, an additional 32 cases would need to be pulled from the PC-Newborns Initial Patient Population.
Note: PC-Newborns with Unexpected Complications, ASR-IP and ASR-OP populations, HBIPS-event and STK-OP are not eligible for sampling and will use the entire Initial Patient sampling group, as appropriate, for reporting.
2. Hospitals Submitting HBIPS or Hospitals Not Submitting the Measure Sets Under the Global Initial Patient Population to The Joint Commission
For hospitals submitting HBIPS or hospitals not submitting the measure sets under the Global Initial Patient Population to The Joint Commission, an independent sample pull should be used to pull the sample for the applicable measure sets (e.g., PC, HBIPS, STK, VTE).
Each measure set, stratum, or sub-population has a unique definition of Initial Patient Population and sample size requirement. However, the same data flow or process steps can be used to identify the data that is aggregated and submitted to the Joint Commission. These process steps are:
- First, identify the Initial Patient Population for the measure set. An Initial Patient Population is defined for each measure set, stratum, and sampling group and the count is collected in the Initial Patient Population Size data elements.
All data elements in the appropriate Initial Patient Population definition, including ICD-10-CM Diagnosis Codes when appropriate, must be applied. This identification process must be completed prior to the application of data integrity filter, measure exclusions, and the application of sampling methodology.
For specific measure set, stratum, and sampling group definitions, refers to the appropriate Initial Patient Population discussion in the Measure Information section.
- Second, if the measure allows sampling and the hospital is sampling, use the Initial Patient Population identified above and pull the sample of medical records for each measure set, stratum, or sub-population using the Sample Size Requirements defined in the appropriate Measure Information section.
- Third, collect or abstract from the identified medical records the general and measure specific data elements that are needed for the measure set. The count of the number of cases used in this step is collected in the Sample Size data elements.
- If the hospital is not sampling, use the medical records identified in the first data pull.
- If the measure allows sampling and the hospital is sampling, use the medical records from the cases in the identified sample.
Sample Size Requirements
Hospitals that choose to sample have the option of sampling quarterly or sampling monthly. The sample size requirements for each of these options are described in turn. Hospitals need to use the next highest whole number when determining their required sample size. See below for rounding examples. For each measure sets sample size requirements, refer to the appropriate measure set's Measure Information section in this manual.
Hospitals selecting sample cases for measure sets that are not stratified must ensure that its Initial Patient Population(s) and sample size(s) meet the conditions stated in the measure set's Sample Size Requirements.
For hospitals selecting sample cases for stratified measure sets or measure sets with sampling groups (e.g., HBIPS, CSTK, ASR and PC), a modified sampling procedure is required. Hospitals selecting samples cases for these sets must ensure that each individual stratum's Population/sampling group and sample size meets the conditions stated in the measure set's Sample Size Requirements.
Regardless of the option used, hospital samples must be monitored to ensure that sampling procedures consistently produce statistically valid and useful data. Due to exclusions and contraindications, hospitals selecting sample cases MUST process AT LEAST the minimum required sample size. The sample size tables for each option automatically build the number of cases needed to obtain the required sample sizes.
Hospitals that sample, should sample by their Joint Commission's
Health Care Organization Identifier. All data that are sampled must be processed against the measure submitted to The Joint Commission.
A hospital may choose to use a larger sample size than is required. Hospitals whose Initial Patient Population size is less than the minimum number of cases per quarter/month for the stratum cannot sample. For the Discharge measures (e.g., HBIPS-1, 5 and PC), hospitals that have five or fewer discharges (both Medicare and non-Medicare combined) are not required to process the patient level data against the measure. For the event measures (e.g., HBIPS-2, and 3), hospitals must process the patient level data regardless of the number of discharges or events they have each quarter. Refer to the Sample Size Requirement tables provided in the Measure Information section to determine the minimum number of cases that need to be sampled for each HBIPS, CSTK, ASR measure sets.
Quarterly Sampling Examples
Quarterly Example 1: Measure set is Not Stratified
Hospitals selecting sample cases for measure set ABC, which is not stratified, must ensure that its Initial Patient Population and quarterly sample size meet the following conditions:
Quarterly Sample Size
Based on Initial Patient Population for the ABC Measure set
Hospital's Measures |
Average Quarterly Initial Patient Population “N” |
Minimum Required Sample Size “n” |
≥ 1551 |
311 |
391 - 1550 |
20% of the Initial Patient Population |
78-390 |
78 |
6 - 77 |
No sampling; 100% of the Initial Patient Population is required |
0 - 5 |
Patient level data must be processed in order to submit your aggregate data. Submission of aggregate data is still required. The required quarterly sample size would be 100% of the patient population or 5 cases for the quarter. |
Examples
- A hospital's ABC Initial Patient Population is 77 patients during the first quarter. Using the above table, no sampling is allowed — 100% of the population is required.
- A hospital's ABC Initial Patient Population is 100 patients during the second quarter. Using the above table, the required sample size is seen to be a minimum of 78 ABC patients for this quarter.
- A hospital's ABC Initial Patient Population is 401 patients during the third quarter. Using the above table, the required sample size is seen to be 20% of the population, or 81 cases for the quarter (twenty percent of 401 equals 80.2 rounded to the next whole number = 81).
- A hospital's ABC Initial Patient Population is 5 patients during the first quarters. Using the above table, processing patient level data is required to allow for submission of aggregate data. The required quarterly sample size would be 100% of the patient population or 5 cases for the quarter.
Quarterly Example 2: Measure set is stratified
For hospitals selecting sample cases for measure set XYZ which contains 8 strata, a modified sampling procedure is required. Hospitals selecting sample cases for these sets must ensure that each individual stratum's population and quarterly sample size meets the following conditions.
- Select within each of the seven individual measure stratum and the 8th XYZ stratum.
Quarterly Sample Size
Based on Initial Patient Population for the XYZ measure set
Hospital's Measures |
Average Quarterly Stratum Initial Patient Population “N” |
Minimum Required Stratum Sample Size “n” |
≥ 471 |
48 |
161 - 470 |
10% of the Initial Patient Population |
16 - 160 |
16 |
< 16 |
No sampling; 100% of the Initial Patient Population is required |
Example
- The XYZ Initial Patient Population sizes for a hospital are 5, 50, 15, 140, 35, 201, 3, and 481 patients respectively per stratum for the quarter. Since the total Initial Patient Population for XYZ is 930, the hospital must process patient level data. The required quarterly sample sizes for each stratum would be 5, 16, 15, 16, 16, 21, 3, and 48.
- The 1st, 3rd, and 7th strata are less than the minimum required quarterly sample size, so 100% of each of these strata are sampled.
- The 2nd, 4th, and 5th strata each require 16 cases to be sampled.
- The 6th stratum has 201 patients per quarter, which requires a 10% sample size, or 21 cases (twenty percent of 201 equals 20.1 rounded to the next whole number = 21).
- The 8th stratum is more than the maximum required quarterly sample size, so this stratum requires 48 cases to be sampled.
- The XYZ Initial Patient Population sizes for a hospital 1, 1, 0, 0, 1, 0, 1, and 1 patients respectively per stratum for the quarter. Since the total Initial Patient Population for XYZ is 5, the hospital may choose to not process patient level data. If the hospital chooses to process patient level data, the required quarterly sample sizes for each stratum would be 1, 1, 0, 0, 1, 0, 1, and 1.
- The 1st, 2nd, 5th, 7th, and 8th strata are less than the minimum required quarterly sample size, so 100% of each of these strata are sampled.
- There is no data to sample for the 3rd, 4th, and 6th strata.
Quarterly Example 3: Measure set has sub-populations
For hospitals selecting sample cases for measure set DEF which contains 3 independent sub-populations a modified sampling procedure is required. The three sub-populations must be sampled independently from each other.
1-Hospitals selecting sample cases for sub-population 1 must ensure that the Initial Patient Population and sample size for the sub-population 1 meet the following conditions:
Quarterly Sample Size
Based on Initial Patient Population for the Patient Sub-Population 1
Hospital's Measures |
Average Quarterly Initial Patient Sub-Population Size “N” |
Minimum Required Sub-Population Sample Size “n” |
≥ 896 |
180 |
226 - 895 |
20% of the Initial Patient Population Size |
45 - 225 |
45 |
< 45 |
No sampling; 100% of the Initial Patient Population required |
2 - Hospitals selecting sample cases for sub-population 2 must ensure that the initial Patient Population and sample size for sub-population 2 meet the following conditions:
Quarterly Sample Size
Based on Initial Patient Population Size for the
Patient Sub-Population 2
Hospital's Measures |
Average Quarterly Initial Patient Sub-Population Size “N” |
Minimum Required Sub-Population Sample Size “n” |
≥ 1796 |
360 |
451 - 1795 |
20% of the Initial Patient Population |
90 - 450 |
90 |
< 90 |
No sampling; 100% of the Initial Patient Population required |
3 - Sub-population 3
is not eligible for sampling and will use the entire Initial Patient Population for reporting.
Example
1. Quarterly sampling for sub-population 1:
- A hospital's sub-population 1 is 752 during the second quarter. Using the quarterly sampling table for sub-population 1, the sample size required is 20% of this sub-population, or 151 cases for the quarter (twenty percent of 752 equals 150.4 rounded up to the next whole number = 151).
- A hospital's sub-population 1 is 5 during the first quarter. Using the quarterly sampling table for sub-population 1, the sample size is less than the minimum required quarterly sample size, so 100% of this sub-population is sampled.
- A hospital's sub-population 1 is 99 during the third quarter. The required quarterly sample is 45 cases.
2. Quarterly sampling for sub-population 2:
- A hospital's sub-population 2 is 511 during the second quarter. Using the quarterly sampling table for sub-population 2, the sample size required is 20% of this sub-population, or 103 cases for the quarter (twenty percent of 511 equals 102.2 rounded up to the next whole number = 103).
- A hospital's sub-population 2 is 3 during the first quarter. Using the quarterly sampling table for sub-population 2, the sample size is less than the minimum required quarterly sample size, so 100% of this sub-population is sampled.
- A hospital's sub-population 2 is 300 during the third quarter. The required quarterly sample is 90 cases.
3. Quarterly sampling for sub-population 3:
- Sub-population is not eligible for sampling and will use the entire initial Patient Sub-Population for reporting.
Quarterly Example 4: Measure set has Sampling Groups
For hospitals selecting sample cases for measure set HGI which contains 3 independent sampling groups a modified sampling procedure is required. The three sampling groups are sampled independently from each other. A patient falls into multiple sampling groups but may not actually be sampled for all the groups for which the patient is eligible.
1-Hospitals selecting sample cases for sampling group 1 must ensure that the Initial Patient Population and sample size for the sampling group 1 meet the following conditions:
Quarterly Sample Size
Based on Initial Patient Population Size for the
Patient Sampling Group 1
Hospital's Measures |
Average Quarterly Initial Patient Sampling Group Size “N” |
Minimum Required Sampling Group Sample Size “n” |
≥ 801 |
161 |
201 - 800 |
20% of the Initial Patient Population Size |
40 - 200 |
40 |
< 40 |
No sampling; 100% Initial Patient Population required |
2 - Hospitals selecting sample cases for sampling group 2 must ensure that the initial Patient Population and sample size for the sampling group 2 meet the following conditions:
Quarterly Sample Size
Based on Initial Patient Population Size for the
Patient Sampling Group 2
Hospital's Measures |
Average Quarterly Initial Patient Sampling Group Size “N” |
Minimum Required Sampling Group Sample Size “n” |
≥ 2001 |
401 |
501 - 2000 |
20% of the Initial Patient Population |
100 - 500 |
100 |
< 100 |
No sampling; 100% Initial Patient Population required |
3 - Hospitals selecting sample cases for sampling group 3 must ensure that the Initial Patient Population and sample size for the sampling group 3 meet the following conditions:
Quarterly Sample Size
Based on Initial Patient Population Size for the
Patient Sampling Group 3
Hospital's Measures |
Average Quarterly Initial Patient Sampling Group Size “N” |
Minimum Required Sampling Group Sample Size “n” |
≥ 2001 |
401 |
501 - 2000 |
20% of the Initial Patient Population |
100 - 500 |
100 |
< 100 |
No sampling; 100% Initial Patient Population required |
Example
- A Hospital's sampling group 1 size 347 during the second quarter. The required sample size is 20% of the patient population or 70 cases for the quarter (twenty percent of 347 equals 69.4 rounded up to the next highest whole number is 70.)
- A Hospital's sampling group 2 size is 250 patients during the second quarter. The required sample size is seen to be 100 patients for this quarter.
- A Hospital's sampling group 3 size is 700 patients during the second quarter. The required sample size is seen to be 140 patients for this quarter.
Monthly Sampling Examples
Monthly Example 1: Measure set is Not Stratified
Hospitals selecting sample cases for ABC measure set must ensure that its Initial Patient Population and effective monthly sample size meet the following conditions:
Monthly Sample Size
Based on Initial Patient Population for the ABC measure set
Hospital's Measures |
Average Monthly Initial Patient Population “N” |
Minimum Required Sample Size “n” |
≥ 516 |
104 |
131 — 515 |
20% of the Initial Patient Population |
26 — 130 |
26 |
< 26 |
No sampling; 100% of the Initial Patient Population is required |
Examples
- A hospital's ABC Initial Patient Population is 25 patients during January. Using the above table, no sampling is allowed — 100% of the population is required.
- A hospital's ABC Initial Patient Population is 130 patients during February. Using the above table, the required sample size is seen to be a minimum of 26 ABC patients for this month.
- A hospital's ABC Initial Patient Population is 301 patients during March. Using the above table, the required sample size is seen to be 20% of the population, or 61 cases for the month (twenty percent of 301 equals = 60.2 rounded to the next whole number = 61.
- A hospital's ABC Initial Patient Population is 516 patients during April. Using the above table, the required sample size is seen to be a minimum of 104 ABC patients for this month.
Monthly Example 2: Measure set is Stratified
For hospitals selecting sample cases for the XYZ measure set, a modified sampling procedure is required. Hospitals selecting sample cases for this set must ensure that each individual strata population and effective monthly sample size meets the following conditions:
- Select within each of the seven individual measure stratum and the 8th XYZ stratum.
Monthly Sample Size
Based on Initial Patient Population for the XYZ measure set
Hospital's Measures |
Average Monthly Stratum Initial Patient Population “N” |
Minimum Required Stratum Sample Size “n” |
≥ 151 |
16 |
61 - 150 |
10% of the Initial Patient Population |
6 - 60 |
6 |
< 6 |
No sampling; 100% of the Initial Patient Population is required |
Example
- The XYZ Initial Patient Population sizes for a hospital are 5, 50, 15, 141, 35, 201, 3, and 481 patients respectively in June. The required monthly sample sizes would be 5, 6, 6, 15, 6, 16, 3, and 16.
- The 1st and 7th strata are less than the minimum required monthly sample size, so 100% of each of these strata is sampled.
- The 2nd, 3rd, and 5th strata each require 6 cases to be sampled.
- The 4th stratum has 141 patients per month, which requires a 10% sample size, or 15 cases (twenty percent of 141 equals 14.1 rounded to the next whole number = 15).
- The 6th and 8th strata are each more than the maximum required monthly sample size, so this stratum requires 16 cases to be sampled.
Monthly Example 3: Measure set has sub-populations
For hospitals selecting sample cases for measure set DEF which contains 3 independent sub-populations a modified sampling procedure is required. The three sub-populations must be sampled independently from each other.
1 - Hospitals selecting sample cases for sub-population 1 must ensure that the Initial Patient Population and sample size for sub-population and sample size for sub-population 1 meet the following conditions:
Monthly Sample Size
Based on Initial Patient Population Size for the
Patient Sub-Population 1
Hospital's Measures |
Average Monthly Initial Patient Sub-Population Size “N” |
Minimum Required Sub-Population Sample Size “n” |
≥ 296 |
60 |
76 - 295 |
20% of the Initial Patient Population |
15 - 75 |
15 |
< 15 |
No sampling; 100% of the Initial Patient Population is required |
2 - Hospitals selecting sample cases for sub=population 2 must ensure that the Initial Patient Population and sample size for sub-population and sample size for sub-population 2 meet the following conditions:
Monthly Sample Size
Based on Initial Patient Population Size for the
Patient Sub-Population 2
Hospital's Measures |
Average Monthly Initial Patient Sub-Population Size “N” |
Minimum Required Sub-Population Sample Size “n” |
≥ 596 |
120 |
151 - 595 |
20% of the Initial Patient Population |
30 - 150 |
30 |
< 30 |
No sampling; 100% of the Initial Patient Population is required |
3 - Sub-population 3
is not eligible for sampling and will use the entire Initial Patient Sub-Population for reporting.
Example
1. Monthly sampling for sub-population 1:
- A hospital's sub-population 1 is 81 during March. Using the monthly sampling table for sub-population 1, the sample size required is 20% of this sub-population, or 17 cases for the month (twenty percent of 81 equals 16.2 rounded up to the next whole number = 17).
- A hospital's sub-population 1 is 5 during February. Using the monthly sampling table for sub-population 1, the sample size is less than the minimum required monthly sample size, so 100% of this sub-population is sampled.
- A hospital's sub-population 1 is 45 during January. The required monthly sample is 15 cases.
2. Monthly sampling for sub-population 2:
- A hospital's sub-population is 387 during March. Using the monthly sampling table for sub-population 2, the sample size required is 20% of this sub-population, or 78 cases for the month (twenty percent of 387 equals 77.4 rounded up to the next whole number = 78).
- A hospital's sub-population 2 is 3 during February. Using the monthly sampling table for sub-population 2, the sample size is less than the minimum required monthly sample size, so 100% of this sub-population is sampled.
- A hospital's sub-population 2 is 47 during January. The required monthly sample is 30 cases.
3. Monthly sampling for sub-population 3:
- Sub-population 3 is not eligible for sampling and will use the entire initial Patient Sub-Population for reporting.
Monthly Example 4: Measure set has Sampling Groups
1 - Hospitals selecting sample cases for sampling group 1 must ensure that the Initial Patient Population and sample size for the sampling group 1 meet the following conditions:
Monthly Sample Size
Based on Initial Patient Population Size for the
Patient Sampling Group 1
Hospital's Measures |
Average Monthly Initial Patient Sampling Group Size “N” |
Minimum Required Sampling Group Sample Size “n” |
≥ 201 |
41 |
51 - 200 |
20% of the Initial Patient Population Size |
10 - 50 |
10 |
< 10 |
No sampling; 100% Initial Patient Population required |
2 - Hospitals selecting sample cases for sampling group 2 must ensure that the initial Patient Population and sample size for the sampling group 2 meet the following conditions:
Monthly Sample Size
Based on Initial Patient Population Size for the
Patient Sampling Group 2
Hospital's Measures |
Average Monthly Initial Patient Sampling Group Size “N” |
Minimum Required Sampling Group Sample Size “n” |
≥ 501 |
101 |
126 - 500 |
20% of the Initial Patient Population |
25 - 125 |
25 |
< 25 |
No sampling; 100% Initial Patient Population required |
3 - Hospitals selecting sample cases for sampling group 3 must ensure that the Initial Patient Population and sample size for the sampling group 3 meet the following conditions:
Monthly Sample Size
Based on Initial Patient Population Size for the
Patient Sampling Group 3
Hospital's Measures |
Average Monthly Initial Patient Sampling Group Size “N” |
Minimum Required Sampling Group Sample Size “n” |
≥ 501 |
101 |
126 - 500 |
20% of the Initial Patient Population |
25 - 125 |
25 |
< 25 |
No sampling; 100% Initial Patient Population required |
Example
1. Monthly sampling for sampling group 1:
- A hospital's sampling group 1 is 81 during March. Using the monthly sampling table for sampling group 1, the sample size required is 20% of this sampling group, or 17 cases for the month (twenty percent of 81 equals 16.2 rounded up to the next whole number = 17).
- A hospital's sampling group 1 is 5 during February. Using the monthly sampling table for sub-population 1, the sample size is less than the minimum required monthly sample size, so 100% of this sampling group is sampled.
- A hospital's sampling group 1 is 45 during January. The required monthly sample is 10 cases.
2. Monthly sampling for sampling group 2:
- A hospital's sampling group is 2 is 387 during March. Using the monthly sampling table for sampling group 2, the sample size required is 20% of this sampling group, or 78 cases for the month (twenty percent of 387 equals 77.4 rounded up to the next whole number = 78).
- A hospital's sampling group 2 is 3 during February. Using the monthly sampling table for sampling group 2, the sample size is less than the minimum required monthly sample size, so 100% of this sampling group is sampled.
- A hospital's sampling group 2 is 47 during January. The required monthly sample is 25 cases.
3. Monthly sampling for sampling group 3:
- A hospital's sampling group 3 is 125 during January. The required monthly sample is 25 cases.
Sampling Approaches
As previously stated in this section, hospitals have the option to sample from their population, or submit their entire population. Hospitals that choose to sample must ensure that the sampled data represent their Initial Patient Population by using either the simple random sampling or systematic random sampling methods and that the sampling techniques are applied consistently within a quarter. For example, monthly samples for a measure set, stratum, or sampling group must use consistent sampling techniques across the quarterly submission period.
- Simple random sampling - selecting a sample size (n) from a population of size (N) in such a way that every case has the same chance of being selected.
- Systematic random sampling - selecting every kth record from a population of size N in such a way that a sample size of n is obtained, where k ≤ N/n. The first sample record (i.e., the starting point) must be randomly selected before taking every kth record. This is a two-step process: a) Randomly select the starting point by choosing a number between one and k using a table of random numbers or a computer-generated random number; and b) Then select every kth record thereafter until the selection of the sample size is completed.
Each hospital is ultimately responsible that sampling techniques applied for their hospital adhere to the sampling requirements outlined in this manual.
Sampling Approach Examples
For a hospital with an Initial Patient Population size of 350 ABC measure set discharges per quarter, the sample size would be 78. To select a random sample of 78 ABC patients:
- Simple random sampling:
- Generate random numbers for individual ABC patient records from a random number function using a statistical software package or computer programming language.
- Sort data by the random numbers either in an increasing or decreasing order.
- Select the first 78 ABC patient records as the random sample.
- Systematic random sampling:
- In this example, the hospital's Initial Patient Population size= 350 and the sample size = 78. Divide the Initial Patient Population size by the sample size and take the quotient (i.e., the integer portion) as the sampling interval k. The sampling interval k = 350/78 = 4.5. Thus, every 4th ABC patient record will be selected from the Initial Patient Population until 78 cases are selected.
- To ensure that each ABC patient has an equal chance of being selected, the “starting point” must be randomly determined before selecting every 4th ABC patient record. This can be done using a computer random number generator or a random number table to randomly choose a number between 1 and 4 as the starting point.
Aggregation of Initial Patient Population and Sample Data Elements
For accreditation purposes, The Joint Commission requires reporting of the Initial Patient Population and sample count data. The Initial Patient Population and sample count data elements are used to assist in evaluating completeness of submission in accordance with The Joint Commission sampling requirements.
The Initial Patient Population Size refers to all patients (Medicare and non-Medicare) who share common payment sources which can be identified by utilizing administrative data such as the UB-04. All ICD-10-CM Diagnosis and ICD-10-PCS Procedure Codes included in the appropriate Initial Patient Population definition must be applied. This identification process must be completed prior to the application of data integrity filter, measure exclusions, and the application of sampling methodology. For specific measure set and strata definitions, refer to the appropriate Initial Patient Population discussion in the Measure Information section of this manual.
For more information concerning aggregate data required for accreditation reporting, refer to documentation available on the Joint Commission’s Direct Data Submission (DDS) Platform. This documentation includes details on the specific aggregate data required for each chart-based measure and information concerning how to calculate the data.
For certification purposes, hospitals do not submit their initial patient population or sampling count data.