How the EHC Satisfaction Survey Was Conducted
Members of BCRTA were invited to participate in a survey about their personal experience with EHC plans. The invitation to participate was circulated widely: by email in our Connections newsletter, by announcement on our website, and through the distribution of the EHC Survey form in our Summer 2021 issue of PostScript magazine.
An online form was made available for easy submission of ratings and comments. We received hundreds of paper submissions as well. The paper submissions were carefully transcribed by BCRTA staff into the same form used by those submitting online.
Steps were taken to minimize duplicate entries.
We received over 1,100 entries, which together represent over 31,000 data points. More than 1,000 comments were submitted across five distinct areas of the EHC plans. All of the comments submitted by users are available below. Those comments have been compiled into ten reports (five for Green Shield and five for Johnson) and total nearly 100 pages.
The results of our survey have statistical validity. We received 1,117 valid entries. The online form required certain questions to be answered in order to proceed. This provided certainty that we had accurate information. We rejected paper submissions that did not answer required questions such as “Who is your plan provider”. There were only five rejected submissions.
A handful of individuals submitted surveys with answers about other plans that were not the TPP sponsored Green Shield plan or BCRTA Johnson plan. Those submissions do not factor into our results.
Our overall statistical significance is calculated to be within 4%, 99 times out of 100. Where we use smaller subsets of data we note the statistical significance for that subgroup.
Confidence intervals are the “plus or minus” amounts around a finding. An example is given just above, when we say that results will be within 4%, 99 times out of 100. The larger the number of respondents, the more likely the results are to closely reflect the opinions of the larger group. BCRTA’s membership is 17,000, not all of whom have EHC coverage. Our large group of 1,117 respondents far exceeds the threshold required for a typical poll which would aim to be within 5%, 95 times out of 100.
As noted in the main survey report, the accuracy of results for Green Shield are higher than those of Johnson, but both are statistically significant. We have the exact numbers of Johnson EHC plan participants and used those to calculate statistical probability for that subgroup. For the Green Shield users, we took the maximum possible number of BCRTA members who might be on that plan as the number to work with – the most conservative approach.
To learn more about sample sizes and calculating statistical significance, view this page that has a handy calculator: https://www.surveysystem.com/sscalc.htm
Overall Satisfaction Ratings – Calculation
Survey respondents were asked to rate their provider on a scale of 1 to 5, with 1 being Poor and 5 being Excellent. The rating results are a simple average.