How are Scores Calculated?

This article summarizes how evaluation tools are scored in BSTperform.

Scoring types for evaluation tools:

Survey – Y/Y+N
Trial/occurrence – (correct # of trials/occurrences)/(total # of trails/occurrences)
- Each item within the trial/occurrence must be correct for the trial/occurrence to be scored as correct. See video below for more information on this scoring.

Evaluation Tool	Scoring Type
ABC Data	Occurrence
BCBA Professionalism Metrics	Survey
Behavioral Skill Training Checklist	Trial
Behaviors Targeted for Reduction	Occurrence
Chaining checklist	Trial
Clinical audit	Survey
Denied access	Trial
DRA	Occurrence
DRH	Occurrence
DRI	Occurrence
DRL	Occurrence
DRO	Occurrence
DTT with stimuli	Trial
DTT without stimuli	Trial
Feedback reception	Survey
Free operant	Trial
Functional communication training	Specific calculation – (# correct consequence deliveries/# opportunities for the FCR and problem behaviors). Specifically, (((A+B)/C)+(D/E)) / (1 or 2).
Group Instruction	Trial
Increasing therapeutic engagement	Occurrence
Instructional control	Occurrence
Match to sample	Trial
Motor Play	Trial
Meeting form – Disciplinary	N/A
Meeting form – General	N/A
MSWO preference assessment	Trial
Natural environment training	Trial
Non-contingent reinforcement	Occurrence
Paired stimulus preference assessment	Trial
Pairing	Specific calculation - Y + (correct/opportunities) / Y + N + 1 (if correct/opportunity values are present).
PDC-HS	N/A
Pretend play	Trial
Providing effective feedback	Survey
RBT initial competency assessment	N/A
Reinforcer relinquishment	Trial
Session environmental barriers	Survey
Session Note	Survey
Session professionalism	Survey
Session intensity	N/A
Social skills	Trial
Skill acquisition	Survey
Supervision form	N/A
Staff feedback preference survey	N/A
Toileting training	Survey
Tolerance shaping	Trial
Transitions	Trial
Treatment plan	Survey
Echoics	Trial
Intraverbal	Trial
Manding	Trial
Tacting	Trial

The below video outlines how trial/occurrence-based evaluations are scored.

Have you ever wondered why despite so many yeses, your supervisee still receives a low overall score? In this video we’ll show you how the score is calculated and why one no may lower a score.

While a single trial within an assessment may include multiple components, BST Perform is set up to count trial based data, so one no within a trial actually counts it as an incorrect trial. If you only run for example 3 trials, one incorrect leads to a score of 67.

You may be asking yourself, why collect all the little details if one no can erase all the yeses within the trial? While it’s true that the final score is dependent on the accuracy of the entire trial, the details within the trial help you pinpoint specific areas of improvement.

In other words, a procedure may have 6 different components to observe. Getting one wrong, lowers the integrity of the procedure, so it’s important that it is recorded as an incorrect trial, but when it comes to feedback for your supervisee, you can highlight all the sections they got correct, then focus in on helping them improve the section they got incorrect.

It may also mean that you need to collect data on a few additional trials. One error trial out of 3 is 67, one error trial out of 5 already brings the score up to 80.

Scoring for Environmental Barriers

The environmental barriers evaluation impacts the supervisor and supervisees score. Below we've outlined what questions impact which user.

Question	Supervisor	Supervisee	Organization
Question	Impact	Impact	No score impact
Has required materials?	30%	60%	10%
Facility appropriate for treatment?	30%	10%	60%
Client in same geographic area?	65%	5%	30%
Protocol documentation is reasonable?	30%	0%	70%
Client is healthy...?	10%	10%	80%
Required staff:client ratio present?	20%	0%	80%
Has potential reinforcers available?	30%	60%	10%