How are Scores Calculated?

This article summarizes how evaluation tools are scored in BSTperform.

Scoring types for evaluation tools:

  • Survey – Y/Y+N
  • Trial/occurrence – (correct # of trials/occurrences)/(total # of trails/occurrences)
    • Each item within the trial/occurrence must be correct for the trial/occurrence to be scored as correct. See video below for more information on this scoring. 

Evaluation Tool

Scoring Type

BCBA Professionalism Metrics

Survey

Behavioral Skill Training Checklist

Trial

Behaviors Targeted for Reduction

Occurrence

Chaining checklist

Trial

Clinical audit

Survey

Denied access

Trial

DRA

Occurrence

DRH

Occurrence

DRI

Occurrence

DRL

Occurrence

DRO

Occurrence

DTT with stimuli

Trial

DTT without stimuli

Trial

Feedback reception

Survey

Free operant

Trial

Functional communication training

Specific calculation – (# correct consequence deliveries/# opportunities for the FCR and problem behaviors). Specifically, (((A+B)/C)+(D/E)) / (1 or 2).

Group Instruction

Trial

Instructional control

Occurrence

Match to sample

Trial

Motor Play

Trial

Meeting form – Disciplinary

N/A

Meeting form – General

N/A

MSWO preference assessment

Trial

Natural environment training

Trial

Non-contingent reinforcement

Occurrence

Paired stimulus preference assessment

Trial

Pairing

Survey

PDC-HS

N/A

Pretend play

Trial

Providing effective feedback

Survey

RBT initial competency assessment

N/A

Reinforcer relinquishment

Trial

Session environmental barriers

Survey

Session Note

Survey

Session professionalism

Survey

Session intensity

N/A

Social skills

Trial

Skill acquisition

Survey

Supervision form

N/A

Staff feedback preference survey

N/A

Toileting training

Survey

Tolerance shaping

Trial

Transitions

Trial

Treatment plan

Survey

Echoics

Trial

Intraverbal

Trial

Manding

Trial

Tacting

Trial

The below video outlines how trial/occurrence-based evaluations are scored. 

Have you ever wondered why despite so many yeses, your supervisee still receives a low overall score? In this video we’ll show you how the score is calculated and why one no may lower a score.

While a single trial within an assessment may include multiple components, BST Perform is set up to count trial based data, so one no within a trial actually counts it as an incorrect trial. If you only run for example 3 trials, one incorrect leads to a score of 67.

You may be asking yourself, why collect all the little details if one no can erase all the yeses within the trial? While it’s true that the final score is dependent on the accuracy of the entire trial, the details within the trial help you pinpoint specific areas of improvement.

In other words, a procedure may have 6 different components to observe. Getting one wrong, lowers the integrity of the procedure, so it’s important that it is recorded as an incorrect trial, but when it comes to feedback for your supervisee, you can highlight all the sections they got correct, then focus in on helping them improve the section they got incorrect.

It may also mean that you need to collect data on a few additional trials. One error trial out of 3 is 67, one error trial out of 5 already brings the score up to 80.

Scoring for Environmental Barriers

The environmental barriers evaluation impacts the supervisor and supervisees score. Below we've outlined what questions impact which user.

Question Supervisor Supervisee Organization
Impact  Impact  No score impact
Has required materials? 30%  60%  10%
Facility appropriate for treatment?  30%  10% 60%
Client in same geographic area? 65%  5% 30%
Protocol documentation is reasonable? 30%  0% 70%
Client is healthy...? 10%  10% 80%
Required staff:client ratio present?  20%  0% 80%
Has potential reinforcers available? 30%  60% 10%