ABA Journal Club #8: Performance Diagnostic Checklist

One of the tenets of ABA is to provide evidence-based practice. The best way to help us do this is to keep up with the literature! Each month, Sam Blanco, PhD, LBA, BCBA will select one journal article and provide discussion questions for professionals working within the ABA community. The following week another ABA professional will respond to Sam’s questions and provide further insight and a different perspective on the piece.

For many BCBAs, a large part of their role is supervising others in implementing ABA treatment.  In the course of my week I typically supervise 12 different paraprofessionals. Their training needs are highly variable, my time with them is minimal, and in my BCBA coursework I did not receive formal training on how to be an effective supervisor. This is an issue within the field of ABA, and can have a big impact on the services individuals with autism receive.

When I first came across the Performance Diagnostic Checklist – Human Services (PDC-HS) I was ecstatic. It is an easy-to-complete assessment of employee training, and provides clarity for next steps in addressing issues related to employee performance. The article for this month’s ABA Journal Club explains how the PDC-HS was utilized to evaluate training in an early intervention setting.

Carr, J. E., Wilder, D. A., Majdalany, L., Mathisen, D., & Strain, L. A. (2013). An assessment-based solution to a human-service employee performance problem. Behavior Analysis in Practice6(1), 16-32.

  1. The PDC-HS is a tool “designed to be used by a behavior analyst during an interview with the employee’s direct supervisor or manager” (p. 20). Is this a reasonable format for your work environment?  
  2. Have you or your organization used the PDC-HS or a different formal tool to evaluate training of staff? What has been your experience with such formal evaluation?
  3. Part of the procedure for this study was to show employees graphed feedback. Is this a strategy you have utilized in the past? If not, how could you utilize it for current skills you are teaching employees?
  4. The dependent measure in this study was cleanliness of the treatment room. This is an important workplace skill, especially if materials for instruction or lost or damaged, if problem behaviors of clients increase while the practitioner is looking for materials, or if the messiness of a room interferes with efficient use of session time. The authors note that systematic replications of their study should include other aspects of training, such as appropriate prompting. If you were to complete a study on the PDC-HS, what training skill would you address? Why?
  5. What are some obstacles in your current setting to implementing the PDC-HS? How can you address those obstacles?
  6. Reread Appendix B, which contains the full PDC-HS. What do you think about the questions they ask? Why are those specific questions asked? Is there anything you would add?
  7. My favorite part of this article is the Intervention Planning portion on pages 30-31. It provides clear direction on what interventions may be appropriate for different training issues along with citations. Why is this an important resource for supervisors?

 [SB1]Link to: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3680147/pdf/i1998-1929-6-1-16.pdf

One of the tenets of ABA is to provide evidence-based practice. The best way to help us do this is to keep up with the literature! Each month, Sam Blanco, PhD, LBA, BCBA will select one journal article and provide discussion questions for professionals working within the ABA community. The following week another ABA professional will respond to Sam’s questions and provide further insight and a different perspective on the piece.

One of my favorite parts of my job is training people who are working to become BCBAs. There is an immense amount of content for my supervisees to learn, and one of the key aspects of this is to understand how to implement all of the new concepts their learning within the context of an actual case. This is often far more challenging than it might appear at first blush. I frequently supervise students pursuing their BCBA, and I require each one of them to read LeBlanc, Raetz, Sellers, & Carr (2016) because it provides a clear model for clinical decision-making.

LeBlanc, L. A., Raetz, P. B., Sellers, T. P., & Carr, J. E. (2016). A proposed model for selecting measurement procedures for the assessment and treatment of problem behavior. Behavior analysis in practice9(1), 77-83

  • Why is this article important for practitioners to read?
  • The model proposed by the authors incorporates several variables (such as observability of behavior and personnel resources.) Are there any other variables you might consider when selecting a measurement procedure?
  • Table 1 clearly outlines each form of measurement along with strengths and limitations. Discuss the forms of measurement you frequently use and the limitations to incorporating other forms into your current practice.
  • In Figure 1, the authors provide a flow chart for easily selecting the most appropriate form of measurement. Many of the questions are directly related to observer resources. In this article, the term “resources” relates directly to the ability of personnel to continuously monitor the behavior. Are there any other factors you would consider in relation to personnel? If yes, how do you typically address those factors?
  • In discussing the behavior being measured, the authors write: “If the behavior can occur at any time, consider all dimensions of the response and select the ones that are most critically important to fully capture the important features of the behavior and the potential change in the behavior that may occur due to intervention” (p. 81). How do you determine which dimensions of the response are the most critically important? Can you think of an example?
  • One of the limitations of this paper is that the model it presents has not been empirically tested. What might such an empirical study look like?

WRITTEN BY SAM BLANCO, PhD, LBA, BCBA

Sam is an ABA provider for students ages 3-15 in NYC. Working in education for twelve years with students with Autism Spectrum Disorders and other developmental delays, Sam utilizes strategies for achieving a multitude of academic, behavior, and social goals. She is also an assistant professor in the ABA program at The Sage Colleges.