Tag Archives: aba journal club

ABA Journal Club: A Response from Dana Reinecke

Posted on by
A quote from this week's ABA Journal Club response from Dana Renecke

Welcome back to ABA Journal Club! One of the tenets of ABA is to provide evidence-based practice. The best way to help us do this is to keep up with the literature! Each month, Sam Blanco, PhD, LBA, BCBA will select one journal article and provide discussion questions for professionals working within the ABA community. The following week another ABA professional will respond to Sam’s questions and provide further insight and a different perspective on the piece.

Check out last week’s discussion questions here!

Behavior analysts engage in many different professional activities, many of which are more or less likely given specific clinical or research settings. For example, some behavior analysts who work with individuals with disabilities are likely to conduct preference assessments and use token economies, while those who work with organizations are less likely to use these technologies. One part of the behavior analyst’s repertoire that is always important, however, is the careful and accurate collection of data. This skill set is necessary for understanding and assessing behavior, as well as for ongoing monitoring of the effectiveness of behavioral interventions. 

It is important to understand not just how to measure behavior, but when to use each type of measure.  LeBlanc, Raetz, Sellers, and Carr (2016) describe some of the critical questions that should be considered when choosing a measurement procedure and offer a clinical decision-making model to guide behavior analysts in making these choices.  This article is useful for helping trainees to practice choosing measurement procedures, and reminding more experienced behavior analysts about the considerations involved in measurement. 

LeBlanc, L. A., Raetz, P. B., Sellers, T. P., & Carr, J. E. (2016). A proposed model for selecting measurement procedures for the assessment and treatment of problem behavior. Behavior analysis in practice, 9(1), 77-83.

Why is this article important for practitioners to read?

Measurement of behavior is one of the most important activities that a behavior analyst engages in.  Without accurate, meaningful measurement, assessment of both behavior and intervention effectiveness is impossible.  Trainees should read this article to learn about the important variables involved in choosing appropriate measurement systems, and more seasoned behavior analysts should read it to remind themselves about those variables.  Even though the article is focused on the measurement of problem behavior, the same principles can be applied to the measurement of behavior targeted for increase.

The model proposed by the authors incorporates several variables (such as observability of behavior and personnel resources.) Are there any other variables you might consider when selecting a measurement procedure?

Length of observation period might be a relevant factor in choosing a measurement procedure.  Consideration of the availability of resources may be influenced by the goal for how much observation is desired.  To use the case example provided by the authors, Joey’s teacher and aide might not be able to continuously record his work engagement throughout the day, but one of them might be able to do so for a limited sample of each day.  They could choose to conduct continuous measurement during a sample interval, and compare it to the longer period of discontinuous measurement to ensure that the discontinuous measure does not result in an over- or under-estimate of behavior. 

Table 1 clearly outlines each form of measurement along with strengths and limitations. Discuss the forms of measurement you frequently use and the limitations to incorporating other forms into your current practice.

As a consultant, I need to measure behavior based on limited samples when I can observe, and I also need to design data collection plans for the staff who are there for the rest of the week.  Staff are often responsible for more than one student, and may not have the resources to conduct continuous event recording.  Behavior is also often not discrete (e.g., crying) or occurs too frequently to count (e.g., stereotypy).  I often use partial-interval recording when I consult in school programs.  This allows for a very easy, non-intrusive overview of the pattern of behavior across the school day.  Another common measure is duration of behavior, because it is also relatively easy to start a timer when behavior begins, and stop it when it ends.  Frequency data are pretty rare in my practice, and reserved for low-frequency behavior that only occurs under specific circumstances.

In Figure 1, the authors provide a flow chart for easily selecting the most appropriate form of measurement. Many of the questions are directly related to observer resources. In this article, the term “resources” relates directly to the ability of personnel to continuously monitor the behavior. Are there any other factors you would consider in relation to personnel? If yes, how do you typically address those factors?

When training staff to collect data, it’s important to acknowledge any unintended bias.  Depending on the staff member’s level of experience, I will conduct more or less frequent IOA to reduce the risk of observer drift, and will also regularly review behavioral definitions to ensure that we are still talking about the same thing.

In discussing the behavior being measured, the authors write: “If the behavior can occur at any time, consider all dimensions of the response and select the ones that are most critically important to fully capture the important features of the behavior and the potential change in the behavior that may occur due to intervention” (p. 81).  How do you determine which dimensions of the response are the most critically important? Can you think of an example?

The importance of each dimension of the behavior will depend on the situation, the behavior, and the target or goal for the behavior.  For example, if a student is able to answer social questions but only does so after a delay, we would want to target, and therefore measure, latency to respond instead of frequency.  Or, a learner might engage in several very brief tantrums throughout the day.  In that case, I would expect that duration would be less important, and frequency a more meaningful measure.  By contrast, if a learner engages in one or two very long tantrums per week, we would want to measure duration and possibly intensity, rather than highlighting frequency.

One of the limitations of this paper is that the model it presents has not been empirically tested. What might such an empirical study look like?

One possible way to validate this model would be to provide several experienced behavior analysts with some case studies, and ask them to use the model to recommend measurement procedures for each case study.  High levels of agreement between the behavior analysts might indicate some validity for the model.  Further validity could be achieved by using the model to select measures, and then conducting those measures and comparing them to true values (e.g., permanent products or continuously-collected event recording).

About The Author

Dana Reinecke, Ph.D., BCBA-D is a doctoral level Board-Certified Behavior Analyst (BCBA-D) and a New York State Licensed Behavior Analyst (LBA).   Dana is a Core Faculty member in the Applied Behavior Analysis department at Capella University.  She is also co-owner of SupervisorABA, an online platform for BACB supervision curriculum, forms, and hours tracking.  Dana provides training and consultation to school districts, private schools, agencies, and families for individuals with disabilities. She has published her research in peer-reviewed journals, written chapters in published books, and co-edited books on ABA and autism.  Current areas of research include use of technology to support students with and without disabilities, self-management training of college students with disabilities, and online teaching strategies for effective college and graduate education.  Dana is actively involved in the New York State Association for Behavior Analysis (NYSABA).

ABA Journal Club #8: Performance Diagnostic Checklist

Posted on by

One of the tenets of ABA is to provide evidence-based practice. The best way to help us do this is to keep up with the literature! Each month, Sam Blanco, PhD, LBA, BCBA will select one journal article and provide discussion questions for professionals working within the ABA community. The following week another ABA professional will respond to Sam’s questions and provide further insight and a different perspective on the piece.

For many BCBAs, a large part of their role is supervising others in implementing ABA treatment.  In the course of my week I typically supervise 12 different paraprofessionals. Their training needs are highly variable, my time with them is minimal, and in my BCBA coursework I did not receive formal training on how to be an effective supervisor. This is an issue within the field of ABA, and can have a big impact on the services individuals with autism receive.

When I first came across the Performance Diagnostic Checklist – Human Services (PDC-HS) I was ecstatic. It is an easy-to-complete assessment of employee training, and provides clarity for next steps in addressing issues related to employee performance. The article for this month’s ABA Journal Club explains how the PDC-HS was utilized to evaluate training in an early intervention setting.

Carr, J. E., Wilder, D. A., Majdalany, L., Mathisen, D., & Strain, L. A. (2013). An assessment-based solution to a human-service employee performance problem. Behavior Analysis in Practice, 6(1), 16-32.

  1. The PDC-HS is a tool “designed to be used by a behavior analyst during an interview with the employee’s direct supervisor or manager” (p. 20). Is this a reasonable format for your work environment?  
  2. Have you or your organization used the PDC-HS or a different formal tool to evaluate training of staff? What has been your experience with such formal evaluation?
  3. Part of the procedure for this study was to show employees graphed feedback. Is this a strategy you have utilized in the past? If not, how could you utilize it for current skills you are teaching employees?
  4. The dependent measure in this study was cleanliness of the treatment room. This is an important workplace skill, especially if materials for instruction or lost or damaged, if problem behaviors of clients increase while the practitioner is looking for materials, or if the messiness of a room interferes with efficient use of session time. The authors note that systematic replications of their study should include other aspects of training, such as appropriate prompting. If you were to complete a study on the PDC-HS, what training skill would you address? Why?
  5. What are some obstacles in your current setting to implementing the PDC-HS? How can you address those obstacles?
  6. Reread Appendix B, which contains the full PDC-HS. What do you think about the questions they ask? Why are those specific questions asked? Is there anything you would add?
  7. My favorite part of this article is the Intervention Planning portion on pages 30-31. It provides clear direction on what interventions may be appropriate for different training issues along with citations. Why is this an important resource for supervisors?

 [SB1]Link to: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3680147/pdf/i1998-1929-6-1-16.pdf

One of the tenets of ABA is to provide evidence-based practice. The best way to help us do this is to keep up with the literature! Each month, Sam Blanco, PhD, LBA, BCBA will select one journal article and provide discussion questions for professionals working within the ABA community. The following week another ABA professional will respond to Sam’s questions and provide further insight and a different perspective on the piece.

One of my favorite parts of my job is training people who are working to become BCBAs. There is an immense amount of content for my supervisees to learn, and one of the key aspects of this is to understand how to implement all of the new concepts their learning within the context of an actual case. This is often far more challenging than it might appear at first blush. I frequently supervise students pursuing their BCBA, and I require each one of them to read LeBlanc, Raetz, Sellers, & Carr (2016) because it provides a clear model for clinical decision-making.

LeBlanc, L. A., Raetz, P. B., Sellers, T. P., & Carr, J. E. (2016). A proposed model for selecting measurement procedures for the assessment and treatment of problem behavior. Behavior analysis in practice, 9(1), 77-83

  • Why is this article important for practitioners to read?
  • The model proposed by the authors incorporates several variables (such as observability of behavior and personnel resources.) Are there any other variables you might consider when selecting a measurement procedure?
  • Table 1 clearly outlines each form of measurement along with strengths and limitations. Discuss the forms of measurement you frequently use and the limitations to incorporating other forms into your current practice.
  • In Figure 1, the authors provide a flow chart for easily selecting the most appropriate form of measurement. Many of the questions are directly related to observer resources. In this article, the term “resources” relates directly to the ability of personnel to continuously monitor the behavior. Are there any other factors you would consider in relation to personnel? If yes, how do you typically address those factors?
  • In discussing the behavior being measured, the authors write: “If the behavior can occur at any time, consider all dimensions of the response and select the ones that are most critically important to fully capture the important features of the behavior and the potential change in the behavior that may occur due to intervention” (p. 81). How do you determine which dimensions of the response are the most critically important? Can you think of an example?
  • One of the limitations of this paper is that the model it presents has not been empirically tested. What might such an empirical study look like?

WRITTEN BY SAM BLANCO, PhD, LBA, BCBA

Sam is an ABA provider for students ages 3-15 in NYC. Working in education for twelve years with students with Autism Spectrum Disorders and other developmental delays, Sam utilizes strategies for achieving a multitude of academic, behavior, and social goals. She is also an assistant professor in the ABA program at The Sage Colleges.

ABA Journal Club #5: Caregivers as Interventionists

Posted on by

One of the tenets of ABA is to provide evidence-based practice. The best way to help us do this is to keep up with the literature! Each month, Sam Blanco, PhD, LBA, BCBA will select one journal article and provide discussion questions for professionals working within the ABA community. The following week another ABA professional will respond to Sam’s questions and provide further insight and a different perspective on the piece.

There is a wealth of studies demonstrating that training caregivers to implement interventions is valuable for generalization of skills, improved learner outcomes, and decreases caregiver stress. While many teachers, behavior analysts, and other practitioners work to train caregivers; these practitioners are rarely given specific training on how to train caregivers.

In this month’s journal club article, behavior skills training (BST) is utilized to teach caregivers to be interventionists. BST is a model that involves instruction, modeling, rehearsal, and feedback. We hope this article will get you talking about your current level of training with BST and how your organization can improve in training practitioners to teach caregivers to implement behavior analytic strategies.

Loughrey, T. O., Contreras, B. P., Majdalany, L. M., Rudy, N., Sinn, S., Teague, P., … & Harvey, A. C. (2014). Caregivers as interventionists and trainers: Teaching mands to children with developmental disabilities. The Analysis of Verbal Behavior, 30(2), 128-140.

  • The researchers trained caregivers on a university campus using the BST model prior to home visits. In your current work, would this be a possibility for you? If not, how could you provide this type of training to caregivers? What obstacles can you predict, and how might you address them?
  • Discuss the multiple baseline design used in the study. How does it demonstrate experimental control? What can you determine from a visual analysis of the data?
  • Part of this study included a measure of whether a competently trained parent could teach their spouse how to implement mand training. Why is this important? Have you implemented similar strategies in your own work?
  • This study did include maintenance data. Why is this data valuable? Do you collect maintenance data on the caregiver training you provide?
  • Consider a particular skill you are teaching one or more clients. What would BST look like to teach caregivers how to implement the necessary procedures for teaching that skill?
  • The article states, “General instructions were provided prior to baseline, but parents were only able to implement the procedures effectively when full instructions, modeling, rehearsal, and feedback were used to train to mastery.” How can you change your current practice to ensure that you are providing the necessary steps to help caregivers master skills they have selected for parent training?

WRITTEN BY SAM BLANCO, PhD, LBA, BCBA

Sam is an ABA provider for students ages 3-15 in NYC. Working in education for twelve years with students with Autism Spectrum Disorders and other developmental delays, Sam utilizes strategies for achieving a multitude of academic, behavior, and social goals. She is also an assistant professor in the ABA program at The Sage Colleges.

ABA Journal Club #2: Ethics and Social Media

Posted on by

One of the tenets of ABA is to provide evidence-based practice. The best way to help us do this is to keep up with the literature! Each month, Sam Blanco, PhD, LBA, BCBA will select one journal article and provide discussion questions for professionals working within the ABA community. The following week another ABA professional will respond to Sam’s questions and provide further insight and a different perspective on the piece.

Head to our Facebook page to join the discussion and let us know your thoughts!

It is important in our field to maintain an open conversation about ethics. The Professional and Ethical Compliance Code outlines how behavior analysts are expected to conduct themselves, but sometimes situations are not so black and white. And as the world changes, so do the expectations for ethical conduct. In recent years, issues related to social media have been especially relevant. This month, I’ve selected the following article which addresses the special concerns that come up with the use of social media.

O’Leary, P. N., Miller, M. M., Olive, M. L., & Kelly, A. N. (2017). Blurred lines: Ethical implications of social media for behavior analysts. Behavior Analysis in Practice, 10(1), 45-51 .

  1. The article reviews the codes of ethics for other professions. Why is this valuable for us to do as a profession? Did you learn anything surprising or interesting form this portion of the article?
  1. Since this article was written, our field has a new Professional and Ethical Compliance Code. How does this code differ from the previously used Guidelines for Responsible Conduct? What aspects of the code directly apply to ethical situations related to social media?
  1. “A search on an internet search engine for information related to a procedure or scientific concept may yield results as to what that procedure or concept is. The same search on a social media outlet may yield results as to whether or not that procedure or concept should be used (p. 47.) Discuss this difference.
  1. Behavior analysts and others interested in the topic may turn to social media to get answers to their questions due to the low response effort involved and the speed of reinforcement. How can we decrease response effort and increase reinforcement for referring to the scientific literature to answer our questions?
  1. The authors provide suggestions for how behavior analysts should behave on social media. Are there any suggestions you might add? Are there ways you can increase the likelihood of other behavior analysts following these suggestions?
  1. Consider your own behavior on social media. Based on recommendations from the article, what is one change you can make to increase your own ethical behavior in this context?

WRITTEN BY SAM BLANCO, PhD, LBA, BCBA

Sam is an ABA provider for students ages 3-15 in NYC. Working in education for twelve years with students with Autism Spectrum Disorders and other developmental delays, Sam utilizes strategies for achieving a multitude of academic, behavior, and social goals. She is also an assistant professor in the ABA program at The Sage Colleges.

ABA Journal Club #1

Posted on by

            For January, I have selected not one, but two texts. The first is a foundational article that every behavior analyst has probably read more than once. However it’s an important one to revisit, and one that I gain more insight from with each read. The second is a follow-up to the original article.

Article One: Baer, D. M., Wolf, M. M., & Risley, T. R. (1968). Some current dimensions of applied behavior analysis. Journal of Applied Behavior Analysis, 1(1), 91-97.

Article Two: Baer, D. M., Wolf, M. M., & Risley, T. R. (1987). Some still‐current dimensions of applied behavior analysis. Journal of Applied Behavior Analysis, 20(4), 313-327.

Discussion Questions for Baer, Wolf, Risley (1968):

The tone of the 1968 article is hopeful. The authors express a belief that behavior analytic procedures will become more prevalent as people understand the technology. Do you think they were accurate in this belief? What has been your experience with people accepting the principles of ABA?

Among the seven dimensions discussed in this article, what did you find most interesting?

The authors state that the term applied is defined by the interest society shows in the problem being studied. Is this how you have thought of the term applied in the past? How does your current work fit into this description? And how do we know society is interested?

In their discussion of analytic, the authors explain two designs commonly used to demonstrate reliable control of behavior change. Do you use these designs in your every day practice? Why or why not?

Do you think all seven of these dimensions hold equal importance? Why or why not?

How do the seven dimensions make ABA different from other fields?

Discussion Questions for Baer, Wolf, Risley (1987):

Compare and contrast the descriptions of each of the seven dimensions across the two articles.

The authors identify social validity as a good measure of effectiveness. However, they also identify issues with the assessment of social validity. How do you think that has changed since they wrote this article? How do you assess social validity in your own work?

What do you think of the discussion of high-quality failures?

In what ways do you follow the seven dimensions in your current work?

Can you identify a way to improve your own work based on the seven dimensions?

If you were to identify an eighth dimension that is not currently represented in these articles, what might you add?

SAM BLANCO, PhD, LBA, BCBA is an ABA provider for students ages 3-15 in NYC. Working in education for twelve years with students with Autism Spectrum Disorders and other developmental delays, Sam utilizes strategies for achieving a multitude of academic, behavior, and social goals. She is also an assistant professor in the ABA program at The Sage Colleges.