ABA Tools of the Trade: A book review from ASAT!

This month’s ASAT feature comes to us from Karrie Lindeman, EdD, BCBA-D, LBA and David Celiberti, PhD, BCBA-D. To learn more about ASAT, please visit their website at www.asatonline.org. You can also sign up for ASAT’s free newsletter, Science in Autism Treatment, and like them on Facebook!

Save 20% on ABA Tools of The Trade and our Tools of the Trade kit now through June 17th!

Data collection is the core of the success of our science. Without data, are we are not providing behavior analytic service to our clients; however, data collection can be a scary new journey for many. What do I collect? How do I collect it? What do I put it on? How do I manage the other children in the class? What do I do with the data once I have it? How do the data guide my decision-making? All of these questions pose roadblocks to the individuals attempting the collection.

To date, many training manuals and books have attempted to provide insight and guidance for struggling data-collection newbies. Some of these books have fallen short of delivering a clear and concise message to its readers. ABA Tools of the Trade provides a unique take at explaining the what, why, and most importantly, the “how-to” of data collection.

The authors start off describing the purpose of the book, addressing concerns that teachers and technicians face in the field every day: Why am I doing this? And how can I create easy to navigate data sheets with simple graphs for analyzing after I have collected the data? ABA Tools of the Trade breaks down their material into five sections which simplify the anatomy of a data sheet, review different types of data collection systems available, discuss how to utilize them with simple behavior change procedures, and offer activities to ensure supervisees are competent (huge bonus!). Throughout the sections, the material is organized in a way to help you identify exactly what you need to do, with helpful vignettes providing real-world examples.

The breakdown of the five sections allows the reader to easily find the information they are looking for, along with supporting documents. The first section delves into the Anatomy of Data Collection, describes not only why we collect data, but how to do so in the most simplistic way. This section is great for someone new to data collection or looking to expand their practice. A bonus includes describing different tools that may be helpful in your data collection journey with informative descriptions and visuals. Examples include tally counters, interval timers, and time timers, to name a few. A useful hints page highlights how the specific tools can be matched to the different measures of behavior that need to be tracked.

The second section is the Data Collection Systems sectionwhich describes more complex systems and strategies that work in different settings. It starts off with a comprehensive list of 10 rules of data collection. These rules are extremely important as they lay the groundwork for ethical data collection and reviews potential issues that may arise as you begin to collect data. These include examples of consent issues, confidentiality mishaps, and an important reminder to adhere to state and local laws. Finally, a handy task analysis of data collection steps provides a simple way for readers to grasp the needed components for specific targeted behaviors and wraps up the section.

The third and fourth sections include Behaviors and Simple Behavior Change Systems, which describes the Functional Behavior Assessment and Behavior Intervention Plan process in user-friendly terms. This is a great introduction for those starting out and looking to brush up on appropriate procedures. This section reviews what qualifies as efficient data collection in an FBA and how to analyze results. An added bonus is the discussion on antecedent strategies, which provides the reader with tactics and corresponding examples. Following the breakdown, vignettes of very specific behavioral episodes are provided, which allow the reader to apply the knowledge derived from the reading in everyday situations. Each vignette is followed by a general solution and helpful hints on dealing with the presented issue. For those interested in learning more about the topic, references and recommended readings are provided after all examples. Great source!

The fifth and final section, Supervision Practices, is a bonus for those supervising candidates for board certification in behavior analysis. It is comprehensive, well organized, and synched with the 5th Edition of Task List providing not only lessons but scenarios for practice with corresponding rubrics. Please note, as the Task List is updated, the alphanumeric codes may change. Three phases are addressed:

  • The Pre-Data Collection Phase addresses information gathering from parents and professionals surrounding prior attempts to address behavior (what was implemented and for how long) including defining behavior and determine how best to measure it.
  • The Data Collection Phase involves implementing the data collection system and making timely modifications, as well as proper training of the data collectors and determining an adequate schedule. Interobserver agreement is also addressed.
  • The Post-Data Collection Phase involves reviewing the collected data, preparing for graphic representation, and using data-based decision making.

Given that many newly credentialed BCBAs are assuming a supervisory role for the first time, this section is very helpful. Learning objectives and activities for each lesson are clearly articulated and rubrics are provided to support application and assess the skill level of the supervisee.

This short, well-organized, and easily-accessible resource belongs on the shelves of those first working towards BCBA certification, BCBAs who are starting out, and current BCBAs providing Registered Behavior Technician and BCBA supervision. The content spans all data collection needs, from the very basics on how to ensure those we supervise understand and demonstrate necessary skills from the Task List. It would also be a practical, yet easy supplemental read for students progressing through their coursework in college programs. To maintain quality service, it is imperative to ensure the next generation of BCBAs have the skills necessary to provide and supervise quality service provision. The inclusion of sections related to modifying one’s behavior as well as supervisory considerations only strengthen the utility of this already informative guide. This book is a great resource, and recommended without reservation!


About The Authors

Karrie Lindeman completed her undergraduate degree at C.W. Post University with a major in psychology. She went on to Queens College to complete her Masters in Psychology and advanced certificate in Behavior Analysis. From here, she worked in a school for children with autism for 10 years before moving on to consult in the public school and early intervention setting. Karrie completed her doctorate in learning and teaching at Hofstra University in 2015. She continues to provide direct service, parent training, and consultation in a variety of settings. Karrie is currently the Program Director of the Behavior Analysis program at Touro College in New York City.

David Celiberti, PhD, BCBA-D, is the Executive Director of ASAT and Past-President, a role he served from 2006 to 2012. He is the Co-Editor of ASAT’s monthly publication, Science in Autism Treatment. He received his PhD in clinical psychology from Rutgers University in 1993 and his certification in behavior analysis in 2000. Dr. Celiberti has served on a number of advisory boards and special interest groups in the field of autism, applied behavior analysis (ABA), and early childhood education. He works in private practice and provides consultation to public and private schools and agencies in underserved areas. He has authored several articles in professional journals and presents frequently at regional, national, and international conferences. In prior positions, Dr. Celiberti taught courses related to ABA at both undergraduate and graduate levels, supervised individuals pursuing BCBA certifications, and conducted research in the areas of ABA, family intervention, and autism.

ABA Journal Club: A Response From Elizabeth A. Drago, M.A., BCBA, LBA

One of the tenets of ABA is to provide evidence-based practice. The best way to help us do this is to keep up with the literature! Each month, Sam Blanco, PhD, LBA, BCBA will select one journal article and provide discussion questions for professionals working within the ABA community. The following week another ABA professional will respond to Sam’s questions and provide further insight and a different perspective on the piece.

  • The researchers trained caregivers on a university campus using the BST model prior to home visits. In your current work, would this be a possibility for you? If not, how could you provide this type of training to caregivers? What obstacles can you predict, and how might you address them?

The majority of my clinical practice is primarily situated in home-based settings.  Delivering behavior analytic services in home-based settings presents with a multitude of circumstances contributing to variable rates of success in teaching new skills for both the client and caregivers.  Two variables contributing to such challenges in service delivery is caregiver accessibility and limited service hours allotted, particularly if the services are funded through insurance-based sources.  Formal Behavior Skills Training (BST) often requires time intensive performance and competency- based components, creating a challenge to implement in the home setting at times. With careful planning and caregiver commitment to participation, BST training in the home setting is quite “do-able”.

To address time constraints, a ‘train the trainer’ model or pyramidal training (Pence, St. Peter, & Tetreault, 2012), may be a beneficial strategy to assist in training multiple caregivers as well as contribute to increased proficiency in treatment fidelity.  A pyramidal training model involves a senior trainer (e.g., a behavior analyst) training a small group of staff or caregivers who in turn train other staff or caregivers.  This type of training model may be particularly beneficial to clinicians working in settings where time constraints may be a factor (such as residential services).  

  • Discuss the multiple baseline design used in the study. How does it demonstrate experimental control? What can you determine from a visual analysis of the data?

The researchers in this study utilized a concurrent multiple-baseline-across-modules design to analyze the effects of the BST module training delivered to parents to teach their children mands. Concurrent multiple-baseline-across modules design allows for simultaneous measurement to occur for all clients. Research suggests concurrent measurement controls better for threats to internal validity and result in somewhat stronger inferences than do nonconcurrent designs (Watson and Workman, 1981). Multiple baseline designs are appropriate when target behaviors are not reversible. Use of a concurrent multiple-baseline design to evaluate treatment effectiveness minimizes the ethical concerns related to a withdrawal design. Training skills sequentially using a multiple-baseline-across-modules design is beneficial since it allows trainers to teach skills gradually and gave trainees repeated rehearsal opportunities on previously trained skills. The trainer could also monitor ongoing caregiver performance and make decisions to advance caregivers through the training based on the consistency and accuracy of their performance on trained skills.  Researchers of the study required caregivers to reach specific mastery criterion rates to advance to additional modules in the BST to assess the maintenance of the caregiver’s accuracy of procedural integrity and the child’s mands.

Upon visual analysis of the data, results of the study support effects of a BST model for training caregivers to implement mand training procedures.  In addition, after training, caregivers did not exhibit difficulties generalizing the skills to implement mand training procedures to the child.  Additional training was provided to caregivers during sessions with the child when mastery criterion was not achieved.  The researchers found by staggering the training across modules, caregivers learned to capture and contrive motivating operations contributing to the emergence of spontaneous mands.

  • Part of this study included a measure of whether a competently trained parent could teach their spouse how to implement mand training. Why is this important? Have you implemented similar strategies in your own work?

Training caregivers to effectively generalize behavior analytic treatment strategies and interventions to the child outside of training sessions is one of the goals of family support behavior analytic services.   Strategies to fade out the necessity of behavior analytic services is developed in the client’s treatment plan at the initiation of services.   Delivering BST to a caregiver who demonstrates proficiency of the designated steps is invaluable in the treatment process.  Through BST,  trained caregivers who have demonstrated mastery of a skill, have the ability to train additional caregivers (e.g., grandparents and siblings) in the client’s environment, facilitating generalization of treatment effects. 

In addition, research has supported the finding that providing caregivers with training and education to increase their family member’s functional skills (such as communication) may reduce caregiver stress by increasing the caregiver’s confidence levels (Bebko et al. 1987).  Researchers have also found that parents who reported high levels of confidence in managing their child’s major difficulties and perceived others in the family as similarly successful also reported lower stress rates (Sharpley and Bitsika 1997).

In my practice, I utilize BST to teach caregivers skills related to communication and socialization training and areas of daily living such as toileting, dressing, toothbrushing and community safety.  I recently utilized BST to teach a modified PECS (Picture Exchange Communication System) to a client’s caregivers. After reaching fluency criteria for each step of the target skill, the trained caregiver was capable of effectively training the modified PECS procedure to the second caregiver.  Success rates for each steps of the BST procedure were measured by observation, data collection and data analysis of procedural integrity demonstrated by the second parent during sessions with the client.  Success rates were also measured by data analysis  of the client’s rate of progress in reaching various communication targets via use of the modified PECS taught by caregivers. 

  • This study did include maintenance data. Why is this data valuable? Do you collect maintenance data on the caregiver training you provide?

According to Alberto & Troutman, 2013, ‘maintenance’ is defined as “performing a response over time, even after systematic applied behavior procedures have been withdrawn”.  Maintenance is demonstrated over time when the skill continues to occur after all direct teaching of the particular skill has been discontinued. 

 Maintenance data could also be utilized to assist in shaping additional skills.  For example, prior to teaching a client receptive discrimination skills related to picture identification in a field of 3 stimuli, it is important to evaluate the presence or absence of certain prerequisite skills such as attending, gesturing (i.e., pointing or eye gaze), following direction and ability to identify objects depicted in the array.  Without information gathered from maintenance skill probes (i.e., attending, pointing, tact repertoire, etc.), teaching the skill of receptive discrimination may not be possible if the client has not exhibited mastery of specific prerequisite skills first.

During skill acquisition training, I typically teach a targeted behavior until the recipient exhibits fluency in exhibiting that behavior.  The computer- generated data system I utilize in my practice includes pre-set monitoring schedules of maintenance data based upon a timed schedule.  Maintenance probes are automatically scheduled in a staggered fashion.  For example, if the client exhibits proficiency in engaging in a specific skill during baseline, that skill is automatically scheduled for a maintenance probe on a monthly basis.  If a client reaches fluency of a specific skill after commencement of treatment, the target is scheduled for maintenance in a staggered time frame (i.e., weekly, bi-weekly, monthly, bi-monthly and annually). After the client reaches mastery criterion for annual maintenance, the target is considered ‘closed’.  If at any time the target fails maintenance, the target is added back into treatment.  

If a clinician is teaching skills to fluency, the necessity of relying on maintenance data to determine if the skill remains in that client’s behavior repertoire becomes less relevant. 

  • Consider a particular skill you are teaching one or more clients. What would BST look like to teach caregivers how to implement the necessary procedures for teaching that skill?

A particular skill BST could be utilized to teach is use of utensils during mealtime.

Instruction – For this step, if a client exhibits adequate receptive skills related to vocal/verbal instruction, one may say to the client, “When you eat certain foods, such as spaghetti or vegetables, you use a fork to pick the food up. You wouldn’t use a fork to eat foods such as cereal or pudding.”

If the client does not exhibit adequate receptive language skills, one may describe the skill to the caregiver.  For example: “We teach the skill of eating with utensils to assist with independent functioning.  We will practice this skill first, with a fork and upon reach specific mastery criteria, we will proceed in teaching use of additional utensils, such as a spoon.  It’s best to practice this skill when motivation to eat is high in order to increase rate of reinforcement and eventually, acquisition of mastery criteria (i.e., if the client is hungry, his motivation to follow the rule to use a fork to eat may be higher compared to times when he is not hungry). Reinforcement for use of the fork is naturally built in, as the food he eats with the fork will serve as reinforcement for the targeted behavior.”

Along with vocal/verbal instruction of the BST steps, I may also provide the caregiver with written steps to the procedure to assist with fluency.

Modeling – For this step, during mealtime, I model the steps described above to the caregiver.  I provide a description of each step as the step is being performed to the caregiver.

Rehearsal –For this step, encourage the caregiver to implement the steps to practice the skill.  During these practice sessions, data recording is critical to determine fluency of the practice of the targeted skill.

Feedback – Prior to this step, I discuss with the caregiver the form of feedback they prefer to receive (in-situ feedback or feedback after each trial session has ended).   Throughout my career I have learned the importance of tailoring my delivery of feedback to individual preference (some caregivers prefer feedback while they are performing the step, while others prefer to receive feedback after they have completed the step).  Once I have determined the timing of my feedback, I deliver the feedback in the context agreed upon.

  • The article states, “General instructions were provided prior to baseline, but parents were only able to implement the procedures effectively when full instructions, modeling, rehearsal and feedback were used to train to mastery.” How can you change your current practice to ensure that you are providing the necessary steps to help caregivers master skills they have selected for parent training?

To streamline the often time-intensive process BST requires, I typically stagger the trainings across multiple sessions.  Delivery of insurance-based family training services is generally provided in a time intensive and structured fashion. To meet these stringent guidelines and to ensure I deliver the most effective and efficient services, I provide the caregiver with written and verbal steps to BST across several consecutive sessions.  I review each step with the caregiver and assign weekly assignments to practice specific steps.  During each family training visit, I review and model the steps and request the caregiver to perform the step they worked on the week prior.  After the caregivers reach specific fluency rates in responding accurately,  additional steps are introduced.  

One method of training I may consider including in my caregiver trainings when delivering BST, is use of video modeling.  Video modeling is a teaching procedure that involves an individual viewing a videotaped sample of a model performing a specific, scripted activity or task. Immediately following having viewed the video-based model, the individual is directed to perform the activity or script he or she observed in the video (e.g., MacDonald, Clark, Garrigan, & Vangala, 2005). Use of video modeling may further address time constraints to training that is often a barrier in delivery of home-based services.  Video modeling may also assist in in higher rates of procedural integrity when working with caregivers who learn more effectively through use of visual guides as opposed to textual guides only.

BST is an incredibly invaluable method of teaching new skills.  With careful planning and commitment to learning, caregivers have a unique opportunity to actively participate in their family member’s treatment to help them engage in socially meaningful ways.

References

Alberto, P., & Troutman, A. C. (2013). Applied behavior analysis for teachers. Boston: Pearson.

Bebko JM, Konstantareas MM, Springer J. Parent and professional evaluations of family stress associated with characteristics of autism. Journal of Autism and Developmental Disorders. 1987; 17:565–576.

MacDonald, R., Clark, M., Garrigan, E., &Vangala, M. (2005) Using video modeling to teach pretend play to children with autism. Behavioral Interventions, 20, 225-238. 

Parsons M. B., Rollyson J. H., Reid D. H. Evidence-based staff training: A guide for practitioners. Behavior Analysis in Practice. 2012; 5:2–11. 

Parsons, M. B., Rollyson, J. H., & Reid, D. H. (2013). Teaching Practitioners to Conduct Behavioral Skills Training: A Pyramidal Approach for Training Multiple Human Service Staff. Behavior analysis in practice6(2), 4–16. doi:10.1007/BF03391798.

Pence S. T., St. Peter C. C., Tetreault A. S. Increasing accurate preference assessment implementation through pyramidal training. Journal of Applied Behavior Analysis. 2012;45:345–359.

Sharpley, C. F., & Bitsika, V. (1997). Influence of gender, parental health, and perceived expertise of assistance upon stress, anxiety, and depression among parents of children with autism. Journal of Intellectual and Developmental Disability, 22, 19–29.

Watson, Paul & A. Workman, Edward. (1981). The non-concurrent multiple baseline across-individuals design: An extension of the traditional multiple baseline design. Journal of behavior therapy and experimental psychiatry. 12. 257-9.


Elizabeth A. Drago, M.A., BCBA, LBA, is a Board Certified and Licensed Behavior Analyst and a consultant at Proud Moments Therapy located on Long Island, New York and Comprehensive Behavior Supports, located in Brooklyn, NY.  She has over 15 years’ experience working with individuals with developmental and related disabilities and has advanced training in areas of autism, behavior disorders, sleep disorders, intellectual disabilities and positive behavior supports.  As a consultant in home and educational settings, she clinically oversees client cases, provides parent training, implements comprehensive skill assessments and programming goals for children diagnosed with ASD, conducts staff trainings for effective performance improvement practices and behavior analytic practices and procedures. She holds professional memberships in organizations such as New York State Association for Applied Behavior Analysis, Association for Behavior Analysis International, Association of Professional Behavior Analysis.

Elizabeth is a Board member of the New York State Association for Behavior Analysis (NYSABA), serving the role of Representative at Large. She is also an active member of NYSABA’s Legislative Committee, focusing on efforts to remove the licensure scope of practice restriction in Behavior Analysis in New York State. Elizabeth has contributed significantly to disseminating information related to the scope restriction in Behavior Analysis in NYS. Some of Elizabeth’s achievements in these efforts include developing initiatives such as the video series entitled, ‘This is ABA’.  The purpose of the video series is to highlight the effectiveness and applicability of the practice of Behavior Analysis to individuals of varying diagnoses, not only for those diagnosed with an Autism Spectrum Disorder. This video series is currently featured on the NYSABA website.   Elizabeth also works collaboratively with NYSABA’s Executive Director, Mari Wantanbe-Rose in the development and oversight of NYSABA’s Inaugural ABA Ambassador Award. The NYSABA ABA Ambassador Award recognizes future behavior analysts, or students, who help to disseminate the usefulness and versatility of behavior analysis in various settings.

Elizabeth has presented at NYSABA’s annual professional conference on the topics of Systematic Desensitization (2017) and Self-Care for the Behavior Analyst (2018). She has been invited as a speaker at a roundtable meeting at Proud Moments ABA, presenting on the topic of the use of technical jargon when interacting with caregivers. Elizabeth has also been featured in a newsletter (August 2018 edition) generated by Comprehensive Behavior Supports in recognition of the many significant contributions to the agency and families she serves across Long Island as a Licensed and Board Certified Behavior Analyst.  Elizabeth has been a guest speaker on a Behavior Analytic podcase, ‘Behaviorbabe’, hosted by Dr. Amanda Kelly, discussing the NYS licensure law scope restriction on the practice of Behavior Analysis in NYS. Elizabeth received a Bachelor’s Degree in Clinical Psychology from St. John’s University, graduating Summa Cum Laude. She continued her education, earning her Master’s Degree in Clinical Psychology at Teacher’s College, Columbia University, where she received an honors certificate in education and teaching and was a member of Kappa Delta Phi- Honor Society in Education.   Elizabeth attended post-graduate studies at Penn State University, where she completed coursework in Applied Behavior Analysis.  She earned her BCBA certification and licensure in Behavior Analysis in 2014.

ABA Journal Club #5: Caregivers as Interventionists

One of the tenets of ABA is to provide evidence-based practice. The best way to help us do this is to keep up with the literature! Each month, Sam Blanco, PhD, LBA, BCBA will select one journal article and provide discussion questions for professionals working within the ABA community. The following week another ABA professional will respond to Sam’s questions and provide further insight and a different perspective on the piece.

There is a wealth of studies demonstrating that training caregivers to implement interventions is valuable for generalization of skills, improved learner outcomes, and decreases caregiver stress. While many teachers, behavior analysts, and other practitioners work to train caregivers; these practitioners are rarely given specific training on how to train caregivers.

In this month’s journal club article, behavior skills training (BST) is utilized to teach caregivers to be interventionists. BST is a model that involves instruction, modeling, rehearsal, and feedback. We hope this article will get you talking about your current level of training with BST and how your organization can improve in training practitioners to teach caregivers to implement behavior analytic strategies.

Loughrey, T. O., Contreras, B. P., Majdalany, L. M., Rudy, N., Sinn, S., Teague, P., … & Harvey, A. C. (2014). Caregivers as interventionists and trainers: Teaching mands to children with developmental disabilitiesThe Analysis of Verbal Behavior30(2), 128-140.

  • The researchers trained caregivers on a university campus using the BST model prior to home visits. In your current work, would this be a possibility for you? If not, how could you provide this type of training to caregivers? What obstacles can you predict, and how might you address them?
  • Discuss the multiple baseline design used in the study. How does it demonstrate experimental control? What can you determine from a visual analysis of the data?
  • Part of this study included a measure of whether a competently trained parent could teach their spouse how to implement mand training. Why is this important? Have you implemented similar strategies in your own work?
  • This study did include maintenance data. Why is this data valuable? Do you collect maintenance data on the caregiver training you provide?
  • Consider a particular skill you are teaching one or more clients. What would BST look like to teach caregivers how to implement the necessary procedures for teaching that skill?
  • The article states, “General instructions were provided prior to baseline, but parents were only able to implement the procedures effectively when full instructions, modeling, rehearsal, and feedback were used to train to mastery.” How can you change your current practice to ensure that you are providing the necessary steps to help caregivers master skills they have selected for parent training?

WRITTEN BY SAM BLANCO, PhD, LBA, BCBA

Sam is an ABA provider for students ages 3-15 in NYC. Working in education for twelve years with students with Autism Spectrum Disorders and other developmental delays, Sam utilizes strategies for achieving a multitude of academic, behavior, and social goals. She is also an assistant professor in the ABA program at The Sage Colleges.