Category Archives: Applied Behavior Analysis

ABA Journal Club #3: Functional Analysis

Posted on by

One of the tenets of ABA is to provide evidence-based practice. The best way to help us do this is to keep up with the literature! Each month, Sam Blanco, PhD, LBA, BCBA will select one journal article and provide discussion questions for professionals working within the ABA community. The following week another ABA professional will respond to Sam’s questions and provide further insight and a different perspective on the piece.

Head to our Facebook page to join the discussion and let us know your thoughts!

When I was first starting out in behavior analysis, I was amazed at the simplicity and accuracy of functional analysis. Behaviors that had seemed complex and impossible to change suddenly made sense. I felt ready to create interventions to address those behaviors, and started to see more success in my behavior change procedures. Functional analysis remains one of my favorite topics to teach, and one of the questions I get most often from my graduate students is about ethical concerns in relation to completing a functional analysis for potentially dangerous behaviors. 

This has been a concern in the field, and there is a strong evidence base that identifying, assessing, and treating precursor behaviors is effective in reducing the target problem behavior. For this month, I have selected a paper on this topic.

Herscovitch, B., Roscoe, E. M., Libby, M. E., Bourret, J. C., & Ahearn, W. H. (2009). A procedure for identifying precursors to problem behavior. Journal of Applied Behavior Analysis, 42(3), 697-702.

What is the purpose of the current study? How is it relevant to your current work?

The researchers used both indirect and descriptive methods for identifying precursor responses. What were these methods?

Describe each of the probability measures the researchers used. How were these related to each other? Could these be used in your current setting?

What did the authors find was most probable to occur prior to head-hitting behavior? Why is this information important?

When the researchers conducted the functional analysis on the precursor behavior, was the head-hitting behavior eliminated? Why is this important to recognize? What implications does it have for practitioners?

Identifying the precursor behavior can decrease risk resulting from problem behaviors such as self-injurious behavior or aggression. Can you identify a current problem behavior for one of your clients and create a plan for determining precursor behaviors?

Please note that this particular study has only one participant. Sometimes, behavior analysis as a field is criticized for the use of single-subject studies. You can read this previous post  for more on the topic of single-subject studies.

WRITTEN BY SAM BLANCO, PhD, LBA, BCBA

The founder of ABA Journal Club, Sam is an ABA provider for students ages 3-15 in NYC. Working in education for twelve years with students with Autism Spectrum Disorders and other developmental delays, Sam utilizes strategies for achieving a multitude of academic, behavior, and social goals. She is also an assistant professor in the ABA program at The Sage Colleges.

How Siblings Of Children With Autism Can Help Improve Behaviors

Posted on by

When I first came across this study, “Behavioral Training for Siblings of Autistic Children,” I was immediately hesitant. There’s something about the idea of sibling-as-therapist that makes me cringe a little bit. When I work with the families of children with autism, the hope is that the siblings of the child with autism still have a childhood without being pushed into the role of caregiver. And I also want the child with autism to have independence and feel like an individual who is heard, which may be more challenging if their siblings are issuing demands just as a parent or teacher would. But as I read the study, I realized that the work they completed had incredible social significance.

In the study, there were three pairs of siblings. The ages of the children with autism ranged from 5 years old to 8 years old. The ages of the siblings ranged from 8 years old to 13 years old. The researchers trained each sibling of a child with autism how to teach basic skills, such as discriminating between different coins, identifying common objects, and spelling short words. As part of this training, the researchers showed videos of one-on-one sessions in which these skills were taught, utilizing techniques such as reinforcement, shaping, and chaining. What the researchers did next was the part that really stood out to me: they discussed with the siblings how to use these techniques in other environments. Finally, the researchers observed the sibling working with their brother/sister with autism and provided coaching on the techniques.

It should be noted here that the goal of the study was not to have the siblings become the teacher of basic skills. Instead, it was to provide a foundation of skills in behavioral techniques for the sibling to use in other settings with the hope of overall improvement in the behaviors of the child with autism. The researchers demonstrated that, after training, the siblings were able to effectively use prompts, reinforcement, and discrete trials to effectively teach new skills. But, perhaps the most meaningful aspects of the study were the changes reported by both siblings and parents. The researchers provide a table showing comments about the sibling with autism before and after the training. One of the most striking comments after the training was, “He gets along better if I know how to ask him” (p. 136). Parents reported that they were pleased with the results and found the training beneficial.

This study provides excellent evidence that structured training for siblings has real potential for making life a little easier for the whole family. The idea isn’t that they become the therapist, but instead that knowledge truly is power.

REFERENCES

Schriebman, L., O’Neill, R.E. & Koegel, R.L. (1983). Behavioral training for siblings of autistic children. Journal of Applied Behavior Analysis. 16(2), 129-138.

WRITTEN BY SAM BLANCO, PhD, LBA, BCBA

Sam is an ABA provider for students ages 3-15 in NYC. Working in education for twelve years with students with Autism Spectrum Disorders and other developmental delays, Sam utilizes strategies for achieving a multitude of academic, behavior, and social goals. She is also an assistant professor in the ABA program at The Sage Colleges

Pick of the Week: Timers!

Posted on by

Promotion is valid through March 4th, 2019 at 11:59pm EST. Offer cannot be applied to previous purchases, combined with any other offers, transferred, refunded, or redeemed and/or exchanged for cash or credit. Different Roads to Learning reserves the right to change or cancel this promotion at any time.

ABA Journal Club #2: Ethics and Social Media

Posted on by

One of the tenets of ABA is to provide evidence-based practice. The best way to help us do this is to keep up with the literature! Each month, Sam Blanco, PhD, LBA, BCBA will select one journal article and provide discussion questions for professionals working within the ABA community. The following week another ABA professional will respond to Sam’s questions and provide further insight and a different perspective on the piece.

Head to our Facebook page to join the discussion and let us know your thoughts!

It is important in our field to maintain an open conversation about ethics. The Professional and Ethical Compliance Code outlines how behavior analysts are expected to conduct themselves, but sometimes situations are not so black and white. And as the world changes, so do the expectations for ethical conduct. In recent years, issues related to social media have been especially relevant. This month, I’ve selected the following article which addresses the special concerns that come up with the use of social media.

O’Leary, P. N., Miller, M. M., Olive, M. L., & Kelly, A. N. (2017). Blurred lines: Ethical implications of social media for behavior analysts. Behavior Analysis in Practice, 10(1), 45-51 .

  1. The article reviews the codes of ethics for other professions. Why is this valuable for us to do as a profession? Did you learn anything surprising or interesting form this portion of the article?
  1. Since this article was written, our field has a new Professional and Ethical Compliance Code. How does this code differ from the previously used Guidelines for Responsible Conduct? What aspects of the code directly apply to ethical situations related to social media?
  1. “A search on an internet search engine for information related to a procedure or scientific concept may yield results as to what that procedure or concept is. The same search on a social media outlet may yield results as to whether or not that procedure or concept should be used (p. 47.) Discuss this difference.
  1. Behavior analysts and others interested in the topic may turn to social media to get answers to their questions due to the low response effort involved and the speed of reinforcement. How can we decrease response effort and increase reinforcement for referring to the scientific literature to answer our questions?
  1. The authors provide suggestions for how behavior analysts should behave on social media. Are there any suggestions you might add? Are there ways you can increase the likelihood of other behavior analysts following these suggestions?
  1. Consider your own behavior on social media. Based on recommendations from the article, what is one change you can make to increase your own ethical behavior in this context?

WRITTEN BY SAM BLANCO, PhD, LBA, BCBA

Sam is an ABA provider for students ages 3-15 in NYC. Working in education for twelve years with students with Autism Spectrum Disorders and other developmental delays, Sam utilizes strategies for achieving a multitude of academic, behavior, and social goals. She is also an assistant professor in the ABA program at The Sage Colleges.

The Salad Shoppe: Changing the Landscape of Vocational Training

Posted on by

Unemployment rates in the autism community are alarming, but the number of individuals entering the workforce only continues to grow. This presents an overwhelming challenge for special educators tasked with preparing learners for what is often an uncertain future. Vocational training is essential as learners with autism approach the transition to adulthood.  With this in mind, Nassau Suffolk Services for Autism (NSSA) introduced The Salad Shoppe in the fall of 2017.

The curriculum was developed by Kathryn Reres and Rebecca Chi, devoted special educators determined to ensure dignified and purposeful futures for the eight young adult students in their classroom. The focus was to create a program that would provide functional tasks for each learner based on their individual skills, interests and IEP goals. The result was an innovative vocational training curriculum that highlights the strengths of each participant, introduces new skills into their everyday lives and serves as a profitable social enterprise. 

The Salad Shoppe model requires multiple steps to be taken over the course of two days, including: Tracking and counting money, taking inventory, creating shopping lists, purchasing, food preparation, converting a customer’s order form to food assembly, delivery and clean up. This comprehensive list ensures that every learner has the opportunity to perform a task that is meaningful and functional to them. (The staff at NSSA are reaping the benefits too! Fresh, healthy, personally-delivered lunches each week have been a huge hit.)

In partnership with Different Roads to Learning, the creative teachers who designed The Salad Shoppe for NSSA are sharing their expertise with special educators everywhere. The published curriculum will allow teachers to implement The Salad Shoppe in a way that will best function for the learners they serve. Now more than ever, there is a crucial need to provide young adults with autism with the tools they will need to take on the competitive workforce. The Salad Shoppe is a cutting-edge curriculum that has opened new doors for educators, learners and parents and will continue to change the landscape of vocational training.

Ready to bring The Salad Shoppe to your school? You can save 15% on this incredible program now through February 18th!

Pick of the Week: The Salad Shoppe!

Posted on by

This week, save 15% on our brand new vocational curriculum! Click on the graphic for more details!

Resources For Parents

Posted on by

This month’s ASAT feature comes to us from Peggy Halliday, MEd, BCBA. To learn more about ASAT, please visit their website at www.asatonline.org. You can also sign up for ASAT’s free newsletter, Science in Autism Treatment, and like them on Facebook!

The following websites include milestones’ checklists, booklets, and a wealth of information to help parents become savvy consumers of autism treatment. The contributors are parent groups well as professional, medical, scientific, and legal and/or advocacy organizations which are available to meet the needs of families.

American Academy of Pediatrics (AAP) 

The AAP is an organization of 67,000 pediatricians committed to the well-being of infants, children, adolescents, and young adults. The AAP website contains recent information about autism prevalence, links to many external resources and training websites, information about pediatrician surveillance and screening, and early intervention guidelines. This site offers great tools and resources for both pediatricians and families. 

Association for Behavior Analysis International (ABAI) 

The ABAI is a nonprofit professional membership organization whose objective for education is to develop, improve, and disseminate best practices in the recruitment, training, and professional development of behavior analysts. ABAI offers membership to professionals and consumers, which entitles them to a newsletter and other benefits, including event registration discounts, and continuing education opportunities. 

Association of Professional Behavior Analysts (APBA) 

The APBA is a nonprofit professional membership organization that is focused on serving professional practitioners of behavior analysis by promoting and advancing the science-based practice of applied behavior analysis. Membership is open to professional behavior analysts and others who are interested in the practice of ABA, including professionals from various disciplines, consumers, and students. 

Association for Science in Autism Treatment (ASAT)  

The ASAT is a non-profit organization founded in 1998 “to promote safe, effective, science-based treatments for people with autism by disseminating accurate, timely, and scientifically sound information, advocating for the use of scientific methods to guide treatment, and combating unsubstantiated, inaccurate and false information about autism and its treatment.” To serve its mission ASAT provides a comprehensive website which includes Research Synopses of a vast array of autism treatments to help families and organizations make informed choices, as well as specific resources for journalists, medical providers, and parents of newly diagnosed children. ASAT also publishes a monthly online publication, Science in Autism Treatment, with over 12,000 subscribers from all 50 states and over 100 countries. ASAT has Media Watch Initiative that responds quickly to both accurate and inaccurate portrayals of autism treatment in the media, and an Externship Program which includes students, professionals, and family members.

Autism New Jersey (Autism NJ) 

Autism NJ is now the largest statewide network of parents and professionals dedicated to improving the lives of individuals with autism and their families. Since its establishment in 1965, Autism New Jersey’s mission has been to ensure that all individuals with autism receive appropriate services. Autism New Jersey is a nonprofit agency committed to ensuring safe and fulfilling lives for individuals with autism, their families and the professionals who support them through awareness, credible information grounded in science, education, and public policy initiatives. 

The Autism Science Foundation (ASF) 

As well as providing information about autism to the general public and promoting awareness of the needs of individuals and families affected by autism, the Autism Science Foundation’s mission is to support and fund scientists and organizations conducting research into Autism Spectrum Disorder. 

Autism Speaks 

Autism Speaks supports global research into the causes, prevention, treatments, and cure for autism and raises public awareness. The website contains information on resources by state, resources for families, advocacy news, and suggested apps for learners with autism. The Autism Speaks 100 Day Kit for Newly Diagnosed Families of Young Children was created specifically for families of children ages 4 and younger to make the best possible use of the 100 days following their child’s diagnosis of autism.  

Autism Wandering Awareness Alerts Response Education (AWAARE).

This organization has developed three “Big Red Safety Toolkits” to respond to wandering incidents: one for caregivers, one for First Responders, and one for teachers. They are free and downloadable from their website.

Behavior Analyst Certification Board (BACB) 

The BACB is a nonprofit corporation established as a result of credentialing needs identified by behavior analysts, state governments, and consumers of behavior analysis services. Their mission is to develop, promote and implement an international certification program for behavior analysis practitioners. The BACB website contains information for consumers (including a description of behavior analysis), conduct guidelines, requirements for becoming certified and maintaining certification, and a registry of certificants that can be searched by name or state. 

Cambridge Center for Behavioral Studies 

The Cambridge Center for Behavioral Studies website seeks to bring together knowledge and behavior analysis resources, a glossary of behavioral terms, online tutorials and suggestions for effective parenting. A continuing education course series is offered through collaboration with the University of West Florida and is designed to provide instruction in a variety of areas of behavior analysis. To utilize all of the features of the website, you must register.

Centers for Disease Control and Prevention (CDC) 

The Act Early website from the CDC contains an interactive and easy-to-use milestones’ checklist you can use to track how your child plays, learns, speaks, acts, and moves ages 3 months through 5 years. The milestones checklist is now available as a free downloadable tracker that follows your child’s progress. There are tips on how to share your concerns with your child’s doctor and free materials that you can order, including fact sheets, resource kits, and growth charts. 

Council of Parent Attorneys and Advocates, Inc. (COPAA) 

The Council of Parent Attorneys and Advocates is a national American advocacy association of parents of children with disabilities, their attorneys, advocates, and others who support the educational and civil rights of children with disabilities. The website provides important information about entitlements under federal law and is divided into resources for students and families, attorneys, advocates, and related professionals, and a peer to peer connection site. 

Council for Exceptional Children (CEC) 

The CEC is an international professional organization dedicated to improving the educational outcomes and quality of life for individuals with exceptionalities. The focus is on helping educators obtain the resources necessary for effective professional practice. Autism is one of many disabilities discussed. 

Education Resources Information Center (ERIC) 

Sponsored by the Institute of Education Services (IES) of the U.S. Dept. of Education, ERIC provides ready access to education literature to support the use of educational research and information to improve practice in learning, teaching, educational decision-making, and research. 

First Signs 

The First Signs website contains a variety of helpful resources related to identifying and recognizing the first signs of autism spectrum disorder, and the screening and referral process. A video glossary is useful in demonstrating how you can spot the early red flags for autism by viewing side-by-side video clips of children with typical behaviors in comparison with children with autism. First Signs aims to lower the age at which children are identified with developmental delays and disorders through improved screening and referral practices. 

Individuals with Disabilities Act (IDEA) 

IDEA is a law that ensures services to children with disabilities throughout the nation. IDEA governs how states and public agencies provide early intervention, special education, and related services to more than 6.5 million eligible infants, toddlers, children, and youth with disabilities. The IDEA website contains information on early intervention services, local and state funding, and Individualized Educational Plan (IEP) issues including evaluation, reevaluation, and procedural safeguards. 

The Interagency Autism Coordinating Committee (IACC)

IACC coordinates ASD related activities across the United States Health and Human Services Department and the Office of Autism Research. The IACC publishes yearly summary advance updates from the field of autism spectrum disorder.

National Autism Center (NAC) 

The NAC is a nonprofit organization dedicated to disseminating evidence-based information about the treatment of autism spectrum disorder and promoting best practices. Through the multi-year National Standards Project, the NAC established a set of standards for effective, research-validated educational and behavioral interventions. The resulting National Standards Report offers comprehensive and reliable resources for families and practitioners. 

National Professional Development Center on Autism Spectrum Disorders (NPDC) 

In 2014 the NPDC, using rigorous criteria, classified 27 focused interventions as evidence- practices for teaching individuals with autism. This website allows you to access online modules for many of these practices as well as an overview and general description, step-by-step instructions, and an implementation checklist for each of the practices. NPDC is currently in the process of updating the systematic review through 2017 as part of the Clearinghouse on Autism Evidence and Practice. It also has a multi-university center dedicated to the promotion of evidence-based practices for ASD. The Center operates three sites at UC Davis MIND Institute, Waisman Center, and the Franklin Porter Graham Child Development Institute at the University of North Caroline Chapel Hill. Each of these websites delivers a wealth of information including online training modules, resources, factsheets, and more.

NIH National Institutes of Health (NIH) 

The NIH, a part of the U.S. Department of Health and Human Services, is the primary federal agency for conducting and supporting medical research. Helping to lead the way toward important medical discoveries that improve people’s health and save lives, NIH scientists investigate ways to prevent disease as well as researching the causes, treatments, and even cures for common and rare diseases. 

The Ohio Center for Autism and Low Incidence (OCALI)

OCALI working in collaboration with the Ohio Department of Education, is a clearinghouse of information on autism research, resources, and trends. The OCALI website contains training and technical assistance including assessment resources and ASD service guidelines.

Organization for Autism Research (OAR) 

OAR is a nonprofit organization dedicated to applying research to the daily challenges of those living with autism. OAR funds new research and disseminates evidence-based information in a form clearly understandable to the non-scientific consumer. The OAR website contains downloadable comprehensive guidebooks, manuals, and booklets for families, professionals, and first responders.  OAR offers recommendations and worksheets for educators and service providers to assist in classroom planning, and a newsletter, “The OARacle.” In conjunction with the American Legion Child Welfare Foundation, OAR also offers Operation Autism for Military Families, a web-based resource specifically designed and created to support military families that have children with autism. 

Rethinkfirst 

Rethink is a global health technology company which provides cloud-based treatment too for individuals with developmental disabilities and their caregivers. Their web-based platform includes a comprehensive curriculum, hundreds of dynamic instructional videos of teaching interactions, step-by-step training modules, and progress tracking features.

Virginia Commonwealth University Autism Center for Excellence 

VCU-ACE is a university-based technical assistance, professional development, and educational research center for autism spectrum disorder in the state of Virginia. VCU-ACE offers a wide variety of online training opportunities for professionals, families, individuals with ASD, and the community at large. The website contains many useful resources, including a series of short how- to videos demonstrating particular evidence-based strategies, webcasts, and online courses. 

Wrights Law 

Wrights Law is an organization which provides helpful information about special education law, education law, and advocacy for children with disabilities in the USA. The Wrights Law website contains an advocacy and law library including articles, cases, FAQs and success stories, and information on IDEA. 

Zero to Three: National Center for Infants, Toddlers, and Families

This is a national, nonprofit organization which seeks to inform, educate, and support professionals who influence the lives of infants and toddlers. The organization supports the healthy development and well-being of infants, toddlers, and their families by supplying parents with practical resources that help them connect positively with their babies. They also share information about the Military Families Project, which supplies trainings, information, and resources for military families with young children. 

Please use the following format to cite this article:

Halliday, P. (2016 revised 2019). Consumer Corner: Some resources for parents. Science in Autism Treatment, 13(2), 27-31.

Peggy Halliday, MEd, BCBA, has served as a member of the Board of Directors of ASAT since 2010. She has been a practitioner at the Virginia Institute of Autism (VIA) in Charlottesville, Virginia since 1998. She oversees trainings for parents and professionals and provides consultation to public school divisions throughout Virginia.

ABA Journal Club #1

Posted on by

            For January, I have selected not one, but two texts. The first is a foundational article that every behavior analyst has probably read more than once. However it’s an important one to revisit, and one that I gain more insight from with each read. The second is a follow-up to the original article.

Article One: Baer, D. M., Wolf, M. M., & Risley, T. R. (1968). Some current dimensions of applied behavior analysis. Journal of Applied Behavior Analysis, 1(1), 91-97.

Article Two: Baer, D. M., Wolf, M. M., & Risley, T. R. (1987). Some still‐current dimensions of applied behavior analysis. Journal of Applied Behavior Analysis, 20(4), 313-327.

Discussion Questions for Baer, Wolf, Risley (1968):

The tone of the 1968 article is hopeful. The authors express a belief that behavior analytic procedures will become more prevalent as people understand the technology. Do you think they were accurate in this belief? What has been your experience with people accepting the principles of ABA?

Among the seven dimensions discussed in this article, what did you find most interesting?

The authors state that the term applied is defined by the interest society shows in the problem being studied. Is this how you have thought of the term applied in the past? How does your current work fit into this description? And how do we know society is interested?

In their discussion of analytic, the authors explain two designs commonly used to demonstrate reliable control of behavior change. Do you use these designs in your every day practice? Why or why not?

Do you think all seven of these dimensions hold equal importance? Why or why not?

How do the seven dimensions make ABA different from other fields?

Discussion Questions for Baer, Wolf, Risley (1987):

Compare and contrast the descriptions of each of the seven dimensions across the two articles.

The authors identify social validity as a good measure of effectiveness. However, they also identify issues with the assessment of social validity. How do you think that has changed since they wrote this article? How do you assess social validity in your own work?

What do you think of the discussion of high-quality failures?

In what ways do you follow the seven dimensions in your current work?

Can you identify a way to improve your own work based on the seven dimensions?

If you were to identify an eighth dimension that is not currently represented in these articles, what might you add?

SAM BLANCO, PhD, LBA, BCBA is an ABA provider for students ages 3-15 in NYC. Working in education for twelve years with students with Autism Spectrum Disorders and other developmental delays, Sam utilizes strategies for achieving a multitude of academic, behavior, and social goals. She is also an assistant professor in the ABA program at The Sage Colleges.

How Do We Measure Effectiveness?

Posted on by

This month’s ASAT feature comes to us from Dr. Daniel W. Mruzek, PhD, BCBA-D, Associate Professor, University of Rochester Medical Center. To learn more about ASAT, please visit their website at www.asatonline.org. You can also sign up for ASAT’s free newsletter, Science in Autism Treatment, and like them on Facebook!

Marketers of purported interventions for autism spectrum disorder (ASD), whether they are pills, devices, or exercises, claim that their products are effective. As proof, they point to any number of measures some valid, some questionable, and some potentially misleading. Given that many of these “treatments” may be costly, ineffective and even dangerous, it is good to consider what constitutes legitimate measures of therapeutic benefit. How will we know if the intervention actually works?


A first step when presented with a potential treatment option is to investigate its scientific record. One can certainly ask the marketer (or therapist, interventionist, clinician, etc.) for examples of peer-reviewed studies examining the effectiveness of their recommended intervention. Indeed, this can be a great first step. An honest marketer will be glad to give you what they have in this regard or freely disclose that none exist. A good second step is to consult with a trusted professional (e.g., physician, psychologist, or behavior analyst who knows your family member), in order to get an objective appraisal of the intervention. If, after this first level of investigation is completed, a decision is made to pursue a particular intervention for a family member there are additional questions that one can ask the marketer prior to implementation that may prove very helpful in determining effectiveness after the intervention has been employed. These include the following:


Question 1: “What behaviors should change as a result of the intervention?”
Virtually any ASD intervention that is truly effective will result in observable change in behavior. For example, a speech intervention may very well result in increased spoken language (e.g., novel words, greater rate of utterances). An academic intervention should result in specific new academic skills (e.g., greater independent proficiency with particular math operations). An exercise purported to decrease the occurrence of challenging behavior will, if effective, result in a lower rate of specific challenging behaviors (e.g., tantrums, self-injury). As “consumers” of ASD interventions, you and your family member have every right to expect that the marketer will identify specific, objective, and measurable changes in behaviors that indicate treatment efficacy. Scientists refer to such definitions as “operational definitions” – these are definitions that are written using observable and measurable terms. If the marketer insists on using ill-defined, “fuzzy” descriptions of treatment benefit (e.g., “increased sense of well-being”, “greater focus and intentionality”, an increased “inner balance” or “regulation”), then “Buyer Beware!” These kinds of outcome goals will leave you guessing about treatment effect. Insist that operational definitions of target behaviors be agreed upon prior to start of intervention.

Question 2: “How will these behavior changes be measured?”
Behavior change is often gradual and variable. Behavior change often occurs in “fits and starts” (i.e., the change is variable). Also, our perception of behavior change can be impacted by any number of events (e.g., the co-occurrence of other therapies, our expectations for change). Therefore, it is the marketer’s responsibility to offer up a plan for collecting data regarding any change in the identified “target” behaviors. Usually, it is best to record numerical data (e.g., number of new words spoken by the individual, duration [in minutes] of tantrums, etc.) The use of numerical data to measure the change of operationally defined target behaviors is one of the best ways for a treatment team to elevate their discussion above opinion, conjecture and misrepresentation. If a pill, therapy or gadget is helpful, there is almost assuredly a change in behavior. And, that change is almost always quantifiable. Setting up a system to collect these numerical data prior to the initiation of the new intervention is a key to objective evaluation of intervention. Don’t do intervention without it.


Question 3: “When will we look at these intervention data and how will they be presented?”
Of course, it is not enough to collect data; these data need to be regularly reviewed by the team! One of the best ways to organize data is “graphically”, such as plotting points on a graph, so that they can be inspected visually. This gives the team a chance to monitor overall rates or levels of target behaviors, as well as identify possible trends (i.e., the “direction” of the data over time, such as decreasing or increasing rates) and look for change that may occur after the start of the new intervention. Note that the review of treatment data is generally a team process, meaning that relevant members of the team, including the clinicians (or educators), parents, the individual with ASD (as appropriate) often should look at these data together. Science is a communal process, and this is one of the things that makes it a powerful agent of change.


An interventionist with background in behavior analysis can set up strategies for evaluating a possible treatment effect. For example, in order to gage the effectiveness of a new intervention, a team may elect to use a “reversal design”, in which the target behaviors are monitored with and without the intervention in place. If, for example, a team wishes to assess the helpfulness of a weighted blanket in promoting a child’s healthful sleep through the night, data regarding duration of sleep and number of times out of bed might be looked at during a week with the blanket available at bedtime and week without the blanket available. Another strategy is to use the intervention on “odd” days and not use it on “even” days. Data from both “odd” and “even” days can be graphed for visual inspection, and, if the intervention is helpful, a “gap” will appear between the data sets representing the two conditions. These strategies are not complex, but they give the team an opportunity to objectively appraise whether or not a specific intervention is helpful that is much better than informal observation. Few things are as clarifying in a team discussion as plotted data placed on the table of a team meeting.


If the marketer does not answer these questions directly and satisfactorily, consider turning to a trusted professional (e.g., psychologist, physician or behavior analyst) for help. Families have a right to know whether their hard-earned money, as well as their time and energy, are being spent wisely. Asking these questions “up front” when confronted with a new intervention idea will help. Marketers have a responsibility to present their evidence – both the “state-of-the-science” as reflected in peer-reviewed research, as well as their plans to measure the potential effectiveness of their intervention for the individual whom they are serving.


Speaking of measuring treatment effectiveness, fellow ASAT board member Eric Larsson offers his considerations regarding the use of standardized measures (e.g., IQ) as outcome measures in treatment research (next article; page 20). Though this might be a little out of context for some of our readers, for those of us who rely on direct interpretations of peer-reviewed studies in our work (e.g., researchers, clinicians), Dr. Larsson describes the limitations of sole reliance on change in standardized measures is assessing the scientific validation of an intervention.


Please use the following format to cite this article:
Mruzek, D.W. (2014). ASD intervention: How do we measure effectiveness? Science in Autism Treatment, 11(3), 20-21

About The Author
Daniel W. Mruzek, Ph.D., BCBA-D is an Associate Professor at the University of Rochester Medical Center (URMC), Division of Neurodevelopmental and Behavioral Pediatrics in western New York. He received his doctoral training in Psychology at the Ohio State University and is a former Program Director at the Groden Center in Providence, Rhode Island. Currently, he is an associate professor and serves as a clinician and consultant, training school teams and supporting families of children with autism and other developmental disabilities.


Mruzek coordinates his division’s psychology postdoctoral fellowship program in developmental disabilities and is an adjunct faculty member in the University of Rochester Warner School of Education. He is actively involved as a researcher on several externally funded autism intervention research studies and has authored and co-authored more than 20 peer-reviewed articles and book chapters on autism and other developmental disabilities. Dr. Mruzek is on the editorial board for the journals Focus on Autism and Other Developmental Disabilities, Behavior Analysis in Practice, Journal of Mental Health Research in Developmental Disabilities, and Intellectual and Developmental Disabilities. Dr. Mruzek is a former member of the Board of Directors of the Association for Science in Autism Treatment.