By Christy Evanko and Emaley McCulloch. *Updated February 2021
The tug of war that behavior analysts and insurance companies engage in can be all-encompassing! The dichotomy of clinical effectiveness vs. necessity of standards is real enough that the Behavior Analyst Certification Board® (BACB) has an ethics code that relates to it (2014):
“2.04 d. Behavior analysts put the client’s care above all others and, should the third party make requirements for services that are contraindicated by the behavior analyst’s recommendations, behavior analysts are obligated to resolve such conflicts in the best interest of the client. If said conflict cannot be resolved, that behavior analyst’s services to the client may be discontinued following appropriate transition.“
Behavior Analyst Certification Board®
While Code 2.04 may not specifically be written for insurance companies, there are most definitely times when behavior analysts’ clinical recommendations are at odds with what the insurance company (payor) will accept. One of the biggest areas where this comes into play is with assessments. The BACB has something to say on this, too:
3.01 Behavior-Analytic Assessment
“(a) Behavior analysts conduct assessments prior to making recommendations or developing behavior-change programs. The type of assessment used is determined by the client’s need and consent, environmental parameters, and other contextual variables. When behavior analysts are developing a behavior-reduction program, they must first conduct a functional assessment.
(b) Behavior analysts have an obligation to collect and graphically display data, using behavior analytic conventions, in a manner that allows for decisions and recommendations for behavior-change program development.
Behavior Analyst Certification Board®
The BACB tells behavior analysts the type of assessment used is determined by the client’s (1) needs and (2) consent, (3) environmental parameters, and other (4) contextual variables.
According to The Council for Autism Service Providers Practice Guidelines, client’s behaviors must be assessed before creating a treatment plan and periodically to guide treatment and evaluate progress (for example, on a semiannual basis). Some payors require certain assessments at regular intervals. Each learners are different and some may need assessment more often than every 6 months and some may need it less. Functional assessment of behaviors should be conducted when creating a Behavior Intervention Plan or if the learner is not making expected progress.
*ABA Skill Repertoire – designed for Behavior Analysts to identify behavioral and skill excesses and deficits that guide the creation of an appropriate and effective treatment plan. Examples include VB-MAPP, ABLLS-R, PEAK, EFL.
*Adaptive Behavior – Assesses the person’s independent display of skills necessary for normal daily living. Adaptive Behavior includes grooming, getting dressed, avoiding danger, eating, following school rules, managing money, chores, getting and maintaining a job, and making friends. Examples include the Vineland and the ABAS-3.
Autism Screening and Assessment- Identifies children on the autism spectrum and assesses the severity of core symptoms, deficits, and behavioral outcomes. Many of these instruments are used as outcome measures in research and clinical settings, especially clinical trials (Payakachat, 2013). This assessment is performed or supervised by a professional whose scope of practice includes diagnosing. Examples include the CARS, ADOS and ADI.
*Developmental- Measures various aspects concerning a child’s physical and mental growth and development while mapping a child’s performance compared with children of similar age. Examples include PEP-3, Vineland and Bailey III.
*Functional Assessment of Problem Behavior- Identifies the aspects of the environment that may contribute to the development and continued occurrence of problem behavior. That is functional assessments are designed to identify where, when, and why problem behavior occurs (CASP, 2014). Examples include the MAS, QABF and FAI.
Intellectual – Tests an individual’s current intellectual functioning often measured through various reasoning tasks and assigning an intelligence quotient (IQ). The assessment is done by Psychologists. Examples include the Standford-Binet and WISC-5.
*Parental Stress– Identifies issues that may lead to problems in the child’s or parent’s behavior and stress. Examples include the PSI-4 and PSS.
*Social and Emotional – detects and monitors signals that indicate whether a child may be delayed in aspects of social-emotional development, such as communication, autonomy, affect, and interaction with people. Examples include the Social Skills Checklist, SRS-2 and SSRS.
Speech and Language – measures of a person’s communication skills. The evaluation is done by a speech-language clinician. Examples include the CELF-5, TOPL and TOPS.
*Transitional and Vocational- evaluates a person’s strengths, needs, preferences, and interests as they relate to the demands of current and future living, learning, and working environments. Examples include the Brigance Transitional Skills Inventory and Career Ability Placement Survey.
*BCBAs and BCBA-Ds can usually administer these assessments with training and sometimes certification depending on the instrument.
The Standards for Educational and Psychological Testing published by the American Educational Research Association (AERA), American Psychological Association (APA), and the National Council on Measurement in Education (NCME) maintain that individuals should use only those tests for which they have the appropriate training and expertise. Many assessment vendors require that the provider demonstrate qualifications in order to purchase assessments. For Example Pearson has 3 levels of qualifications (2021).
There are no special qualifications to purchase these products.
OR
OR
OR
OR
Tests with a C qualification require a high level of expertise in test interpretation, and can be purchased by individuals with:
OR
OR
The above qualification levels are taken directly from Pearson Assessments
Some of the assessments in the below list are not behavior analytic in nature and for some, behavior analysts do not have the qualifications to administer the assessment. So, what do behavior analysts do if they want to use a replacement assessment that isn’t accepted by the insurance company? This is a tricky question and not one that is easily answered. We see several options.
While there is no easy answer to this conundrum, it does highlight the need for behavior analysts to become more familiar with the assessment tools that exist and are evidence-based, and work together with other behavior analysts as well as professionals outside of our field to get to the best outcomes for the individuals whom we serve.
(if there are any assessments that you feel are very commonly used and are missing, contact emaley@motivity.net)
Provides a complete assessment of adaptive skills across the life span.
Assessment Type: Adaptive Behavior
Research: “For the 11 skill areas assessed—norm-referenced scaled scores. For the 3 adaptive domains and the General Adaptive Composite (GAC)—norm-referenced standard scores, confidence intervals for standard scores, and percentile ranks. In addition, all scores can be categorized descriptively”
Qualifications: Level C: MA (psychologist, SLP, OT) A master’s degree (MA, MS, MSW CAGS) in psychology, school counseling, occupational therapy, speech-language pathology, social work, education, special education, or related field; OR BA (occupational therapist) A bachelor’s degree (BA, BS) in fields listed above AND License or certification from an agency/organization that requires training and experience in assessment
Ages: birth to 89 years
Reference & Publisher:
https://www.wpspublish.com/abas-3-adaptive-behavior-assessment-system-third-edition
The ABLLS-R is an assessment, curriculum, and skill tracking program based on the behavior analysis of Language from Skinner’s book, Verbal Behavior (1957). It was designed to be used to help guide the instruction of language and critical learner skills for children with autism or other developmental disabilities.
Skill areas: The ABLLS-R® provides a comprehensive review of 544 skills from 25 skill areas including language, social interaction, self-help, academic and motor skills that most typically developing children acquire prior to entering kindergarten. The task items within each skill area are arranged from simpler to more complex tasks.
Ages: The ABLLS-R is for assessing Basic Language and Learning Skills and is recommended for children of all ages, but mainly focuses on language skills developed by typical developing children ages 2-6, when children learn to speak their first language.
Assessment Type: ABA Skill Repertoire Assessments
Qualifications: None. Training is recommended.
Reference & Publisher: You can purchase and learn more at Partington Behavior Analysts website. The ABLLS-R assessment is sold as a set (includes: 1 ABLLS-R Guide & 1 ABLLS-R Protocol) for $64.95 or separately for $39.95 each. BAI also offers the ABLLS-R Data and Task Organizer kit for $495. The kit does not come with the ABLLS-R assessment but does come with 2 boxes of picture cards and directions. The picture-stimuli correlate with the ABLLS-R assessment and can be helpful but is not required for administering the ABLLS-R assessment.
“Allows you to accurately assess and diagnose autism spectrum disorders across age, developmental level, and language skills”
Ages: 12 months through adulthood
Assessment Type: Autism Screening and Assessment
Qualifications: Level C: MA (psychologist, SLP, OT) A master’s degree (MA, MS, MSW, CAGS) in psychology, school counseling, occupational therapy, speech–language pathology, social work, education, special education, or related field; OR BA (occupational therapist) A bachelor’s degree (BA, BS) in fields listed above AND License or certification from an agency/organization that requires training and experience in assessment
Reference & Publisher: https://www.wpspublish.com/ados-2-autism-diagnostic-observation-schedule-second-edition
Description & Use: The Assessment of Functional Living Skills (AFLS) is a criterion-referenced skills assessment tool, tracking system, and curriculum guide. AFLS is used for teaching children, adolescents, and adults with developmental disabilities the essential skills they need in order to achieve the most independent outcomes.
Skill Areas: The AFLS Full Set assesses and provides curriculum guides for Basic Living Skills, Home Skills, Community Participation Skills, School Skills, Independent Living Skills and Vocational Skills.
Ages: The AFLS is a criterion-referenced assessment that is designed to be used from early elementary through adulthood.
Assessment Type: ABA Skill Repertoire Assessments
Qualifications: None. Training is recommended.
Reference & Publisher: You can purchase the paper copies at the Functional Living Skills Store. The AFLS is also available in a digital version.
Description & Use: “Allows you to quickly screen a child for developmental delays in five key areas”
Assessment Type: Developmental
Ages: Birth to 12 years, 11 months
Research: Standardized on a nationally representative sample of 2,216 individuals
Qualifications: Level B: BA (schoolteacher) A bachelor’s degree (BA, BS) in psychology, school counseling, occupational therapy, speech–language pathology, social work, education, special education, or related field.
Reference & Publisher:
https://www.wpspublish.com/dp-3-developmental-profile-3
“The Daily Living Activities (DLA) Functional Assessment is a functional assessment, proven to be reliable and valid, designed to assess what daily living areas are impacted by mental illness or disability. The assessment tool quickly identifies where outcomes are needed so clinicians can address those functional deficits on individualized service plans.”
Assessment Type: Adaptive Behavior
Ages: all ages
Research: “The DLA is a reliable and valid measure for the purposes of level of care consideration, treatment planning around outcomes, and to correlate and predict DSMIV, Axis V. Two studies with 971 consumers over repeated measures will be reviewed with the results reflecting a satisfactory treatment plan time-saver for case coordinators. The tool is published in the Research on Social Work Practice (Abstract and other reference articles are in Appendix B). Please note, however, that since 2005, the DLA has been copyrighted to protect reliability and validity, not for additional monetary remuneration beyond training fees.”
Qualifications: Level A: The consumer’s primary clinician or case manager typically has the most information about daily functioning at home or in the community and are best prepared to complete the form.
Reference & Publisher:
Description & Use: A Communication, Behavior, and Life Skills Curriculum, Assessment, and Professional Practitioner’s Handbook. EFL is designed for verbal and non-verbal children and adults with moderate-to-very severe disabilities, including autism, and limited skill repertoires. It is, “composed of functional skills and behaviors, which are essential for effective daily living and which result in an improved quality of life for children and adults” McGreevy.
Skill Areas: Essential for Living includes over three thousand skills sorted into domains on communication, language, daily living, social, functional academic, and tolerating skills, along with a domain on severe problem behavior, which encompasses the core components of autism and many other developmental disabilities.
Assessment Type: ABA Skill Repertoire Assessments
Ages: 2 through adulthood
Research: no published research as of May 2020
Qualifications: “[EFL] was written in language familiar to most professionals in the fields of special education, developmental disabilities, and rehabilitation.” Training is recommended.
Reference & Publisher: The EFL can be purchased on Patrick McGreevy’s site.
Description & Use: The Early Start Denver Model Curriculum Checklist for Young Children with Autism is used to comprehensively assess the skills of toddlers and preschoolers with autism spectrum disorder across multiple developmental domains and to establish individualized teaching objectives. Administered every 12 weeks, it is an essential component of the intervention program described in the authoritative manual, Early Start Denver Model for Young Children with Autism. Sold in sets of 15 ready-to-use booklets.
Assessment Type: ABA Skill Repertoire Assessments
Ages: Toddlers
Qualifications: Become certified in ESDM
Reference & Publisher: EDSM.co
“The Functional Analysis Screening Tool (FAST) is a 16‐item questionnaire about antecedent and consequent events that might be correlated with the occurrence of problem behavior. Items are organized into 4 functional categories based on contingencies that maintain problem behavior. “
Assessment Type: Functional Assessment of Problem Behavior
Ages: all ages
Research: Reliability and Validity of FAST
Qualifications: Level B
Reference & Publisher: Here is the pdf file of the FAST
“Assesses responsiveness to intervention in children with ASD. Unlike existing assessments for ASD, the PDDBI was developed to assess both problem behaviors as well as appropriate social, language, and learning/memory skills.”
Assessment Type: Autism Screening and Assessment
Ages: 1 year, 6 months to 18 years, 5 months
Qualifications: Level B: A degree from an accredited 4-year college or university in psychology, counseling, speech-language pathology, or a closely related field plus satisfactory completion of coursework in test interpretation, psychometrics and measurement theory, educational statistics, or a closely related area; or license or certification from an agency that requires appropriate training and experience in the ethical and competent use of psychological tests.
Research: Standardization sample consisted of 369 parents and 277 teachers of children with well-defined autism from a range of racial/ethnic backgrounds and geographic regions.
Test-retest stability for the teacher ratings ranged from .65 to .99 over an average 2-week interval. For the parent sample, test-retest stability ratings ranged from .38 to .91 over a 12-month interval.
Concurrent validity was assessed through comparison with the Childhood Autism Rating Scale, the Nisonger Child Behavior Scales, the Vineland Adaptive Behavior Scales, and the Griffiths Mental Development Scales.
Clinical validity was assessed through comparison with the ADI™-R, the ADOS™-G, and the Vineland Adaptive Behavior Scales.”
Reference & Publisher: PAR
The Verbal Behavior Milestones Assessment and Placement Program (VB-MAPP) is a criterion-referenced assessment tool, curriculum guide, and skill tracking system that is designed for children with autism, and other individuals who demonstrate language delays. The VB-MAPP is based on B.F. Skinner’s (1957) analysis of verbal behavior, established developmental milestones, and research from the field of behavior analysis.
Skill Areas: The skills assessed include mand, tact, echoic, intraverbal, listener, motor imitation, independent play, social and social play, visual perceptual and matching-to-sample, linguistic structure, group and classroom skills, and early academics.
Ages: 2-6
Assessment Type: ABA Skill Repertoire Assessments
Qualifications: Level B: A degree from an accredited 4-year college or university in psychology, counseling, speech-language pathology, or a closely related field plus satisfactory completion of coursework in test interpretation, psychometrics and measurement theory, educational statistics, or a closely related area; or license or certification from an agency that requires appropriate training and experience in the ethical and competent use of psychological tests.
Research: See a list of research related to VB-MAPP on Mark’s Website
Reference & Publisher: Order the books from VBPress and digital VB-MAPP app
Description & Use: “Vineland Adaptive Behavior Scales Third Edition is the leading instrument for supporting the diagnosis of intellectual and developmental disabilities. Vineland-3 not only aids in diagnosis, but provides valuable information for developing educational and treatment plans”
Ages: birth to 90+
Assessment Type: Adaptive Behavior
Qualifications: LEVEL B: Tests may be purchased by individuals with: A master’s degree in psychology, education, occupational therapy, social work, or in a field closely related to the intended use of the assessment, and formal training in the ethical administration, scoring, and interpretation of clinical assessments. OR · Certification by or full active membership in a professional organization (such as ASHA, AOTA, AERA, ACA, AMA, CEC, AEA, AAA, EAA, NAEYC, NBCC that requires training and experience in the relevant area of assessment. OR · A degree or license to practice in the healthcare or allied healthcare field. OR Formal, supervised mental health, speech/language, and/or educational training specific to assessing children, or in infant and child development, and formal training in the ethical administration, scoring, and interpretation of clinical assessments.
Research: “Total sample size 6,535. Norm sample for Interview and Parent/Caregiver Forms each comprised 2,560 people. The Teacher Form sample was 1,415 students.”
Reference & Publisher: Order from Pearson
Behavior Analyst Certification Board. (2014). Professional and ethical compliance code for
behavior analysts. Littleton, CO: Author.
Council of Autism Service Providers (“CASP”). Ver. 2.0 (2020). Applied Behavior Analysis
Treatment of Autism Spectrum Disorder: Practice Guidelines for Healthcare Funders and Managers. https://casproviders.org/wp-content/uploads/2020/03/ABA-ASD-Practice-Guidelines.pdf
Pearson. (2021, Feb 2). Qualifications Policy. https://www.pearsonassessments.com/professional-assessments/ordering/how-to-order/qualifications/qualifications-policy.html
Texas Education Agency. (2019) Autism Evaluations. https://www.txautism.net/evaluations
Chief Technology Officer
As Motivity’s CTO and Chief Software Architect, Catalin is the core designer and implementer of Motivity’s architecture and user experience. His industry experience spans more than 20 years, across a multitude of domains. He has 10 patents on diverse applications such as data encoding, user interaction, and latency compensation. Prior to joining Motivity, Catalin was a chief architect of McKesson Corporation’s market-leading, large scale radiology systems. His extensive expertise and diverse background have allowed him to take a unique approach to designing Motivity’s cutting-edge knowledge modeling capabilities.
President
Dr. Jakobovits is an experienced business leader who has a long career in clinical software. He received his Ph.D. in Computer Sciences from the University of Washington, then built a successful start up, Vivialog Technologies, which he sold to McKesson in 2008. He served as a Vice President at McKesson for 5 years before leaving to launch Motivity Systems. He is widely published in computer science and informatics journals, and has been awarded several patents. He has raised over $13M in seed capital for his startups through NIH Small Business Innovative Research grants. He is a Research Affiliate with the University of Washington Autism Center.
VP of Clinical Products
Emaley McCulloch co-founded Autism Training Solutions (ATS), an online learning company, in 2010 which has trained hundreds of thousands of professionals and parents around the globe in evidence-based autism interventions. ATS was acquired by Relias in 2014 and after serving as the VP of Research for 5 years, is currently the Vice President of Clinical Products at Motivity Systems. She is a Board Certified Behavior Analyst and holds an MA in Special Education. She has over 20 years’ experience in the field of autism and ABA and has provided and overseen services to hundreds of individuals between the ages of 18 months to 24 years in homes, schools and clinical settings. For eight years she served as a consultant and Clinical Supervisor at agencies based in Hawaii and Japan where she trained groups of professionals and parents