What Did the Nonverbal Person Say to the Verbal Person? Answer: Anything they want!

What Did the Nonverbal Person Say to the Verbal Person?

Answer: Anything they want!

Cognixion's goal is to unlock speech for hundreds of millions of people worldwide affected by communication disabilities.

This week our Founder and CEO Andreas Forsland and Tim Jin, a Cognixion Brainiac Council Member, will be exploring the world of AI-powered communication.

Here at Cognixion we focus on accessible communication through the realm of AAC, AR, and Neurotechnology. In addition to software offering eye-tracking and facial recognition, future products explore the world of brain-computer interface and augmented reality. That’s where Tim Jin comes in. Tim was born with Cerebral Palsy and has used an Augmentative and Alternative Communication (AAC) device since elementary school. A graduate from Cal State Long Beach in speech communication, he is also an active member on several boards of directors.

Have a question for Andreas or Tim?

Drop it in the comment section below and we will make sure they get it.

What's NEW? What's NEXT? With Krista Howard A.A., AAC Mentor with We Speak AAC

What’s NEW? What’s NEXT? Facebook Live Interview

Initially recorded on October 28th, 2020

What's NEW? What's NEXT? with Krista Howard A.A., AAC Mentor with We Speak AAC

Highlights:

  • Modeling in a time of COVID

  • Limitations of tethered AAC when you are unable to use your hands

  • Becoming an SLPA who is an AAC user

Join us for a new AAC Live interview
every Wednesday!

Are you a Healthcare Professional?

What's NEW? What's NEXT? With Gil Addison, PathPoint Community Integration Manager

What’s NEW? What’s NEXT? Facebook Live Interview

Initially recorded on October 21st, 2020

What's NEW? What's NEXT? with Gil Addison, PathPoint Community Integration Manager

Highlights:

  • Challenges of remote services during COVID-19

  • What’s NEXT? Control & Communication

  • Coming together to provide services in a time of remote 

Join us for a new AAC Live interview
every Wednesday!

Are you a Healthcare Professional?

BCI Connection With Joel Ward

BCI Connection Facebook Live Interview

Initially recorded on October 14th, 2020

What's NEW? What's NEXT? with Joel Ward, Technology Strategist.

Highlights:

  • XR- Extended Reality

  • The mix between AR and VR

  • Combining current technologies for new solutions

Join us for a new AAC Live interview
every Wednesday!

Are you a Healthcare Professional?

BCI Connection With Larry Goldberg

BCI Connection Facebook Live Interview

Initially recorded on October 7th, 2020

What's NEW? What's NEXT? with Larry Goldberg, Head of Accessibility for Verizon Media, former Senior Director of Accessible Media for Yahoo.

Highlights:

  • Creating accessibility in film & TV

  • Ever wonder how closed captioning works?

  • The need for dynamic image recognition and scene description

Join us for a new AAC Live interview
every Wednesday!

Are you a Healthcare Professional?

AAC: What's NEW? What's NEXT? With Glenda Watson Hyatt

AAC: What’s New? What’s Next? Facebook Live Interview

Initially recorded on September 30th, 2020

What's NEW? What's NEXT? with Glenda Watson Hyatt, BA, Author, Keynote Speaker and a Badass Agitator.

Highlights:

  • International Keynote Speaker

  • How will people with communication disabilities be included?

  • Communication within healthcare settings

Join us for a new AAC Live interview
every Wednesday!

Are you a Healthcare Professional?

AAC: What's NEW? What's NEXT? With Richard Ellenson

AAC: What’s New? What’s Next? Facebook Live Interview

Initially recorded on September 23rd, 2020

What's NEW? What's NEXT? with Richard Ellenson, Founder of Talk Suite, former CEO of the Cerebral Palsy Foundation and creator of Blink Twice and Panther.

Highlights:

  • Started new inclusive school program in NYC

  • Changing the brand of disabilities

  • Anticipatory Communication

Join us for a new AAC Live interview
every Wednesday!

Are you a Healthcare Professional?

AI is Transforming Disabilities into Possibilities

We are honored to have Simeone Scaramozzino of Trans Tech Milan interview our CEO Andreas Forsland about what we have been working on at Cognixion.

Scroll through to read Alison Keiper’s piece on the the interview.

Almost half a billion people worldwide have a speech disability, yet only 3% of them have access to technology that could help them connect and interact with the world around them.

Imagine what the world could look like if each of these people were empowered? To contribute their voices. To share their ideas. To express their full potential. We could have artists, scientists, creators, engineers, change-makers, philosophers, and more among us with undiscovered talents that could revolutionise society.

This has been the mission of Santa Barbara, California-based company Cognixion since its founding in 2014 — to unlock self-expression, connection, and inclusion for those who may otherwise be marginalized.

Andreas Forsland, Founder & CEO of Cognixion, joined Simeone Scaramozzino, Chapter Leader of Transformative Technology Milan, in a virtual event to discuss how Cognixion is developing affordable and accessible technology and getting it into the hands of more people who need it.

The inspiration for Cognixion manifested in 2012 when, during a trip to California, Forsland’s mother suffered from an aggressive case of pneumonia, so severe that she was placed on a ventilator for 7 weeks. After experiencing first-hand the difficulties and frustration in trying to communicate with a loved one unable to speak, Forsland was inspired to find solutions for people with communication challenges.

Drawing from his background in design and healthcare consumer electronics, Forsland founded Cognixion to break down communication barriers and empower people through technology that is affordable, accessible, and intuitive to set up and use.

Cognixion’s award-winning app, Speakprose. Photo by Cognixion

Cognixion’s award-winning app, Speakprose. Photo by Cognixion

Recently earning recognition as a top 21 neurotech startup to watch, Cognixion develops neuroprosthetic software and wearables that enable people with complex disabilities to utilise their face, eyes, and brain as a direct control interface to express themselves.

Their “think to speak” technology aims to address the human interaction needs of those with autism, down syndrome, traumatic brain injury, stroke, cancer, cerebral palsy, Parkinson’s, multiple sclerosis, ALS, and more.

Each communication challenge is unique and has a wide spread of parameters to design for. Cognixion builds on whichever user abilities are available — hearing, touch, gesture, movement, or even simply attention to the environment.

To build solutions for users in a way that is humane and respectful of their abilities, Forsland explains that Cognixion has developed “a technical framework that allows people to personalise for their own experiences so they can access communication with less effort.” They employ a range of technologies — brain computer interfaces (BCIs), artificial intelligence (AI), augmented reality (AR), and eye-tracking and facial recognition technology — to design truly augmentative conversational interfaces.

With Cognixion’s AI-powered neurotechnology, users are able to respond more quickly in conversation and get to the words they want to say faster, up to 10x faster than any other solution on the market.

“It’s like a neuro-bionic capability — our technology is so easy and natural to use that it quickly becomes a digital extension of someone’s body and abilities. Like a superpower.” — Andreas Forsland

Cognixion currently has an application available in the Apple App store: award-winning SpeakProse and the recently launched upgrade SpeakProse Pro+. Both have either a free trial or free version as well as a paid version. By providing software that can be easily downloaded, Cognixion aims to improve access to affordable assistive technology and give control back to people rather than requiring them to go through more convoluted and time-consuming channels, such as through insurance or a clinical evaluation.

Blog 3.png

In early 2021, Cognixion expects to launch a new wearable, which Forsland describes as a “heads-up display that includes AR and a BCI. It’s a complete integrated system that includes BCI electronics using EEG [electroencephalogram] as well as the accessibility of using head gaze and other things for controlling the AR environment. It’s essentially one elegant solution that can accommodate a variety of access methods within a very simple form factor.”

While Cognixion is currently focused on addressing the specific needs of those with communication disabilities, Forsland describes Cognixion’s work as a pebble in the water that could have a much larger ripple effect into the global community. Viewing the world through a lens of universal design, Forsland believes that by focusing on a unique need, the world benefits when those solutions can be adopted universally.

“By designing for the least of us, we benefit the most of us.” — Andreas Forsland

A philosophy that motivates Cognixion’s work, universal design is a design approach that considers the wide spectrum of human abilities and improves accessibility and inclusivity. When something is universally designed, it can be used easily by everyone. One of the most common examples of universal design is the sidewalk ramp. Originally designed for those with wheelchairs to conveniently and safely use sidewalks, it also benefits small children, seniors, people riding bikes, parents pushing strollers, and others.

From Forsland’s perspective, “20% of the world has a disability, and 100% will become old,” meaning that, in a sense, we are only temporarily abled. “By focusing all of our attention and efforts and energy into designing for people with disabilities, you truly are designing for everyone because eventually we all may end up needing to use the tools that we’re creating today.”

By translating universal design approaches and improving accessibility to assistive technology, Cognixion is building a more equitable and inclusive world — a world where “you have new ideas and new voices being expressed, you have people fulfilling themselves… And not just what they can do, but the network effect… For any individual that has a disability, they have a family, they have friends, they have their first and second and third degree circles in their social graph that also benefit by that individual being empowered… There’s this huge ripple effect.”

Watch a recording of the full discussion here:

Article Written By:

Alison Keiper

Patent agent, engineer, & wellness enthusiast exploring science, tech, & transformation

AAC: What's NEW? What's NEXT? With India Ochs

AAC: What’s New? What’s Next? Facebook Live Interview

Initially recorded on September 16th, 2020

What's NEW? What's NEXT? with India Ochs, Attorney & Social Justice Advocate

Highlights:

  • 20th Consecutive Show Celebration

  • High achievement combined with a productive and fulfilling lifestyle

  • Disability Advocacy

Join us for a new AAC Live interview
every Wednesday!

Are you a Healthcare Professional?

AAC: What's NEW? What's NEXT? With Lydia Dawley

AAC: What’s New? What’s Next? Facebook Live Interview

Initially recorded on September 9th, 2020

What's NEW? What's NEXT? with Lydia Dawley, AAC Consultant and CEO at Click Speak Connect

Highlights:

  • AAC consultation by a professional who also uses AAC

  • The value of teaching social skills through organic conversation

  • Exciting ideas about the future of AAC and BCI

Join us for a new AAC Live interview
every Wednesday!

Are you a Healthcare Professional?

What's NEW? What's NEXT? with Yannick Roy

AAC: What’s New? What’s Next? Facebook Live Interview

Initially recorded on September 2nd, 2020

What's NEW? What's NEXT? with Yannick Roy, CoFounder & Executive Director of NeuroTechX

Highlights:

  • Intro to Brain-computer Interface 

  • How SLPs and other professionals can be an integral part of a neurotech creation team

  • Future neurotech opportunities

Join us for a new AAC Live interview
every Wednesday!

Are you a Healthcare Professional?

What's NEW? What's NEXT? with Rachael Langley

AAC: What’s New? What’s Next? Facebook Live Interview

Initially recorded on August 26th, 2020

What's NEW? What's NEXT? with Rachael Langley

Highlights:

  • Importance of making AAC information accessible to everyone.

  • Talking AAC Workshops beginning 9/14/20

  • Increasing awareness of AAC

Join us for a new AAC Live interview
every Wednesday!

Are you a Healthcare Professional?

What's NEW? What's NEXT? with Kacy Barron, AAC Specialist MA, CCC-SLP

AAC: What’s New? What’s Next? Facebook Live Interview

Initially recorded on August 19th, 2020

What's NEW? What's NEXT? with Kacy Barron

Highlights:

  • New ways to offer AAC coaching and education to professionals

  • Coaching and supporting parents

  • Supporting individuals with limited physical abilities

Join us for a new AAC Live interview
every Wednesday!

Are you a Healthcare Professional?

What's NEW? What's NEXT? with Tim Jin

AAC: What’s New? What’s Next? Facebook Live Interview

Initially recorded on August 12th, 2020

What's NEW? What's NEXT? with Tim Jin

Join us for a new AAC Live interview
every Wednesday!

A little background on Tim:

I was born with Cerebral Palsy and graduated from Cal State Long Beach in speech communication.  I’ve been an active member on several advisory boards, such as In Home Support Service, USC University Center for Excellence in Developmental Disabilities, Self-Determination Program Local Advisory Committee for Regional Center of Orange County, TASK in Brea, California, Disability Voices United, and California Communications Access Foundation and Ability Central.   

I have been using an AAC device ever since I was in elementary school. One of my passions is for everyone to communicate through technology, whatever that happens to be. It doesn't matter what your disability is, everyone needs to communicate.  

 

What differences have you experienced during the pandemic in terms of AAC or accessibility during the pandemic?

 When the State reopens again, the disabled community won’t be the first people that will go out of their doors and our lives won’t be normal.  Most likely, we are all staying at home and being isolated from the virus because we are most vulnerable.  The disabled community is one of the poorest people in our society.  Many of us don’t have the means to have access to the Internet in our homes, yet alone a computer.  Many of us don't have the ability to communicate through  a communication device to message our basic needs, or our devices are so outdated or broken that it becomes a paperweight because it is no longer optimized to our needs, because of limitations from our health conditions.  

For example, I have a friend who has the same disability as myself and he lives in the next city from me.  We have been trying to get him on Zoom to have some kind of social interaction because of the lock down.  He has no computer or basic internet connection.  My friend has a cell phone, but he has a flip phone and cannot install any apps on it.  What is my friend supposed to do for the next six months or whenever the pandemic is over?  I fear for my friend because he is not getting the services that he should be receiving to maintain his mental health.  

There are a lot of unheard stories like my friend.

What are you looking forward regarding future accessibility technology?

With the recent innovation with artificial intelligence, I like to see better word prediction.  The current word prediction system is very outdated.  I like to see word prediction that uses some form of artificial intelligence to make me communicate even more effectively and faster.  The app will know what setting I am, either at home or work and it will predict phrases or words that I’ve already used for that environment.  

For example, let’s say I’m at a show, seeing my favorite bands.  With artificial intelligence and GPS, the app will know where I’m at and switch vocabulary to fit to that environment.  Like, albums to the bands or songs.

Here is a better example, let’s say you are having lunch at your favorite restaurant and you are about to order.  Instead of typing what you want to eat, the word prediction should adapt to the environment that you are in and the restaurant menu should be appearing in the prediction library, as you order your food.  This will save you time with your device and make you more efficient at communicating with others.

AAC should be adapting to the user rather than the user adjusting to the device.  

Are you a Healthcare Professional?

Meaghan Azlein , M.A. Ed., Marketing Operations Associate & Customer Advocate for Cognixion

AAC: What’s New? What’s Next? Facebook Live Interview

Initially recorded on August 5th, 2020

Meaghan Azlein , M.A. Ed., Marketing Operations Associate & Customer Advocate for Cognixion

Highlights:

  • Early days with Cognixion 

  • Marketing and Customer service in the disability community 

  • Special education, disabilities, and future tech opportunities

Join us for a new AAC Live interview
every Wednesday!

Are you a Healthcare Professional?

Dr. Caroline Ramsey Musselwhite, CCC-SLP, Assistive Technology Specialist of AAC Intervention

AAC: What’s New? What’s Next? Facebook Live Interview

Initially recorded on July 29, 2020

Dr. Caroline Ramsey Musselwhite, CCC-SLP, Assistive Technology Specialist of AAC Intervention

Highlights:

  • Reviewing a little history of AAC

  • Individualizing language systems to increase user independence

  • Eye Gaze and Brain-Computer Interface (BCI) as future AAC technology

Join us for a new AAC Live interview
every Wednesday!

Are you a Healthcare Professional?

Vicki Clarke CEO, of Dynamic Therapy Associates Inc

AAC: What’s New? What’s Next? Facebook Live Interview

Initially recorded on July 22, 2020

Vicki Clarke CEO, of Dynamic Therapy Associates Inc

Highlights:

  • "Makers" revival in digital resource creation

  • Increased focus on deep dive coaching and supports

  • Creativity and flexibility providing remote AAC evaluations

Join us for a new AAC Live interview
every Wednesday!

Are you a Healthcare Professional?

I have something to say, but I can’t tell you…

MIND_Issue 3_Age_Spring 2020.jpg

Our very own Cristiano Micheli, Andreas Forsland and Lucas Steuber were featured in the latest issue of MIND. MIND is an international collaboration among organizations in the Neurotech community. It serves as a well of knowledge exploring myriad aspects of Neurotechnology, hoping to educate, inspire, and instill wonder regarding recent discoveries and promising possibilities. And we are so honored to be featured.

I Have Something To Say

But I Can’t Tell You...

The majority of nations have successfully extended the average lifespan of their citizens. However, the quality of life in the extra years gained from this extension is often overlooked. While it is difficult to approach this from a medical perspective, the widespread adoption of current technologies of human-computer interaction such as portable devices, wearables, mixed reality products, and brain-computer interfaces (BCIs) have made it possible to complement the healthcare infrastructure and augment the quality of life of geriatric populations.

Primarily, these devices can improve their lived experience by facilitating person-to-person communication. This article presents some of those cutting-edge technologies available to support the elderly and those with limited communication abilities, followed by a few prominent use-cases for the aging population.

By Cris Micheli, Utkarsh Sarawgi, Lucas Steuber, Andreas Forsland

Technology can assist the elderly in a variety of ways by leveraging a diversified selection of access interfaces and assistive technologies that augment or compensate for deficits in their physical and cognitive abilities. These portable human-technology interfaces aid humans, without substituting or invading their bodies. This non-invasive approach is called ‘assistive technology’ as it gently assists human function similar to a walking stick providing stability to an elderly person.

As people age, communication becomes more and more challenging, eventually leading to social isolation. As such, all available instruments able to support or ‘augment’ communication will assume a very important role in the years to come for aging populations. These technologies are referred to as Augmentative Alternative Communication, or AAC. Specifically, AAC is described as “encompass[ing] the communication methods used to supplement or replace speech or writing for those with impairments in the production or comprehension of spoken or written language.”[1]

The most ubiquitous modern form of AAC is accessed via a touch screen – often on a commercially available device. Such devices allow for solutions that assist or augment the interaction of users with their surroundings, thereby solving communication roadblocks with their peers. In fact, a substantial percentage of the population (7.6% of adults in the US [2]) has some form of speech impediment. As a consequence, the market has shown lately a high adoption rate of portable devices with AAC technologies across all ages, including the geriatric segment.

In particular, there are an increasing number of apps on the market that use the built-in accessibility functions of mobile devices to produce synthesized or recorded language. These apps also employ specialized interfaces designed for specific target populations to provide access to communication (Figure 1). In addition to speaking aids, most portable devices can help communication by easing cognitive functioning. For example, by engaging the user’s attention and memory systems through gaming or providing dashboards that produce simple sentences, the cognitive workload of communication can be distributed and made easier.

Figure 1: A useful depiction of Augmentative Alternative technologies or AAC (from Elsahar et al 2019). Licensed under creative commons by 4.0

Due to recent innovations - like the consumer-grade touchscreen devices mentioned above - we can now design and create affordable high-tech solutions with the potential to exponentially improve the abilities of aging individuals affected by speech or general communication impediments. A handful of companies with clearly defined missions have taken upon this task of delivering consumer-level products that will help solve these challenges, forming a niche technological ecosystem described below.

A Brief and Incomplete Overview of the Tech Ecosystem

CTRL-Labs, originally based in New York, developed an armband to decode arm gestures. This assistive device could be used to convey intended movement or to decode a simple hand or arm gesture with a stipulated meaning. Facebook recently acquired CTRL-Labs for over 500 million dollars, making it part of the Facebook Reality Labs. The financial scale of this acquisition, among many others, demonstrates the consumer electronics industry’s commitment to transform what we currently call “accessibility” into simply another component of user “personalization”, where the product adapts to the consumer rather than the other way around.

Another company, Neuralink, adopts an invasive approach that substitutes the loss of function with technology. Their interface rests on top of the user’s head and transmits information wirelessly from tiny flexible electrode threads embedded in the brain. It is supposed to provide a near-to-the source interface to assist decoding movement or language intentions where the biological systems are no longer able to do so. As opposed to the earlier mentioned approaches, Neuralink advances an invasive framework by reaching into the human body, rather than having an external product that can be used as a ‘plug-and-play’ device.

Cognixion, a company based in Santa Barbara and Toronto, provides a speech-generating device as an assistive communication solution that interacts with users via multiple non-invasive access points. The app efficiently serves as a prosthetic to provide speech to non-verbal individuals through a user-friendly tablet or phone interface which generates grammatically accurate sentences from a fast access interface with the goal to increase their speed of communication. In technical terms, it seeks to enhance ‘word rate’, a measurement of the amount of words effectively communicated in one minute. The interface is completely customizable and supports eye-tracking, multiple keyboard layouts, and a range of gesture swipes corresponding to the desired messages. For example, a swipe or tap on the iPad screen could select the ‘I love you dad’ tile; alternatively, a blink during directed eye gaze could generate a spoken request for water. The company is also developing a cutting-edge brain-computer interface to augment daily-life conversational skills for people in need (Figure 2).

IMG_5915.png

Figure 2: Three of the many interfaces available in Speakprose® (Cognixion’s AAC app): swipe or tap on an iPad and eye-tracking (right) and Augmented Reality (left). Among other features (not pictured): brain-machine interface. The app vocalizes the desired statement on behalf of the user from a customizable vocabulary

Another striking example of AAC technology is project AlterEgo from MIT Media Lab. It is a non-invasive and wearable real-time silent speech interface that helps people communicate in natural language without using their voice or externally observable movements. All the user has to do is articulate their words internally, and the peripheral neural interface records electrical activity using multiple surface electrodes around the speech articulators (mouth and throat areas), which are then decoded into speech. The feedback to the user is given through audio, via bone conduction, without disrupting the user’s usual auditory perception, and making the interface closed-loop. This feature is commonly adopted in rehabilitation protocols, and in this specific case it leverages neuroplasticity by providing feedback via the bone conduction device about the correctness of a silent speech word.

As opposed to brain-computer interfaces which record electrical activity from the brain, this wearable merely acquires intended speech signals, i.e. internal articulations which are inherently silent and unobtrusive. While a primary focus of this project is to help support communication for people with speech disorders in conditions like Amyotrophic Lateral Sclerosis (ALS) and Multiple Sclerosis (MS) among others, the system has the potential to seamlessly integrate humans and computers such that computing, The Internet, and AI would weave into our daily life as a “second self” and augment our cognition and abilities. This can thereby help facilitate unobtrusive and real-time access to personalized content and publicly available information for the elderly people and any other target population with similar needs, while also providing an AI assistant to help form intelligible speech for the affected. (Figure 3).

Figure 3: An elderly Multiple Sclerosis patient using an early prototype of AlterEgo

Many other companies have joined the effort to restore, augment, or supplement the ability to communicate for affected individuals. The use cases detail how technology can aid communication among the elderly.

Aging and Stroke

The use of portable devices is important among the aging population. Their general availability and accessible interface make them useful for a population with senses that often are naturally in decline. In some cases, this decline is abrupt, such as after a cerebrovascular insult (CVI), more commonly known as a stroke. One frequent consequence of stroke is aphasia, a structural disruption in the brain conducive to impaired language comprehension and/or production. Aphasia is a complex syndrome that presents itself with different symptoms and, while individuals with aphasia can benefit from AAC, their needs are often unique. Thus, a personalizable interface with images describing the items to be selected would support such recovering patients. For them, a picture is really worth a 1000 words. The ideal app would support recovering patients affected by stroke and aphasia by providing an effective neurofeedback tool; by viewing the image and accompanying verbal or textual stimulus, they quite literally are able to “recall” a forgotten word or phrase.

Aging and Mild Cognitive Impairment

AAC technology can also support individuals affected by age-related mild cognitive impairment. The symptoms of such conditions are memory loss as well as working memory impairment, which is the inability to retain a thought for a medium to long span of time.

Working memory impairment has a clear impact on communicative efficacy because it makes communication much more cognitively difficult. Assistive technologies can provide resources to help this by reducing the cognitive workload of communication and helping the elderly remember the sentences they want to communicate. For example, having graphic elements that reinforce the context of the discourse within a speech generating app facilitates the retainment of words in working memory and therefore promotes fluid communication.

In general, AAC interfaces can assist communication by lowering the cognitive workload related to word selection by visualizing, or otherwise facilitating the understanding of, both concepts and context relevant to conversation. Such solutions, paired with personalized vocabulary that learns from patients’ routines and the myriad factors that constitute their immediate context, can boost communication and give useful neurofeedback to the user, over time improving their cognitive and communicative abilities. The promise of such AAC technologies is to promote cognitive plasticity and reinstate weakened verbal abilities.

Aging and Hospitalization

Every so often, in a clinical environment, patients wake up in the Intensive Care Unit and find out that their ability to speak is temporarily impaired. Some individuals must receive invasive surgeries such as tracheostomy to restore respiration, and the lack of verbal communication affects the patients as well as their families.

Critical care is a dramatic example of AAC as a communication aid. Most often, aging individuals in assistive nursing conditions or under caretaking regimens experience a gradual decline in their ability to speak. In such cases, speech-generating devices can make a difference in communicating intentions and needs. Portable lightweight solutions with a set of contextual sentences can also make a difference in constrained clinical settings where visiting times are often limited (Figure 4).

IMG_5916.png

COVID-19 Flipbook

Figure 4:Portable solutions as communication aids in critical care can make the difference for non-speaking patients (Speakprose ®, from Cognixion)

The previous examples cover use cases within wearable or lightweight portable assistive technologies. Speech assistive technologies can also compose emergency numbers on behalf of the customer. Another example of such technologies is the fall-detection device, an automatic dialling switch hanging from the neck of elderly people. The device contacts family members with an emergency preprogrammed call in instances of sudden falls. All these discussions lead towards a question that still remains unanswered– with such apparent diversity of options, how does this all come together for the user – and why would an industry develop dedicated solutions to generating such tools?

Why This Is Important

Let’s briefly review how assistive technologies affect the quality of life of elderly people. Due to recent technological innovations such as portable and wearable devices to aid communication by supporting different levels of functionality and human interaction, especially for non-speaking individuals: they provide neural feedback mechanisms. By providing visual or audio feedback to the elderly, they stimulate more communication and improve quality of life and interaction with other individuals:

  • They are lightweight, easily concealed, and cost-effective therapeutic solutions;

  • Some solutions allow the caretaker or the individual to personalize the vocabulary;

  • Multimodal access for items selection such as eye tracking, gestures, touchscreen displays, brain-computer interfaces, further improve customizability as the elderly can choose their preferred communication modality.

Where once a nonverbal or a minimally verbal individual was limited by the options presented to them, they now have personalized access to the ability to communicate, control their environment, and contribute in ways that were until recently very difficult, causing profound implications at the individual, familial and societal levels.

For the individual, it is not a significant recovery of cognitive function due to effective communication support and neurofeedback of such tech solutions is not unlikely. We, as tech contributors and developers, are motivated to imagine the improved relationship with family and friends, the feelings of integration or diminished isolation, and a better sense of agency and control over their own life. Importantly, such interfaces enable the elderly to communicate their life experiences as part of the human need to pass on their culture and experience to the next generations.

The impact of AAC on society is already – and will continue to be - profound. Among other benefits, assistive technologies help reduce the burden on staff and caretakers, thus reducing costs for palliative care and psychological therapies and reducing the possibility of misunderstandings and errors.

Every human being deserves to be given the opportunity to share their thoughts and experiences. Communication is not just a functional or transactional act; it is the means by which they expand the span of their well-being; it is a form of self-actualization. For many of us, this key facet of our identity will slowly slip away as we continue to age. Fortunately, we can prevent this with the right technology, allowing the oldest members of society to participate in it once again.

Notes: [1] https://en.wikipedia.org/wiki/Augmentative_and_alternative_communication, [2] https://www.nidcd.nih.gov/health/statistics/quick-statistics-voice-speech-language

References: Balandin and Morgan, 2001, Beukelman et al, 2009, Elsahar et al 2019, ter Hoorn et al 2016

This article was originally published here. Editors: Jwalin Joshi and Lillian Shallow, Cover: Chris Seo @ NeuroTechX Berkeley

To download the full feature click here.

Want to learn more about how technology and healthcare intertwine? Curious about how BCI works? Give us a follow on our Cognixion Facebook page here where each week we host a Live show of Whats NEW? Whats NEXT?

Sarah Pearce, Senior BCI Software Engineer, Cognixion

AAC: What’s New? What’s Next? Facebook Live Interview

Initially recorded on July 15, 2020

Sarah Pearce, Senior BCI Software Engineer, Cognixion

Highlights:

  • Career in UX and website design leads to brain computer interface research

  • BCI and AAC opportunities

  • Future BCI and AR technology

Join us for a new AAC Live interview
every Wednesday!

Are you a Healthcare Professional?

Kate Ahern, MS, ED, Educational Specialist

AAC: What’s New? What’s Next? Facebook Live Interview

Initially recorded on July 1, 2020

Kate Ahern, MS, ED, Educational Specialist
Founder AAC Voices
Facebook Administrator AAC Through Motivate, Model, Move Out Of The Way

Highlights:

  • Creating and leading online educational and social AAC groups

  • Client focused design at the forefront of new, smaller, wearable technology

Are you a Healthcare Professional?