The End Of Knowledge - Vault 4/93 - AI For Good - 2024 - Reconnecting ALS patients with their loved ones

graph LR classDef main fill:#f9d4d4, font-weight:bold, font-size:14px classDef halo fill:#d4f9d4, font-weight:bold, font-size:14px classDef goal fill:#d4d4f9, font-weight:bold, font-size:14px classDef unbabel fill:#f9f9d4, font-weight:bold, font-size:14px classDef emg fill:#f9d4f9, font-weight:bold, font-size:14px classDef communication fill:#d4f9f9, font-weight:bold, font-size:14px classDef tech fill:#d4d4d4, font-weight:bold, font-size:14px classDef future fill:#f9f9f9, font-weight:bold, font-size:14px A[Reconnecting ALS patients
with their loved
ones] --> B[Vasco Pedro demonstrates
AI translation. 1] A --> C[Halo transforms
bio signals
to language. 2] A --> D[Goal: reconnect ALS
patients and
families. 3] A --> E[Unbabel raised $91 million,
trusted globally. 4] A --> F[Non-invasive, seamless
brain-computer solution. 5] A --> G[EMGs and LLMs
create Unbabel
Halo. 6] C --> H[Consumer-level goal,
immediate ALS benefit. 7] C --> I[7,100 languages,
most going
extinct. 8] C --> J[Universal brain
language
potential. 9] C --> K[LLMs made
technology
usable now. 10] C --> L[Vasco responds to
WhatsApp
without speaking. 11] E --> M[EMG interface
navigates LLM
answers. 12] M --> N[Reduces cognitive
load, aids ALS
patients. 13] M --> O[Eye-tracking interfaces:
10 words/minute.
14] M --> P[Unbabel Halo:
15 words/minute
improvement. 15] M --> Q[Luis demonstrates
technology
remotely. 16] M --> R[Partnership with OpenAI
for voice LLM.
17] Q --> S[Luis communicates
with recreated
voice. 18] Q --> T[Audience asks about
biggest breakthrough.
19] Q --> U[Luis: revolutionizes
communication
difficulties. 20] G --> V[EMGs and muscle
movement decode
signals. 21] G --> W[Halo collects bio
signals for
responses. 22] G --> X[AI Persona learns
users
preferences. 23] G --> Y[Social data fed
to AI
Persona. 24] G --> Z[Voice cloning
generates
own voice. 25] E --> AA[Aligns with UN
sustainability
goals. 26] AA --> AB[Communication essential
for health,
connection. 27] AA --> AC[Developed at Center
for Responsible
AI. 28] AA --> AD[Consortium ensures
responsible,
transparent AI. 29] AA --> AE[Vasco expresses
excitement for
future. 30] class A,B,C,D,E,F,G,H,I,J,K,L,M,N,O,P,Q,R,S,T,U,V,W,X,Y,Z,AA,AB,AC,AD,AE main class B,C halo class D goal class E,F,G,H,I,J,K,L,M,N,O,P,Q,R,S,T,U,V,W,X,Y,Z unbabel class AA,AB,AC,AD,AE communication

Resume:

1.- Vasco Pedro, CEO of Unbabel, presents a demonstration of AI-powered language translation for ALS patients.

2.- Unbabel Halo uses generative AI and non-invasive neural interfaces to transform bio signals into language.

3.- The goal is to help ALS patients reconnect with their families and loved ones.

4.- Unbabel has raised $91 million and is trusted by global industries like Adidas, Patagonia, and Panasonic.

5.- Vasco and his team wanted to create a non-invasive, seamless solution for brain-to-computer interfaces.

6.- They settled on EMGs coupled with LLMs (large language models) to create Unbabel Halo.

7.- Although the long-term goal is consumer-level integration, they realized it could benefit ALS patients right now.

8.- There are around 7,100 languages in the world, most of which are going extinct.

9.- The team believes there might be a universal language in the brain that they could tap into.

10.- LLMs gave a significant boost to the technology, making it usable right now.

11.- Vasco demonstrates the device by responding to WhatsApp messages without speaking.

12.- The EMG interface allows navigation of potential answers generated by the LLM based on the user's preferences.

13.- This reduces cognitive load and makes it easier for ALS patients to express themselves in a conversation.

14.- Current state-of-the-art eye-tracking interfaces for ALS patients achieve about 10 words per minute.

15.- Unbabel Halo achieves around 15 words per minute, a significant improvement in speed and usability.

16.- Luis, an ALS patient, joins the presentation remotely to demonstrate the technology.

17.- Unbabel announces a partnership with OpenAI, using their new voice LLM to recreate Luis' voice.

18.- This allows Luis to communicate with his own voice, which is deeply emotional and connective.

19.- The audience asks Luis about the biggest breakthrough of the technology for him.

20.- Luis responds that it will revolutionize communication, especially for those with difficulties.

21.- The headband is important for ALS patients because it requires EMGs and muscle movement to decode bio signals.

22.- Halo works by collecting bio signals from the headband and using the LLM to generate possible responses.

23.- An AI Persona, trained on the user's data, continuously learns and predicts what the user wants to say.

24.- Social circles and relationships are an important part of the information fed to the AI Persona.

25.- Voice cloning is super important for ALS patients, allowing them to generate their own voice.

26.- This technology relates to the UN Sustainable Development Goals of reducing inequality and improving health and well-being.

27.- Communication is essential for maintaining health, expressing needs, and staying connected with loved ones.

28.- The technology has been developed within the Center for Responsible AI, led by Unbabel in Portugal.

29.- The consortium focuses on creating AI that is responsible and transparent.

30.- Vasco thanks the audience and expresses excitement for the future of this technology.

Knowledge Vault built byDavid Vivancos 2024