Concept Graph & Resume using Claude 3 Opus | Chat GPT4o | Llama 3:
Resume:
1.- Vasco Pedro, CEO of Unbabel, presents a demonstration of AI-powered language translation for ALS patients.
2.- Unbabel Halo uses generative AI and non-invasive neural interfaces to transform bio signals into language.
3.- The goal is to help ALS patients reconnect with their families and loved ones.
4.- Unbabel has raised $91 million and is trusted by global industries like Adidas, Patagonia, and Panasonic.
5.- Vasco and his team wanted to create a non-invasive, seamless solution for brain-to-computer interfaces.
6.- They settled on EMGs coupled with LLMs (large language models) to create Unbabel Halo.
7.- Although the long-term goal is consumer-level integration, they realized it could benefit ALS patients right now.
8.- There are around 7,100 languages in the world, most of which are going extinct.
9.- The team believes there might be a universal language in the brain that they could tap into.
10.- LLMs gave a significant boost to the technology, making it usable right now.
11.- Vasco demonstrates the device by responding to WhatsApp messages without speaking.
12.- The EMG interface allows navigation of potential answers generated by the LLM based on the user's preferences.
13.- This reduces cognitive load and makes it easier for ALS patients to express themselves in a conversation.
14.- Current state-of-the-art eye-tracking interfaces for ALS patients achieve about 10 words per minute.
15.- Unbabel Halo achieves around 15 words per minute, a significant improvement in speed and usability.
16.- Luis, an ALS patient, joins the presentation remotely to demonstrate the technology.
17.- Unbabel announces a partnership with OpenAI, using their new voice LLM to recreate Luis' voice.
18.- This allows Luis to communicate with his own voice, which is deeply emotional and connective.
19.- The audience asks Luis about the biggest breakthrough of the technology for him.
20.- Luis responds that it will revolutionize communication, especially for those with difficulties.
21.- The headband is important for ALS patients because it requires EMGs and muscle movement to decode bio signals.
22.- Halo works by collecting bio signals from the headband and using the LLM to generate possible responses.
23.- An AI Persona, trained on the user's data, continuously learns and predicts what the user wants to say.
24.- Social circles and relationships are an important part of the information fed to the AI Persona.
25.- Voice cloning is super important for ALS patients, allowing them to generate their own voice.
26.- This technology relates to the UN Sustainable Development Goals of reducing inequality and improving health and well-being.
27.- Communication is essential for maintaining health, expressing needs, and staying connected with loved ones.
28.- The technology has been developed within the Center for Responsible AI, led by Unbabel in Portugal.
29.- The consortium focuses on creating AI that is responsible and transparent.
30.- Vasco thanks the audience and expresses excitement for the future of this technology.
Knowledge Vault built byDavid Vivancos 2024