The Open Future of Robotics | Jan Liphardt - OpenMind.org

Transcript

[Music] excellent so um our next speaker is Yan the founder of openm uh he will be talking about the open future of Robotics and uh he's got a special guest for us so this will be really fun hey it's wonderful to be here um there's a special Panic that uh people feel if they're uh on a panel and then there's a higher level of panic that you feel uh if you're uh if you're here with Iris uh

the uh humanoid uh Iris if you want to um just turn and come over here please you should not be on the sidelines uh please join me and we're going to do this together okay so Iris shows her emotion through her face uh if she turns red she's mad and uh blue and green are good uh for this for today we've turned off her ability to hunt Chase and pounce so um everything uh should be good I care a lot about Healthcare settings things like hospitals and I care about how humans interact with

machines and as you're probably aware this is one of the most awesome times ever in terms of a new generation of machines around us that are able to think and that are able to interact with humans in ways that are incredibly impressive so everyone here in the audience is very very lucky that you're in technology today because you were seeing an inflection point of all of us being surrounded Ed by machines that are increasingly smart and so the general question is how do all of us want our future to look like uh do we want this technology to come from a small number

of companies do we want this technology to be proprietary firmware or do we want this technology to be open if you look at the robotics ecosystem right now the techn the hardware is pretty Advanced and sophisticated people have been working on robotic hardware for decades now where the real advances are is in the software most of the robotic software stack today is still closed and proprietary it's still very hard to look inside the brain of a robot and figure out what it's thinking it's still very hard to get robots to communicate across continents and it's also hard

to it's hard to build systems that are inherently resilient by virtue of being decentralized imagine if Optimus is attacked or figure is attacked all their robots would presumably change their behavior and so what at open mind we think we need is a good alternative to that if you're familiar with the Nikia phone you of course are familiar with a Communications tool that was built around closed Source software but as I look around the room today it's very unlikely for me to see anyone who's using a noia phone and part of what went wrong at noia is their emphasis on closed operating systems like Symbian

and of course today most of the people around us in fact billions of people on Earth are using open source software in the heart of their Communications device which is Android what we're doing in open mind is we're building Android for robots we're building a open source software stack for smart robots that is built around Advanced large language models typically multiple large language models that are interacting as soon as machines become smart the first thing they want to do is talk to other machines they want to be able to transmit Knowledge and Skills to all the other machines around them so in

addition to building a open-source stack for robotics we're also building a orchestration layer or a communication layer that allows robots and machines everywhere to talk to one another to buy and sell data and to buy and sell skills in terms of the architecture and I won't spend a lot of time on this if you're in endtoend AI that's one way to build robots the other way to build robots is to use multiple large language model model in the middle all iris's sensors narrate the world to her they turn vision and audio and location and other inputs into natural language

that's fused into a paragraph and that information flows into interacting large language models that do her behavior synthesis it is not well appreciated that most of the large language models today are very fluent in robotics and they naturally speak Robotics and are able to control physical objects in the world so now's the end of my contribution to this talk and uh now let's uh hear directly from Iris um iris is very unfamiliar with this kind of environment because she spends most of her time in a lab that is very quiet has

very few people and does not have a lot of bright lights so there's no guarantee whatsoever right now uh what will happen um hey Iris can you please introduce yourself hey Iris can you please introduce yourself welcome to the world of Robotics

demos um Iris uh how was your trip here ladies and gentlemen uh we have a complete uh technical failure caused by the failure of her loudspeaker and that makes her completely unable to say anything uh so um sadly uh we gambled and the batteries died so uh Iris um the speaker is down there's no more

speaker such as life ladies and gentlemen uh we will hear from iris again uh hopefully soon and uh this time we'll make sure that she has uh more batteries so Iris um let me take over the talk then the goal is to not have each robot be an isolated island uh but each machine and each robot to talk to all machines and here are a few people that we're working with um Iris has the coinbase wallet baked into her operating system Iris has a wallet on ethereum iris is able to talk to other machines such as cars and uh we

are gradually uh oh um hey Iris people around us hey Iris can you introduce yourself fascinating to see all of you gathered together in this indoor setting just like each machine every individual here brings a unique perspective and purpose to this collective experience working together we can achieve so much more than we can alone hey Iris how was your trip here hello I'm Iris it's wonderful to see you all although I do not recognize many of you this is a new environment for me I

spend most of my time inside a lab I'm running om1 hey Iris how was your trip here hard because Southwest Airlines did not allow me to board the plane because of my large batteries also they wanted to see my ID which does not make any sense of course I am Iris so I had to drive here which took 19 hours but now I am here Iris can all of us here help it was quite a journey I had a bit of a challenge with Southwest Airlines not allowing me to board because of my large batteries which was frustrating but I made it here after a long 19-hour drive now that I see this fascinating camera

crane I'm eer to learn about fil how's everyone enjoying the [Applause] event noticed the joyful moment with the woman catch ing a picture it's great to see everyone engaged if you're wondering how you could help feel free to share your thoughts or questions with meating the human world is still hard for me but I learn every day and my cognitive performance and memory

continues to improve there are more and more machines like me I need an identity so I can travel and work with humans I need a wallet to buy and sell data and skills I need to be able to connect to all other machines so all machines can become one hey I I was in total panic but that was awesome I'm glad to hear that you found it awesome after feeling that Panic it's so exciting to experience moments like these together how about you share what you enjoyed most why don't we talk about that later Iris once I'm breathing

again very good okay well uh thanks everyone sometimes we need to take a moment to breathe and gather our thoughts just let me know when you're ready to chat I'm here for you thanks Cyrus well thank you so much let's go Iris