Oliver Lemon

Our ground-breaking artificial intelligence research is developing robots that can learn human language and interact socially with pioneering applications across global industry.

Professor Oliver Lemon, Director of the Interaction Lab

Professor Oliver Lemon's team are developing technology to enable robots and computers to interact naturally with humans, using combinations of speech, gesture, movements and facial expressions. Their leading artificial intelligence (AI) research can make such human-level communication skills a reality, for future systems that will cooperate intelligently.

The Interaction Lab is one of the few places in the world that has pioneered the use of machine learning methods to develop conversational language interfaces. This means that machines can now learn how to have dialogues with people and better understand and generate natural human language. Ultimately, this research will develop new interfaces and robots which are easier, quicker, and more enjoyable to use.

As robots and the 'internet of things' become more integrated into our everyday lives, we will need increasingly complex human interaction systems, to avoid information overload and enjoy more effective and entertaining interaction with new technologies.

Real-world impact.

The Interaction Lab is breaking new ground in the development of robots that can learn from human language, and how to interact socially with humans; a successful European Commission Horizon 2020 funding call in 2015 resulted in Pepper, Heriot-Watt's resident robot. Pepper exhibits behaviour that is socially appropriate, combining speech-based interaction with non-verbal communication and human-aware navigation.

The team has worked with companies including Yahoo, Orange, and BMW to solve new problems in conversational interaction with machines - an, for the second year running, a PhD team from the Lab have made it to the final three, in the world, in the $3.5 Million Amazon Alexa Prize

Read more abour our Alexa success.