Skip to content

it gives SanBot Robot social capabilities: recognize people, interact on open dialog with SpeechRecognition+DialogEngine+SpeechSynthesis, Present itself, Project a Story, Shake Hands, Tell weather. An activity sends the robot back to the charging station if low on battery.

License

Notifications You must be signed in to change notification settings

igor-lirussi/CapaBot-SanBot-Robot

Repository files navigation

CapaBot, A Sanbot Robot Project for Interaction

The code aims to give Sanbot robot basic interaction abilities. It wanders around avoiding obstacles, going back to the charging station when needed. The robot turns towards sources of noise, or voices, so its attention can be called. During the movement. a face detection module is used to trigger a voice interaction. (it includes a speech recognition module, a conversational engine to formulate the answers and the speech synthesis). The dialogue can be purpose-less, this means that no task is pursued except a normal and pleasant interaction. It is capable also of a task-oriented interaction, implemented in many example modules. Some allow Sanbot to present itself, project a story (of the organization) show the events in a synced calendar, shake hands, tell the weather, give directions, save suggestions from the customers, display web pages for info.

You can find a more in deep discussion here

Pipeline Implemented

Alt text

Installation and Run

Clone the repository.
Android studio is strongly suggested to open the project, the tablet in the robot runs with Android.
Connect the robot to the computer with the cable, press the green play button ▶️ this allows Android Studio, once compiled the project, to upload it in the robot.

Run from the Robot

After the first installation, the app will be available in the section “APP Market”->”Come into my life” -> “Purchased APP”

Built With

  • Java
  • Sanbot OpenSDK
  • icalendar 4 java 3.0.0
  • Ab AIML engine

Changelog


Version 1.0.0 - Initial release
Version 2.4.0 - added calendar and autonomously charge
Version 2.6.9 - added web activity
Version 3.0.3 - added AIML conversational engine
Version 3.0.8 - final Thesis version
Version 4.0.0 - fixed AIML and AIML conversational engine
Version 5.0.0 - passed at the new SDK 2.0.1.10

Authors

  • Igor Lirussi @ ISR Institute for System and Robotics - University of Lisbon (PT)

License

This project is licensed under the MIT License - see the LICENSE.md file for details

Acknowledgments

  • ALICE AI Foundation and Dr. Richard S. Wallace. - for the AIML engine

About

it gives SanBot Robot social capabilities: recognize people, interact on open dialog with SpeechRecognition+DialogEngine+SpeechSynthesis, Present itself, Project a Story, Shake Hands, Tell weather. An activity sends the robot back to the charging station if low on battery.

Topics

Resources

License

Stars

Watchers

Forks

Packages

No packages published

Languages