- We use ESP32-Cam to design a fall detection system, including two steps: motion data based(Threshold based) preliminary detection on the wearable device and a video-based (CNN+RNN based)final confirmation on the companion robot
- We study the energy consumption problem when transmiting data based on WiFi and Bluetooth protocols and the size of images.
- We mainly use C language to implement the project, including the Client/Server commnication based on Socket, the image resizing method based on Linear Interpolation Algorithm.
- You can read the paper1 paper2 for more details
- If want to deploy the code on your ESP 32 Device by using the code, please get familiar with ESP32 and the Development environment. You can follow the links below in ESP32 Product section.
- You can read the app_main.c for the main function of device
- If you want to resize your image, you can read resize_image_processing() function in the file app_tcp_wifi.c, linear interpolation algorithm is adopted for resizing the images.
- We provide two type of servers to communicate with the esp client, WiFi-based(esp_server_wifi.c) and Bluetooth-based(esp_server_bluetooth.c)
- We also provide how to test the throughput of the connection based on WiFi or Bluethooth protocols.
Copyright (c) 2023 Fei Liang. To cite my code, please cite my paper:
Here is the BibTeX citation code:
@inproceedings{liang2021collaborative,
title={Collaborative fall detection using a wearable device and a companion robot},
author={Liang, Fei and Hernandez, Ricardo and Lu, Jiaxing and Ong, Brandon and Moore, Matthew Jackson and Sheng, Weihua and Zhang, Senlin},
booktitle={2021 IEEE International Conference on Robotics and Automation (ICRA)},
pages={3684--3690},
year={2021},
organization={IEEE}
}
@inproceedings{liang2021energy,
title={Energy Consumption in a Collaborative Activity Monitoring System using a Companion Robot and a Wearable Device},
author={Liang, Fei and Hernandez, Ricardo and Sheng, Weihua and Gu, Ye},
booktitle={2021 IEEE 11th Annual International Conference on CYBER Technology in Automation, Control, and Intelligent Systems (CYBER)},
pages={812--817},
year={2021},
organization={IEEE}
}
