RememVR is a service facilitating participation in reminiscence therapy based on VR contents. Our team implemented video-to-VR technology based on AI models, which proves to be significantly more cost-effective than other equipment commonly employed in the creation of existing VR content.

Demo (24. 02. 25.)	Demo (24. 05. 06.)

You can check out the Demo Video by clicking above image.

We chose UN Sustainable Development Goal 3. Especially, we aimed to tackle target 3.4, 3.8, and 3.d. The problem of depression and loneliness is world-wide problem, getting worse with nuclear individualization. To address these problems, we designed a reminiscence therapy service for people suffering from depression by using AI and VR. Our service provide essential health care services. Simultaneously, providing VR contents based on reminiscence therapy would strengthen the capacity for risk reduction and management of depression and loneliness.

We separated our application into two tracks, caregiver and care recipient tracks are those. Caregivers can make VR scenes and care recipients can experience VR scenes engaging in reminiscence therapy.

• (1) Creating VR Scene (Place)
  • RememVR creates VR experiences encapsulating the places intertwined with a patient's memories. We all live with our unique sense of places, as visiting specific locations can evoke memories from particular times. Places in VR will make them feel as if they are physically present in that space. Caregivers can upload videos showcasing distinctive features of the location if it's indoor, forward-faced, or unbounded.
• (2) Creating Avatar
  • RememVR gives avatars representing the patient's cherished individuals. These avatars, combined with place VR scene, offer the recipients an immersive recollection of memories. RememVR assists in safeguarding the continuity of the recipient's memories. Caregivers can upload a video or an image featuring the person whom they like to transform into an avatar.
• (3) Creating VR Scene (Avatar + Place)
  • Caregivers can select avatars, and a VR scene to build a completed VR scene. After VR scene is generated, care recipient can find out that scene in his/her VR experience list.

• (1) VR Experience
  • Care recipients can participate in VR scene. Our character ‘Brainy’ helps care recipient to follow the steps for VR experience which is a part of the reminiscence therapy. Avatar idles and have various motions. VR scenes are greatly similar to real existing places. Thus, our user can immerse to the VR contents easily.
• (2) Badge Tracker
  • After the care recipient completes the VR experience, badges are awarded as part of gamification. These badges can be viewed not only on the Care Recipient's home-page but also on the Caregiver's home. There are a total of three badge designs, and one of them is randomly assigned.

This service is developed for mobile and VR device. Below are the methods for installing the application on mobile devices and running it on VR devices.

1. Enter https://github.com/RememVR-2024-SolutionChallenge/RememVR-client/releases.
2. Click the latest release.
3. Download app-release.apk.
4. Launch this app on Android devices.

Before you start, make sure you have installed the following on your system: Flutter SDK, VS Code, Dart and Flutter extensions for VS Code, Android emulator or physical device

1. Clone the RememVR repository from GitHub:

   git clone https://github.com/RememVR-2024-SolutionChallenge/RememVR-client.git
   

2. Open the project folder in VS Code.
3. In VS Code, open the command palette (View > Command Palette) and type "Flutter: Run Flutter Doctor". This will check your system to make sure everything is set up correctly.
4. In VS Code, open the main.dart file and click the "Run" button. This will launch the app in the emulator or on your physical device.

Experience our VR viewer if you have a VR setup. Before launching the app, ensure your VR and mobile devices are connected.

1. Connecting your Quest 2: Link your Quest2 with mobile device. Follow the instructions in-VR and in the Meta Quest mobile app to complete the setup process. Refer to the official guidance. Just ensuring a mirroring connection suffices for our service.

   ❗Note: Your VR device and mobile device MUST BE connected with same network.

2. Accessing the VR Viewer: Once connected, the Start VR button on our web-based VR viewer becomes automatically accessible. Click it, and enjoy your VR journey!

   • Access several pre-trained example models here.
   • This VR viewer connects with Flutter APK. If you have your own trained scene and avatar, you can see your own model with this viewer. Learn how to create your own model here.
   • We've tested with Oculus Quest 2 and Galaxy S22. We will support more VR devices soon.

Detailed descriptions of each component are provided in their respective repositories.

• Client: Mobile Application VR viewer
• Server: Gateway/Application server AI server
• Other server utils: AI task scheduler Realtime DB synchronizer

GuiJung Woo BE Engineer	SeoYeon Byun AI Engineer	Seoyoung Kim PM / Designer	JinWoo Choi FE Engineer

We are team RememVR from Google Developer Student Clubs Korea University, Seoul Campus.