The project's objective is to develop a mobile application that leverages Augmented Reality technology to offer enhancements and supplementary information for Galasa Documentation.
We create a fully functional mobile application - a user can move their phone over Galasa documentation into the camera's frame and AR enhancement is shown. This enhancement involves providing more detail about the diagram with the help of an AI assistant, it will also turn static diagrams into moving and enhance the image to make it more visually appealing. The User will be able to ask questions to the AI Assistant to gain more information.
Develop a fully functional mobile application that enriches a user's experience with Galasa Documentation through Augmented Reality. By simply moving their phone's camera over Galasa documentation, users will witness AR enhancements. These enhancements involve several key features:
-
Detailed Information: An AI assistant will provide in-depth explanations and context for diagrams, making complex information more understandable.
-
Interactive Diagrams: Static diagrams will come to life, offering dynamic representations that enhance understanding.
-
Visual Appeal: The application will improve the visual aesthetics of diagrams, making them more engaging and informative.
-
Interactive Querying: Users will have the ability to interact with the AI assistant by asking questions, enabling them to delve deeper into the subject matter.
Our mobile app transforms the way users interact with Galasa Documentation, providing an immersive and informative experience using Augmented Reality technology.
By tailoring your product to meet the needs of these three personas, we can ensure that the application serves as a valuable resource for everyone. Offering a structured learning path, with content ranging from introductory to advanced, will make the product a comprehensive and inclusive resource for Galasa documentation at all levels.
-
Beginner - Exploring Galasa: The beginner is someone new to Galasa and has limited or no prior knowledge of the tool. They are typically eager to understand the basics and get started. For this persona, the product offers introductory material and clear explanations of fundamental concepts to ensure that the learning curve is gentle. By focusing on simplicity we aim help beginners feel confident about using Galasa and running their first tests.
-
Intermediate - Expanding Skills: The intermediate user already has some experience with Galasa and wants to enhance their knowledge and skills. To support this persona we will create an in-depth resource with more technical language and encourage users to apply their knowledge to more complex testing scenarios.
-
Expert - Mastering Galasa: Experts in Galasa are looking to fine-tune their understanding and master the tool's nuances. They seek in-depth technical documentation, detailed reference guides, and advanced troubleshooting resources. The product will cater for an advanced audience by providing access to extensive documentation and an AI assistant who the user can talk with to perfect his understanding of Galasa
User 1: As a Test Engineer I want to be able to scan a QR code on the Galasa Documentation which will reveal an augmented diagram such that I can have my learning process streamlined and made more engaging.
User 2: As a Specialist Engineer I want to be able to access more detailed information about the documentation such that this will provide me with a more broad overview of the component.
User 3: As a Software Engineering Manager at IBM I want to deliver an augmented application to our test engineers such that their learning experience will be enhanced.
| Stakeholder | Name | Role |
|---|---|---|
| Clients | Jon Mc Namara & Stuart Walker | IBM employees - overseeing the project and delivering the project specification |
| Team | Zak Mansuri, Peter Sheehan, Ruoxin Chen, Louie Sinadjan | Developing the product |
| Test Engineers | Using the mobile app, trying to understand Galasa |
- Download Xcode for Swift
- Clone the repository using the command
git clone https://github.com/spe-uob/2023-AIAREnhancedTech
-
Swift - As a team, we have chosen to utilize the Swift programming language to develop our application. Swift is a modern, open-source programming language developed by Apple. Swift offers performance improvements over Objective-C and features a clean and concise syntax making it a popular choice for building iOS applications.
-
Blender - Blender is a versatile 3D modeling software. We are using it to create our visual content like our augmented diagrams. Blender offers us a comprehensive set of tools and features to be able to sculpt and texture our diagrams.
-
IBM's AI Watson Speech to Text, Text to Speech - IBM's Watson is an artificial intelligence system developed by IBM. Watson is powered by advanced machine learning and natural language processing algorithms. Watson Speech to Text and Text to Speech are services within IBM's Watson AI platform. We will look to harness Watson’s Text to Speech service to transform written text into lifelike speech, facilitating the application's interactive voice response systems.
- Contact bn22907@bristol.ac.uk if you wish to develop so that you can be added to the XCode developer team
- Clone the git repository using the command
git clone https://github.com/spe-uob/2023-AIAREnhancedTech - Open the project XCode
- Click the
Producttab - Then click
Build
- Select a device on the simulator or plug in your physical device
- Click the play button in the top left
- Contact bn22907@bristol.ac.uk to receive a TestFlight invitation
- Download TestFlight from the AppStore
- Once you have TestFlight installed, simply download the latest version of our application from TestFlight. This process is similar to downloading any other app from the App Store.
- After following these steps, the user is able to explore and interact with the latest deployed version of the application.
- Within the Galasa application, select the Instructions button to see further details about how to interact with the application.
- Select the link in our 'about' to be taken to our Github pages. This page displays all the diagrams you can interact with in the application.
- Choose a diagram you would like to learn more about and then click its corresponding button to make its unique QR code visible.
No License Chosen