Remote Expert Mobile iOS ARKit PoC #1

Welcome to “Remote Expert Mobile iOS ARKit PoC #1 Challenge”. In this challenge, we need your help to explore one library to implement Video call with ARKit support.
 

CONTEXT

PROJECT CONTEXT

This project aims to build an iOS (iPhone) application that will help field service personnel to identify documents, videos, and/or remote experts to assist them with solving issues in the field while they're working.

The app should leverage ARKit to allow AR objects to be shown during live video calls that will improve the ability of remote experts to provide contextual cues to a user during a video call.
 

CHALLENGE CONTEXT

In this challenge we are going to build a PoC application that makes video calls and have ARKit functionalities on top of it. This is the first application to build the entire application.

CHALLENGE DETAILS

TECHNOLOGY

• iOS 12 (iPhone only)
• Swift 5.x
• ARKit
• Agora.io (https://github.com/AgoraIO-Community/Agora-ARKit)

 

INDIVIDUAL REQUIREMENTS

• You need to build an iOS applications sample leveraging the following technology: Agora.io. Use swift language latest version
• The application should be able to connect two iOS phone devices into a video call
• It is required to build an annotation capability. It has to be enabled during video call
• Once the annotation action button is tapped, the annotation menu option appear on the screen. Note: The user will have the option of selecting:
  • Pen/Marker or Highlighter
  • Eraser
  • Object (for insertion) (Optional)
  • Color Palette (optional)
• IMPORTANT: All annotation added to the video should leverage augmented reality (i.e., ARKit) to remain anchored to a specific space/location (i.e., it should be spatially aware).
• For example, if the user moves the camera the annotation may be out of visibility but when it moves the camera back the annotation is still in the space it was originally added.  Example screenshots are given below
• We don't have a hardcoded design, you can use your creativity based on the screens below. Use any public available icons or library (MIT or Apache License)

 

       

Final Submission Guidelines

Zip file with:

• iOS application
• Details instructions for validating the application
• Video recording link (optional)