Exploring Apple ARKit with sample application

Apple’s AR Kit is an augmented reality platform for the devices running iOS. ARKit allows developers to build detailed AR experiences for its users by capturing the environment and placing characters, objects, 3D virtual text in that environment.

ARKit was released by Apple in June 2017. It opened a wide range of possibilities for iOS developers to explore a new approach.

ARKit uses iOS device camera, accelerometers, gyroscope, and context awareness to map the environment as the device is moved.

ARKit uses inertial sensors to pick out visual features in the environment, such as planes and track motion. The camera is used to determine the light sources.

What is Apple ARKit?

ARKit is a development environment that enables iOS app developers to build AR experiences into their applications quickly and easily.

ARKit uses Visual Inertial Odometry in order to track the world around the iPhone. It not only tracks the room’s layout but also tracks tables and other objects.

Recently, Apple has introduced ARKit 3, RealityKit, and Reality Composer. It is a collection of tools to make AR development easier.

ARKit 3 offers major improvements which include –

It can be a little daunting task for some people to jump into the world of AR who are not familiar with the technology, but I will try to make it easy for you through this blog.

Getting started with AppleAR Kit

We will be developing a small project using ARKit2. ARKit 2 introduced several new features and improvements to the API. To get started, you need –

We can’t use the simulator to debug an AR application as the simulator doesn’t provide a camera and other sensors that are required to configure the AR world.

How Apple ARKit Works?

Apple ARKit uses Visual Inertial Odometry (VIO) process to access the device motion sensor and visual information from the camera to track the real world. Mathematics is used to take this tracking information from the real 3D world to your 2D screen.

ARKit also collects the amount of available light using the sensors and applies the same lightning to the AR objects within the scenario.

The camera is also used to detect all the possible objects in the frame. As you move the camera, ARKit constantly refines the information.

Setting up a project in Xcode

To set up a project in Xcode, follow these steps –

Congratulation, you have created your first AR Project. Any doubt? Just run the app and see the results.

When you will run the app you will be asked for permission for the camera. Allow the camera permission and you will have a spaceship hanging in the air. Isn’t it cool! You can look at this spaceship from any distance and at any orientation angle. It won’t move as it is settled in the 3d world according to your phone.

Looking at the code, you will see that there is a scene view’s outlet connected in your View Controller

@IBOutlet var sceneView: ARSCNView!

A scene for the spaceship is added in viewDidLoad, which is present in art.scnassets assets.

Run the sceneView session with ARWorldTrackingConfiguration, so that iPhone tracks the object in the real world

Create our own node or object

Firstly remove the scene created by default i.e. delete these lines of code from viewDidLoad

Let’s set up the camera

var object = SCNNode()

let position = SCNVector3(0, 0, -0.6)

object = createObject(at: position)

sceneView.scene.rootNode.addChildNode(object)

Reposition the object

Our next step is to remove the object if the object is tapped and add it to the tapped location if tapped at any location other than the object.

First, we add the following method to our class

This will return the first object in the world added to our Augmented world.

var recentVirtualObjectDistances = [Float]()

var selectedObject: SCNNode?

Now add all these methods to your class. They will do a hit test at the position to find the possible nodes where the object can be placed and then add the object to the closest node to the tapped location.

Add these extensions to the project in order to convert float4x4 values we get by hit test to be used to locate the current position of the object and to find the average of an array of float values, track camera state, etc.

Add tap gesture in ViewDidLoad and make your ViewController its delegate


Now let’s add the tap gesture to hide and show our object

That’s a lot of code, isn’t it? Yes, but this code needs to be added only once and can be reused many times. So it’s a one time ache, go on with it;).

Moving the object

Let’s move on to 4th step which is to make our object move according to our drag gesture in our screen. Let me take you through the steps which we are going to follow –

Add pan gesture in viewDidLoad and make your view controller its delegate.

import UIKit.UIGestureRecognizerSubclass

import SceneKit

Now add ARSCNViewDelegate function which is commented by default, it renders the view at run time in each frame of screen to modify it. Delete it and add following code –

Now in each frame your tapped or dragged position in the screen is been monitored and if your drag starts from the object, then it will move to your current touched place on the screen. Else it won’t move.

Congratulations you are having an object placed in the Augmented world which can be placed anywhere and can be moved anywhere as if it is dancing on your fingers. What else do you want? With dance, I remember some salsa dance moves like rotation.

Rotating the object

Let’s make our object t rotate at its place also.

Summary

It is not so difficult to work with ARKit. However, there are some limitations like scanning white surfaces and showcasing an object on it.

Other than that you just need to have proper configuration and rest will be taken care of by the framework.

Other than this demo application we have implemented ARKit on a few of our client projects, and it has been fun to work with ARKit.

Hire our experienced iOS app developers

Leveraging agile methodology and experienced iOS developers, we provide our clients with custom iOS app development solutions keeping in mind the design guidelines related to the Apple ecosystem.

Our iOS app development services offer –

ARKit

Build beautiful AR experiences for your users with Apple ARKit 3. With ARKit 3, Apple has introduced Reality Composer – an app that easily let you create AR experiences, RealityKit – a powerful augmented reality framework and Motion Capture which let you track human movement as input to AR.

iPhone app development

iOS ecosystem has defined the ideal mobile environment and pushed the boundaries for smart mobile computing. We offer a wide range of iOS app development services for our global clients. We build and deliver robust and scalable applications for the iPhone.

iPad app development

iPadOS is the latest offering from Apple which offers additional technologies by leveraging the power of iPad using the iOS SDK. Now offer your users a multiwindow experience, add full drawing experiences for Apple Pencil in your iPad application with iPadOS.

Apple Watch app development

Give your users an easy way to complete quick actions by developing an application for Apple Watch. watchOS leverages the power of SwiftUI and new APIs to deliver robust experience. Now build independent watchOS apps without the iOS counterpart with Core ML and the Neural Engine.

Request a callback from our industry experts.