Vera — AR Digital Twins for Smart Buildings

Elevate the mall experience with AI and AR-powered intelligent building management.

AI and AR-powered Digital Twins

Vera transforms buildings into intelligent digital twins with embedded AI and real-time data, creating environments where people and devices operate seamlessly. Vera enables context-aware applications for efficient operations and personalized, engaging experiences in office buildings, retail stores, healthcare facilities and much more.

Industries:

Indoor Navigation, Building Management

Country:

Israel

Services:

iOS, Android

Team involved:

iOS, Android

Duration:

2.5 years

Technologies

Challenges

Solutions

Performance was a big challenge. Running ARKit in 60fps, rendering and communicating with a webview, and processing each frame on-device is very resource-heavy.

We ended up using Metal for rendering, and after off-loading many operations on background threads, we managed to get from 13fps to 60fps.

Syncing the ARKit (camera) frames with the webview frames was a challenge as we wanted the content to move in sync with the world.

We implemented a custom frame sync mechanism that would not render the ARKit frame until webview wouldn't finalize it's pipeline, and it worked like a charm.

Managing the state of the ARKit, webview, GRPC connection, many background services, and the UI was a major challenge.

We ended up implementing a custom asynchronous architecture called 'The Mall' on top of Combine and Coroutines that would fully manage all the state of the app.

Creating an SDK that would allow other developers to create their own experiences on top of Vera was a challenge.

We ended up building Native iOS and Android SDKs, and a React Native wrapper on top, along with web SDKs.

Results

60fps

Performance

Business Clients

Trips to HQ

Very communicative and pleasant to work with, highly motivated and eager to provide the best possible solution. They respond quickly, have great skills, and vast relevant knowledge. They provided excellent plans and timelines for a complex project.

Oren CohenVP of R&D @ ResonAI