Vera
Elevate the mall experience with AI and AR-powered intelligent building management.
Vera
Elevate the mall experience with AI and AR-powered intelligent building management.
AI and AR-powered Digital Twins
Vera transforms buildings into intelligent digital twins with embedded AI and real-time data, creating environments where people and devices operate seamlessly. Vera enables context-aware applications for efficient operations and personalized, engaging experiences in office buildings, retail stores, healthcare facilities and much more.
Industries:
Indoor Navigation, Building Management
Country:
Israel
Services:
iOS, Android
Team involved:
iOS, Android
Duration:
2.5 years
Technologies
Challenges
Solutions
Performance was a big challenge. Running ARKit in 60fps, rendering and communicating with a webview, and processing each frame on-device is very resource-heavy.
We ended up using Metal for rendering, and after off-loading many operations on background threads, we managed to get from 13fps to 60fps.
Syncing the ARKit (camera) frames with the webview frames was a challenge as we wanted the content to move in sync with the world.
We implemented a custom frame sync mechanism that would not render the ARKit frame until webview wouldn't finalize it's pipeline, and it worked like a charm.
Managing the state of the ARKit, webview, GRPC connection, many background services, and the UI was a major challenge.
We ended up implementing a custom asynchronous architecture called 'The Mall' on top of Combine and Coroutines that would fully manage all the state of the app.
Creating an SDK that would allow other developers to create their own experiences on top of Vera was a challenge.
We ended up building Native iOS and Android SDKs, and a React Native wrapper on top, along with web SDKs.
Results
Selected Work
Apps used by real people — built from scratch by our team.
