Geollery
Geollery can continuously render virtual 3D environments based on real-world 2D maps in real-time.
Background
Social media plays a significant role in many people’s daily lives. People can see everything from restaurant reviews to updates from friends to local news and sporting events. However, these things all still seen and experienced on screens. Screens are efficient for quick browsing, but users can’t truly interact with the social media posts that they’re seeing. Augmented and virtual reality (AR and VR) allows us to break that barrier and create an environment where users can truly experience and interact with social media. This includes finding nearby friends, checking for special offers at shops, and learning about upcoming events. While there have been several efforts to create similar platforms, they are limited by their inability to let users walk or render worlds in a reasonable time.
Technology
Geollery is an interactive mixed-reality platform for creating, sharing, and exploring geo-tagged social media. It uses a real-time pipeline to continuously create a three-dimensional environment as a user walks through it. As they’re walking through the world, users can create their own content and see geo-tagged posts from other social media sites. This mirrored world allows users to see, chat, and collaborate with remote participants within the same immersive space.
Benefits
- Seamlessly integrates real-world 2D maps with augmented 3D, enabling an immersive mixed-reality experience.
- Utilizes real-time progressive rendering and dynamic data streaming for accurate spatial visualization.
- Offers diverse content visualization and aggregation methods, enhancing user creativity and interaction.
- Empowers users with robust privacy controls and customizable avatar presence.
- Supports versatile applications such as tourism, advertising, immersive storytelling, and cultural learning.
Applications
- location-based advertising
- immersive tourism experiences
- interactive virtual events
- augmented reality urban guides
- crowdsourced cultural storytelling
Additional info
The system delivers interactive mixed-reality experiences by transforming 2D map data into mirrored 3D environments via progressive rendering. Real-time data from OpenStreetMap and multiple social media sources are aggregated using API integration and WebSocket communication. Implementation utilizes Three.js for spatially accurate visualization, dynamic content rendering, and six degrees-of-freedom navigation. Multiple aggregation and display modes enhance interactivity, supported by privacy controls and environmental effects for robust, immersive user collaboration.