Work recognition technologies consist of tools that can identify and gather feedback from physical objects, gestures and visual or auditory inputs to deliver targeted content. This technology can be used for museum mediation as it can enhance visitor interaction, and the visit’s accessibility and educational value.
These systems function through a combination of artificial intelligence, machine learning and sensor-based inputs. They allow to create dynamic visits that go through static exhibits, while providing the option of personalisation of the visitor experience.
This technology can be used in different ways for on-site digital mediation:
- Technologies for object recognition: cameras and sensors are installed, to identify physical objects such as artefacts or exhibits and provide digital content. This way when visitors point the dedicated device (like a phone or tablet) at the exhibit, the system will display detailed information that can be presented in a multimedia format such audio descriptions, or a text giving historical context, or interactive visuals. The benefit of this use is that it allows to transform static displays into interactive portals of information, which in its turn will create a deeper engagement with collections.
- Technologies for gesture recognition: Here sensors and devices are installed to track and interpret the visitors gestures that would lead to trigger specific actions or responses. This can allow visitors to interact with digital exhibits or to navigate in virtual environments.
For example: Visitors can wave their hand or make a specific motion to explore a 3D model of an artefact or access more content without touching any physical device. This could be interesting for accessibility, as it can be used to remove barriers for individuals with mobility impairments and offers a hygienic, touchless option in the post-COVID era.
Series of three articles “Touchless Gesture-Based Exhibits” will give you a more in-depth look into this matter.
You can also watch a short video on how gesture recognition technology works.
- Image and text recognition: Systems like OCR (Optical Character Recognition) and pattern-matching algorithms scan artefact inscriptions, manuscripts, or artwork details to generate corresponding digital narratives.
As shown by these applications this mediation tool has a potential for inclusivity and accessibility.
For visitors with visual impairments, the object recognition tool paired with audio guides can provide detailed descriptions of visual exhibits, ensuring full accessibility.
For visitors with mobility challenges, the gesture based systems enables interaction without requiring physical touch or proximity.
Moreover, the real time translation through the text recognition systems ensures that language barriers do not impact the visitor experience negatively.
This mediation tool is however considered an advanced technology that can be expensive and unaffordable for all institutions. However, entry-level solutions using smartphone based object recognition apps can be a more cost-effective solution to start with.