Ainetra feature display, the work of the ITS student team, which is equipped with an intelligent assistant and voice user interface technology to support the independence of the blind.

ITS Campus, ITS News — Facilitating accessibility for the blind and visually impaired, a team of students from Institut Teknologi Sepuluh Nopember (ITS) innovated an application with a friendly user experience design (UX Design). The application called Ainetra comes equipped with a smart assistant based on Voice User Interface (VUI) and Realtime Video to Voice Recognition to accompany its users’ daily lives.

The head of the ITS Aities Team, Hilmi Fawwaz Sa’ad, said that this innovation can support the independence of people with visual impairments in exploring and recognizing their surroundings. Thus, difficulties such as getting lost, bumping into objects, and other limitations faced by users can be overcome. “Users will be assisted through voice interaction with the Ainetra intelligent assistant,” he said.

In carrying out its role, Ainetra brings a number of features that can be easily accessed by users. Among them, Aitra, Aisee, Aimo, and Aicom which also utilize artificial intelligence (AI) in their use. Through the trials that have been conducted, the Informatics Engineering Department student revealed that the layout of each feature has been arranged in such a way as to make it easier for users.

Hilmi explained that Aitra is the main feature in Ainetra in the form of an intelligent assistant that can provide information, directions, or other assistance to users. This feature can be easily accessed by users through commands in the form of voice input. “This feature integrated with VUI allows users to interact with voice with the intelligent assistant,” explained the student born in 2004.

(from left) Muhammad Rayyaan Fatikhahur Rakhim, Hilmi Fawwaz Sa’ad, and Dian Kusumawati when they won first place in the UX Design division at the 17th Gemastik 2024 event

The next feature is Aisee which functions to provide environmental recognition to users through computer vision and video captioning. This feature utilizes the camera on the user’s smartphone to capture videos or photos. Then the capture results are translated into sound through Realtime Video to Voice Recognition technology.

Furthermore, Aimo is a feature that provides storage for recordings of moments and documents that have been captured by users using the Aisee feature. Not only that, users can also share their captures through the user community which is packaged through the Aicom feature. “Through the community, users can interact with each other,” added this young man from Magetan.

The innovation of the ITS Aities Team has also won first place in the UX Design competition in the 17th National Student Exhibition in the Field of Information and Communication Technology (Gemastik), some time ago. As real evidence of the implementation of technology for the welfare of society, this application also supports the 10th Sustainable Development Goals (SDGs) program, namely to support equality in society.

Hilmi hopes that the rapid technological advances today can help and provide benefits to all groups in society. One of them is by providing facilities in the form of intelligent assistant technology for the blind. “Hopefully, in the future the Ainetra application can be further developed and provide real impact for users,” he concluded hopefully. (ITS PUBLIC RELATIONS)

Reporter: Ahmad Naufal Ilham