(For USM Staff/Student Only)

EngLib USM > Ω School of Electrical & Electronic Engineering >

Wearable visual impairment assistance system

Wearable visual impairment assistance system / Wong Hong Loon_
Pada tahun 2014, Organisasi Kesihatan Dunia (WHO) melaporkan bahawa terdapat 285 juta orang dianggarkan mempunyai cacat penglihatan di seluruh dunia, termasuk rabun dan buta. Kira-kira 90% daripada golongan ini adalah dari keluarga berpendapatan rendah. Golongan cacat penglihatan menghadapi banyak cabaran dalam kehidupan seharian, seperti navigasi dan mengenali objek. Apabila menjalani aktiviti seharian, mereka hanya boleh bergantung kepada maklumat deria lain untuk melihat alam sekitar yang agak sulit kepada mereka. Oleh itu, jurutera dan pereka telah mencipta banyak sistem bantuan bagi golongan cacat penglihatan untuk meningkatkan kualiti kehidupan mereka. Walau bagaimanapun, sesetengah sistem tidak selesa, sederhana ketepatan atau terlalu mahal kepada meraka yang dari keluarga berpendapatan rendah. Dalam kajian ini, sistem bantuan yang kos rendah telah diperkenalkan untuk membantu golongan cacat penglihatan mengesan halangan semasa navigasi. Sistem yang dicadangkan melaksanakan konsep penglihatan stereo untuk mencapai tujuan pengesanan halangan. Sebuah kamera stereo yang dibina daripada dua kamera tunggal digunakan untuk menangkap gambar alam sekitar. Pemadanan stereo akan dilakukan pada pasangan imej stereo untuk menjana peta jurang di mana halangan ditemui dan diekstrak. Satu algoritma halangan pengesanan teleah dibangunkan dengan menggunakan peta perbezaan. Raspberry Pi 3 telah digunakan sebagai pengawal untuk melaksanakan algoritma halangan pengesanan dan kamera stereo. Prototaip system bantuan telah direka dan dibina untuk orang buta dan memakai di pinggang. Sistem bantuan tersebut akan memberitahu pengguna buta tentang keadaan halangan di hadapan mereka melalui getaran. Sistem bantuan itu dan algoritma halangan pengesanan teleh diuji di persekitaran dalaman dan persekitaran luar bagi adegan statik dan dinamik. Hasil eksperimen menunjukkan bahawa algoritma halangan pengesanan mempunyai kadar pengesanan sebanyak 70% dan 90% di persekitaran dalaman bagi adegan dinamik dan static masing-masing. Walaupun algoritma tersebut mempunyai kadar pengesanan yang tinggi di persekitaran luar tetapi juga mempunyai kadar penggera palsu yang tinggi. Oleh itu, algoritma ini memerlukan penambahbaikan sebelum digunakan di pesekitaran luar. Sistem ini hanya berkos kira-kira RM600. _______________________________________________________________________________________________________ In year 2014, the World Health Organization (WHO) reported that there are 285 million people are estimated to be visually impaired worldwide, include low vision and blind. About 90% of this group of people are from low income family. Visually impaired person encounter a lot of challenges during their daily life, such as navigation and recognize object. When carry out daily activities, they just can rely on other sensory information to perceive the environment which is quite inconvenient for them. Todate, many engineers and designers have designed a lot of assistance system for visually impaired person to improve their quality of life. However, some of the systems are uncomfortable, medium accuracy or too expensive for the low income blind people. In this study, a low cost wearable assistance system for visually impaired people is developed to help them detect obstacle during navigation. The proposed system implements the concept of stereo vision to achieve the purpose of obstacle detection. A stereo-camera system, which is fabricated from two single cameras is used to capture a stream of stereo image pairs of the environment in real time manner. Stereo matching will be performed on stereo image pairs to generate disparity map where the obstacle is spotted and extracted from. An obstacle detection algorithm is developed by using disparity map and U-disparity map. Raspberry Pi 3 is used as controller to operate stereo camera and implement obstacle detection algorithm. A wearable assistance system prototype is designed and built for blind users to wear at their waist level. The wearable assistance system able to inform blind users about the obstacle condition in front of them through vibration. The frame refreshing rate of the developed system is approximately one second and the system cost approximately RM600. The whole system and obstacle detection algorithm is tested in indoor and outdoor for static and dynamic environment. Experimental results show that the obstacle detection algorithm has more than 70% of detection rate in indoor dynamic environment and more than 90% of detection rate in indoor static environment with false alarm rate of around 20%. However, although the algorithm has high detection rate in outdoor environment, it also has very high false alarm rate, hence, this algorithm need further improvement for outdoor use.
Contributor(s):
Wong Hong Loon - Author
Primary Item Type:
Final Year Project
Identifiers:
Barcode : 00003107101
Accession Number : 875007222
Language:
English
Subject Keywords:
low vision and blind; visually impaired; improve their quality of life
First presented to the public:
6/1/2017
Original Publication Date:
4/17/2018
Previously Published By:
Universiti Sains Malaysia
Place Of Publication:
School of Electrical & Electronic Engineering
Citation:
Extents:
Number of Pages - 87
License Grantor / Date Granted:
  / ( View License )
Date Deposited
2018-04-17 14:50:47.563
Date Last Updated
2020-05-28 22:55:55.136
Submitter:
Mohd Jasnizam Mohd Salleh

All Versions

Thumbnail Name Version Created Date
Wearable visual impairment assistance system1 2018-04-17 14:50:47.563