Integrating YOLOv8, EasyOCR, and GTTS for text detection in assistive technology for the visually impaired

Abstract

Technology for visually impaired individuals has advanced, but accessing text-based information remains challenging. Accurate text detection, clear reading, and voice conversion are essential. YOLOv8, EasyOCR, and Google Text-to-Speech (GTTS) are cutting-edge technologies that can be integrated to address this need. This study aims to develop a system combining YOLOv8 for text detection, EasyOCR for text recognition, and GTTS for text-to-speech conversion, focusing on improving accessibility for the visually impaired. The system operates in several stages. First, YOLOv8 detects text in images in real-time. Next, EasyOCR extracts text from the detected regions. Finally, GTTS converts the recognized text into clear speech. A diverse text image dataset was used for training and testing the detection model, while user testing was conducted to assess system usability and effectiveness. The developed system successfully detects and reads text with high accuracy and converts it into clear speech. System evaluation revealed significant improvements in information accessibility for the visually impaired, with users responding positively to its speed, accuracy, and ease of use. Integrating YOLOv8, EasyOCR, and GTTS into a single solution presents an innovative approach to text detection, recognition, and conversion for visually impaired individuals. This system demonstrates significant potential to enhance independence and quality of life by improving access to text-based information. The study contributes to assistive technology development and opens doors for further research into practical applications and system refinement.