Description
We built an android app that can do visual image translation. It can detect texts in an image, recognize the words, do translation, and overlay the translated results.
The app relieves users burdens of searching word one at a time. We believe this app would be useful for foreign visitors and foreign language learners.
We achieved a good accuracy and recall on detecting text in relatively simple images. The OCR has not very high accuracy which should be further improved in the future.
Image processing pipeline
Sample testing results from collection 1, left: original image, middle: text region detection result, right: erasure and translation output.
[1]https://www.mathworks.com/help/vision/examples/automaticallydetect-and-recognize-text-in-natural-images.html.
[2] R. Smith, An overview of the Tesseract OCR engine, Google Research, 2007.
[3] https://www.abbyy.com/en-us/.
[4] https://developers.google.com/vision/text-overview.
[5] https://github.com/rmtheis/tess-two.
[6] https://cloud.google.com/translate/.
Android app for recognize and evaluate arithmetic expressions by OCR
Android app for recognize and evaluate arithmetic expressions by OCR
Colton –
This project helped me a lot.