Android app to do visual image translation

(1 customer review)

69

Description

We built an android app that can do visual image translation. It can detect texts in an image, recognize the words, do translation, and overlay the translated results. 

The app relieves users burdens of searching word one at a time. We believe this app would be useful for foreign visitors and foreign language learners.

We achieved a good accuracy and recall on detecting text in relatively simple images. The OCR has not very high accuracy which should be further improved in the future.

 

Image processing pipeline

Image processing pipeline

 

 

Sample testing results from collection 1, left: original image, middle: text region detection result, right: erasure and translation output

Sample testing results from collection 1, left: original image, middle: text region detection result, right: erasure and translation output.

 

 

[1]https://www.mathworks.com/help/vision/examples/automaticallydetect-and-recognize-text-in-natural-images.html.
[2] R. Smith, An overview of the Tesseract OCR engine, Google Research, 2007.
[3] https://www.abbyy.com/en-us/.
[4] https://developers.google.com/vision/text-overview.
[5] https://github.com/rmtheis/tess-two.
[6] https://cloud.google.com/translate/.

Android app for recognize and evaluate arithmetic expressions by OCR

Android app for recognize and evaluate arithmetic expressions by OCR

 

1 review for Android app to do visual image translation

  1. Colton

    This project helped me a lot.

Add a review

Your email address will not be published. Required fields are marked *