Saturday, 29 November 2014

How Google Cracked the Image Translation Problem

We used to have to put words on the web because computers could not see images. When all that a search engine had to go by was the alt text input by a human and, maybe, the text surrounding an image, understanding what it was exactly was a very hit and miss affair. 


 Ajay Tripathi

Words like Vectors
Semantic search changes all of that and Google came up with a brilliant way of tackling it that is predicated on language translation. Although the mathematics are complex the idea behind them is not: Every language has a strict logical order in which words can be associated with each other which is based upon: 
  • The internal grammatical logic of the language
  • Popular convention
  • Culture
  • Use & usage paradigms
Images like Words
The traditional approach to image translation is to take an image and try to match the elements within it to already known entities in an attempt to devine the context. This was covered in my system article. Because an image can appear in many variants of shape, size and perspective in a picture then a probability assessment would be carried out to deduce whether some elements ‘detected’ in the picture should be there within that context.
Translated Images

Well, that cleverness need not be lost any more. Google researchers realized that if they could use a computer’s image-element reading ability, combined with advances in within an image and translated that image into vector words which then used a traditional language-to-language translation model to create a caption, the effect would be, essentially a ‘translation’ of an image into language in a way that made sense for both. 

The net result of this approach is that complex images can now be translated the same way complex sentences from one language can be translated into another without loss of meaning.

Digital Marketing is the use of digital channels to promote or market products and services to consumers and businesses.
Ajay Tripathi is a digital marketing expert, he is widely considered as one of the best digital marketing expert in all search engine. He has good hand and experience in SEO, SMO, PPC, ORM, SEM…etc.

Contact me On Social Channel 













No comments:

Post a Comment