IT specialists from the University of Tokyo have developed an interesting artificial intelligence-based application with an excellent sense of harmony and taste - Imaginary Soundscape. Its main purpose is to select a suitable soundtrack for the loaded image.
For example, looking at the Japanese engraving "Fishing Boats", the user will hear the lapping of the waves. In test installations, the selected video is very often accompanied by a sound fragment that almost ideally coincides with the expectations of the users.
This impressive result is actually a product of a relatively simple AI that recognizes objects within an image and then correlates them with more than 52 thousand sound files. An early version of Imaginary Soundscape, launched in January, closely resembles Google Maps and Google Earth's Google Street View feature.
Despite the fact that the new version of the application looks much more impressive, it is not without its drawbacks. So, in its work, some errors are quite possible, and the number of files would not hurt to increase several times. Experience has shown that the most successful sound "illustrations" from Imaginary Soundscap are obtained for artwork, photographs and abstract painting.