This marks the first time Pinterest’s visual discovery technology is being integrated into a separate application, a Pinterest spokesperson said.
“While search engines rely on typing text into a box, we're focused on the untapped potential of searching and discovering with your camera,” the spokesperson said in an email. “Now that [visual discovery tool] Lens [which allows users to discover content using the camera in the Pinterest app], is out to the world on Pinterest, we're excited to extend similar technology through the Samsung integration.”
In addition to the Galaxy S8, the platform will power image search in Samsung’s new intelligent interface Bixby.
“Now Samsung customers around the world can take a photo of anything and get related ideas and products from Pinterest through the S8 native camera app,” the rep said. “Just tap Bixby Vision [a feature The Verge likened to an augmented reality camera], then ‘image search’ to discover related products and ideas. Samsung customers can also search images across the web in the Samsung Internet app and existing photos in their photo gallery.”
If a consumer takes a photo of a dress he or she likes, for example, Pinterest will display related dresses, including styles, colors and patterns, which could include dresses the consumer can buy on Pinterest, or pins he or she can click through to purchase directly from the brand that sells the dress. Content from brands will appear organically if relevant to whatever it is users are searching for, the spokesperson said.
The rep also noted, “We are not monetizing results at this time.”
As part of the integration, Pinterest said it will also return ways to bring the idea, recipe or style to life.
“We’ll show you what the product looks like in different settings, so if you take a photo of a sofa, we’ll show you rooms and decor ideas with that sofa."