Skip to main content
Participant
June 1, 2016
Open for Voting

P: Automatic image tagging

  • June 1, 2016
  • 37 replies
  • 6066 views

[Update: See this reply for a list of third-party plugins providing automatic image tagging: https://feedback.photoshop.com/photoshop_family/topics/automatic-image-tagging-with-google-cloud-vis... -- John Ellis]

Hi all,
who of you likes organising and tagging pictures in your image catalogue? I don't. I'd love to keep my focus on taking photos. When I read about the Google Cloud Vision API, I thought this cloud be the solution for my problem that I don't like organising, but love having things organised. Cloud Vision is a service that takes an image and returns a set of keywords, places, brancs, etc. it detected. Why not let Google do the work?
So I started learning Lua and Lightroom development to create such a Plugin by myself (hold on, it is nothing there yet).
When I started thinking about the actual plug-in, the question came up what would other Lightroom users expect it to look like? And what other features do you expect? So I forwarding these questions to you. What do you think of it? Do you think this plug-in is helpful to you? What are your expectations?

37 replies

berliner_ffm
Inspiring
October 19, 2017
I understand Sensei only works for online pictures. But why not enable search with sensei from Lightroom Classic for all synched photos? I dont want to change the application just for a search.
imanikongirl
Participant
October 19, 2017
THANK YOU for this!
johnrellis
Legend
October 19, 2017
See this previous post for plugins that provide automatic tagging and search: https://feedback.photoshop.com/photoshop_family/topics/automatic-image-tagging-with-google-cloud-vis...
johnrellis
Legend
October 19, 2017
In a merged topic, *Victoria Bampton Champion wrote, "Sensei is all done in the cloud, so you'd have to get your photos up there. Since you have Classic though, you can sync photos to the cloud (it just sends small smart previews) so that Sensei searches them, and you can use the Sensei search on the mobile apps or web browser."
imanikongirl
Participant
October 19, 2017


Can you please give us professionals that use Lightroom Classic Sensei too? I hate it when you give all the new tools to the shiny new penny and don't continue to do so with the older "classic" versions. This is alarmingly similar to my experience with purchasing Lightroom 6 only to discover it didn't have all the features of the CC version...so I did switch.
johnrellis
Legend
August 29, 2017
Google's Cloud Vision service does some of this. For example, it generally recognizes and labels the presence of "car", "antique", and "classic" or "vintage" car, and it correctly identified a Volkswagen Beetle, a Ford Model A, and a Mercedes Benz 500K. But more often it fails to identify the make or model.

It also usually identifies the presence of other categories -- trains, planes, etc.   And it often identifies buildings and landmarks by their map location.  

See this post for an overview of services that provide automatic tagging in LR: https://feedback.photoshop.com/photoshop_family/topics/automatic-image-tagging-with-google-cloud-vis...
smu95rp
Participating Frequently
August 29, 2017


Currently, Lightroom can recognize faces and suggest People to label images. It would be really useful to be able to apply the same technology to objects or products. 

I take a lot of photographs of classic cars and it would be really helpful for Lightroom to be able to suggest specific makes/models. I'm sure that train, airplane and boat enthusiasts will have a similar use. Or marketers can use it to find appearances of their products in media.

Additionally, it can recognize specific cities by their buildings or landmarks. 

Also statues and artworks.
Participant
April 17, 2017


Is it possible to implement photo recognition to generate keywords?

I have seen this kind of functionality on an online photo community (I don't know if Adobe already provide it to its online one). I was thinking that this functionality will be a powerful tool for non professional photographer to improve their use of a software like Lightroom that provide tools to take advantage of keywords in photos.

I use Lightroom for long time, but in order to exploit my photo database I need an continuing improved set of keywords. As I develop my way to practice photography I'm more demanding about Lightroom features that are powerful like collections... But one limitation is brain and memory (speak for myself only) because I'm facing a problem : how can I extract photos that share the same features in order to work on them and see if I can make a coherent collection.

I'm not so wise to implement a complete dictionary of keywords, and giving coherently keywords to all my photos is a task that will take too long time and probably will be pledge by inefficiencies in the keywords definition.

So will it be possible to implement IA photo recognition and to generate set of keywords on each photo of a given database, like face recognition does. It will save precious time and give the opportunity to all users to discover common elements in their photographic practice. A analysis module could also provide automatic collection themes based on the most shared keywords or can provide interface that allows the user to select a specific theme and explore differently its production.

Exploiting past photos is a growing problem and this kind of feature will be helpful and powerful if connected to other LR existing functionalities. It will help me (and probably some others) to focus on ideas and photo selection/improvement.

Thanks 
Frederic
johnrellis
Legend
March 19, 2017
Here's an updated list of products for automatic image tagging within Lightroom. If you know of others, please post them here.

Cloud Tagger uses Google Cloud Vision, and it is intended as an aid to careful keywording of smaller numbers of photos rather than searching large catalogs. It currently has no recurring charges.

MyKeyworder is intended as an aid to careful keywording of smaller numbers of photos rather than searching large catalogs.  It has recurring charges.

Lightroom Keywords is intended for careful keywording of smaller numbers of photos rather than searching large catalogs. It has per-photo charges.

Wordroom is intended for careful keywording of individual stock photos. It's currently in beta and it's not clear what it will cost in the future.

Excire lets you search your entire catalog for specific content or for similar images. It doesn't use the cloud and it has a higher one-time upfront cost with no recurring charges.

LrTag is similar to Excire, but it has a monthly charge.

RAISE is an online photo-sharing service. Free?  Not clear if its LR plugin downloads tags back to the catalog.

Any Vision uses Google Cloud Vision to automatically tag your photos with labels, landmarks, logos, face expressions, and dominant colors and extract embedded text (OCR). It has recurring charges.

Lightroom Cloud (but not LR Classic) uses similar technology, but it doesn't search your desktop catalog, just photos you've synced with Lightroom Cloud, Web, and Mobile.

[Updated to reflect the release of Project Nimbus as Lightroom CC.]

[Updated to add Wordroom and LrTag.]

[Updated to add RAISE.]
Inspiring
March 19, 2017


Keywording is a painful and cumbersome process especially in these days where many photographers have fat LR catalogs with hundred thousands of photos that are increasing every day with little or no time to pick, rate, keyword, and tag.

LR has automated face detection and geotagging features, and both are integrated nicely with keywording panel at the library module. However, many users may need to search for a specific photo based on some general concepts such as scene type (e.g. landscape, architecture), or more specific objects such as Eiffel tower.

At the moment, I'm aware of the experimental search feature which is available only at online version of LR but this is limited only for searching on synced collections without offering any option to keyword them.


I think it will be great if Adobe extends the artificial intelligence based search feature to desktop and mobile versions of LR  and adds the ability to suggest keywords and apply them into photos.