P: Automatic image tagging

[Hendrik M Halkow]

[Update: See this reply for a list of third-party plugins providing automatic image tagging: https://feedback.photoshop.com/photoshop_family/topics/automatic-image-tagging-with-google-cloud-vis... -- John Ellis]

Hi all,
who of you likes organising and tagging pictures in your image catalogue? I don't. I'd love to keep my focus on taking photos. When I read about the Google Cloud Vision API, I thought this cloud be the solution for my problem that I don't like organising, but love having things organised. Cloud Vision is a service that takes an image and returns a set of keywords, places, brancs, etc. it detected. Why not let Google do the work?
So I started learning Lua and Lightroom development to create such a Plugin by myself (hold on, it is nothing there yet).
When I started thinking about the actual plug-in, the question came up what would other Lightroom users expect it to look like? And what other features do you expect? So I forwarding these questions to you. What do you think of it? Do you think this plug-in is helpful to you? What are your expectations?

[johnrellis]

"please allow us to search our Lightroom Classic library by text description. For example, Search: elephant - then it would show all the elephants in our library WITHOUT having to tag them that way"

While waiting for Adobe to implement this (which seems unlikely), some options:

- Sync LR Classic with LR Cloud and do such searches in LR Cloud, which provides this functionality.

- Any Vision plugin.

- Excire Search.

[PhilBurton]

After a lot of thought I decided that I did not need Excire or any other tagging software that generatged generic tags such as "boat" or "mountain."  I already do a lot of manual tagging.  I tage faces of course, but I also tag subjects that are of interest to me and that sort of tagging is something that Excire can't do now, and probably won't do for a long time. 

As a Lightroom Classic user (only!) right now, what I need is AI that I can train on MY images only, and use that to tag new photos. And I want it to be Classic only, so I don't depend on an internet connection.

Also if Lightroom Classic did implement auto-tagging, I would have two concerns:

1. Do I even want to include more of the resulting tags?  Tag clutter is a concern for me.

2. How would the auto-tagging align with the keywords I have already created?  Would I need to revise those existing keywords to align with the auto-tagged equivalents.

All this presupposes that I have a GPU powerful enough to make local autotagging perform well.  And GPU boards now are $$$

[johnrellis]

"All this presupposes that I have a GPU powerful enough to make local autotagging perform well."

Most common desktops and laptops are more than powerful enough to execute image classification models. In another context, I timed a popular open-source image-classification model:

https://community.adobe.com/t5/lightroom-classic-ideas/p-allow-users-to-disable-the-gpu-for-ai-maski... 

On a 2019 Intel Mac, it classified photos at about 111 photos/sec using its (now older) GPU, and at about 26 photos/sec not using the GPU.  That's more than fast enough and allows plenty of headroom to incorporate larger models.  Excire uses similar technology.

Training new models is much more compute-intensive in general. I don't have enough experience with that to comment on your desire to train on just your own photos. 

[ChristianFrank]

Im LR Entwicklermodus kann das aktuelle Bild automatisch Verbessert werden.
kann diese Funktion auch auf alle markierten Bilder angewendet werden?

[Shivani Somayajula]

Hey there, Welcome to the Lightroom Ecosystem Community. I'll help you figure this out. 

I'll merge this thread to the parent thread now. 

Regards, 

Shivani 

[westdr1dw]

A nice feature would be adding an object search feature in LrC.

How many times have we taken pics and there was no sign of the object name. This could apply to almost any object ie flower, car, vegetable . . .

Current process is exporting a JPG file and loading into Google in Lens search. 

[johnrellis]

LR Desktop / Mobile / Web offers this capability as its "Sensei" search.  But Adobe has never implemented it for LR Classic. You might consider the Any Vision plugin, which uses Google Cloud Vision, or Excire Search.

[johnrellis]

Moderators, @Rikk Flohr: Photography, please merge with this Idea:

https://community.adobe.com/t5/lightroom-classic-ideas/p-automatic-image-tagging/idi-p/12248745

[johnrellis]

Moderators, @Rikk Flohr: Photography, please merge with this Idea:

https://community.adobe.com/t5/lightroom-classic-ideas/p-automatic-image-tagging/idi-p/12248745

[Y2745045020cw]

I hope Lightroom can use AI to detect objects/themes/styles in photos and automatically add keywords.

[michaelburris]

Apple Photos provides location information and Google provides detailed information about subject. Why can't AI be used within LR to suggest keywords and geomarking data?  Nothing is more tedious than entering keywords and hunting down geomarkers for the majority of us who don't have GPS in camera. 

[johnrellis]

LR Desktop / Mobile / Web offers AI-based keyword search as its "Sensei" search.  But Adobe has never implemented it for LR Classic.

You might consider the Any Vision plugin, which uses Google Cloud Vision, or Excire Search. Any Vision uses Google Gemini AI, letting you write "prompts" that can generate keywords, descriptions, categorizations, and identify GPS locations.