P: Automatic image tagging

[Hendrik M Halkow]

[Update: See this reply for a list of third-party plugins providing automatic image tagging: https://feedback.photoshop.com/photoshop_family/topics/automatic-image-tagging-with-google-cloud-vis... -- John Ellis]

Hi all,
who of you likes organising and tagging pictures in your image catalogue? I don't. I'd love to keep my focus on taking photos. When I read about the Google Cloud Vision API, I thought this cloud be the solution for my problem that I don't like organising, but love having things organised. Cloud Vision is a service that takes an image and returns a set of keywords, places, brancs, etc. it detected. Why not let Google do the work?
So I started learning Lua and Lightroom development to create such a Plugin by myself (hold on, it is nothing there yet).
When I started thinking about the actual plug-in, the question came up what would other Lightroom users expect it to look like? And what other features do you expect? So I forwarding these questions to you. What do you think of it? Do you think this plug-in is helpful to you? What are your expectations?

[Antoine HLMN]

Thanks Thomas

[FeedbackCommunityMember]

I've read the previous replies, but I'm not sure that my situation fits any of the solutions... I'm not looking for general keywords such as car and racetrack, I'm looking for the driver's name after linking that tag to a number style or photo of his car.  Each night will have a dozen+ photos of 80+ different drivers, and there will be 80+ races per year.  Below is my original request on another forum that lead me here:

This may or may not be something that will be useful to the majority, but... looking at the "facial recognition" features gave me an idea.  As a motorsports photographer, it would save an incredible amount of time if we could get lightroom to "recognize" a particular number style or feature on a car and label it with the driver's name the way that it recognizes a face and labels it with the person's name.  When shooting 1000+ shots per night over 4-6 different divisions, it could take hours to label each car with the driver's name that would unlock the ability for customers to search for their particular car when looking to purchase photos.  IF Lightroom could do that work for us, it would be a game changer, and IMO it doesn't seem like that much of a stretch from the "facial recognition" ability.   Thanks for your consideration.

[FeedbackCommunityMember]

There is a new tool out .It's called Smart Image Tagger.It can automatically recognize image content and tag images based on the content.The software can also organize images to folders based on these tags.
Take a look https://smartimagetagger.com

[DanielHY]

Excire seems to be quite good and there are a number of plugins that can do this, but, if we can have it as a native feature it would be great!

This is already exist for LR CC, would be great if the Classic version could do automatic image tagging using Sensei tech, can we get this pretty please?

[martin-s]

I'm wondering whether it would be possible to extend LR's facial recognition to a general subject recognition for things such as "plants", "birds", "flowers" etc.

It would allow one to find things more quickly and greatly reduce the time spent on keywording. I 'm not after 100% accuracy but would happily to settle for 80-90%.

The Apple Photos app does an impressive job at this already.

[Theresa J]

Lightroom, not Lr Classic can do this because the images are in the cloud. 

[martin-s]

I would have thought that the technology is already built in since Classic does facial recognition.

[johnrellis]

There are a number of plugins that provide AI-based automatic tagging for Lightroom Classic, including my Any Vision plugin (which uses Google Cloud Vision AI).  See here for a list of similar services.

[johnrellis]

Moderators, @Rikk Flohr: Photography, please merge with this existing Idea:https://community.adobe.com/t5/lightroom-classic-ideas/p-automatic-image-tagging/idi-p/12248745

[Red Point]

Will it ever arrive?

[GoldingD]

/Edited/ As in keywords?

Did the OP change the title? Did I have a bad day?

So, perhaps something as ON1 Keyword AI?

[Keith Reeder]

"Will it ever arrive?"

Judging by the lack of requests for it (which explicity matters), probably no time soon.

New features don't materialise just because you want them.

[Ian Lyons]

@GoldingD  Somebody changed the title. So, you can put the meds back in their safe place 😉

[Jao vdL]

Pretty sure they want this to be a Lightroom Cloudy (where this already happens behind the scenes) exclusive feature.

[johnrellis]

As Jao indicated, LR Cloud has used AI to auto-keyword photos for many years, and most of us believe it is very unlikely Adobe will implement this for LR Classic.

You could use the Any Vision or Excire plugins while waiting for Adobe...

[Red Point]

Thank you for the many responses.

I just saw that Adobe is in fact already offering "Smart Tags" based on Sensai AI in Adobe Experience Cloud. See link here. But its only for the corporate and enterprise crowd. For us common cloud subscribers, I guess we are not worthy of receiving such "advanced" features (;

Since most here agree that Adobe will not offer this feature for normal Cloud subscribers (thank you for pointing this fact out to me), I am looking into using ComfyUI, which is a node / graph based batch processor that uses open source AI models. There is an extension that allows automatic keyword tagging of images in a batch workflow (via ComfyUI WD Tagger).

Seems like the OpenSource community is a lot quicker in many things AI these days.

[Red Point]

ON1 Keyword AI is only part of their whole ON1 suite what I see, which is around 230 USD. Also, it seems that their tagging feature is very slow (based on YT reviews). 

Lightroom (cloud) has smart tagging? I will try it out. But since I have around 30k images to tag, not sure if this is a good solution for me. I am looking for a desktop app solution (I will look into the other above suggested solution - thank you btw).  

Any Vision looks very promising. I just purchased it (for 10 USD). You also need a Google API key. When you set it up, you get 300 USD credit to be used within 90 days, which is great for tagging your whole image catalog (basically for free). After that you get 1000 images per month free, which would probably work for most of us. AnyVision+GoogleAPI will tag keywords based on objects in image; it can recognise logos and will also tag dominant colors. An image takes around 4 seconds to process.

I really like the idea of tagging directly within Lightroom, so that will probably be my prefered goto option. 

[andrzejv90126968]

Prydała by sie opcja słow kluczowych AI

[Micke, Finland]

Is there any research going on that could provide something like this?

"Enter a word in the search field and LrC (or LR) would show photos that contain the described object or action even if none of the metadata contain those words."

"Enter a single word, LrC/LR would locate shots that contain the described object or action and offer to add the word as a new keyword."

"LrC/LR would examine newly imported photos and suggest adding words present in the Keyword List if the shots seem to contain the objects or actions."

This would be a huge time saver as it is tedious work to maintain comprehensive descriptive keywording.

Micke

[Jao vdL]

"Enter a word in the search field and LrC (or LR) would show photos that contain the described object or action even if none of the metadata contain those words."

This is already present in Lightroom Cloudy. You can search images by visual keywords that are recognized by Adobe's AI in all your images. It works amazingly well but cannot be used in Classic. Lightroom Cloudy can do this because all of your images are stored in the cloud and therefore are analyzed by Adobe's AI. Just sync a few images to the cloud from Classic and open up Lightroom Cloudy and use the search field and search for keywords that you can see in the image but are nowhere in their metadata.

"Enter a single word, LrC/LR would locate shots that contain the described object or action and offer to add the word as a new keyword."

"LrC/LR would examine newly imported photos and suggest adding words present in the Keyword List if the shots seem to contain the objects or actions."

That is unfortunately not possible in Cloudy. It hides the AI generated keyword list from users unfortunately. There have been many requests to make them visible and usable in the interface but you really only search from them. I think the fear is that if they were visible, people could train their own AI system on the results from Adobe's AI. Classic, which has far more powerful keywording tools, is very unlikely to get the AI keywording unfortunately because of the images not being stored in the cloud so can't be easily analysed this way.

[johnrellis]

@Micke, Finland, check out the Any Vision plugin, which uses Google's Cloud Vision AI service to label photos in your catalog. That page has a section on similar services.

To build on @Jao vdL, it's unlikely Adobe will ever add this to Lr Classic -- back when the LR cloud ecoystem was announced (Lightroom Classic 7), Adobe publicly stated there would be no more improvements to LR Classic's connection with the cloud.

[Califdan2]

@johnrellis said: 

> To build on @Jao vdL, it's unlikely Adobe will ever add this to Lr Classic -- back when the LR cloud ecoystem was announced (Lightroom Classic 7), Adobe publicly stated there would be no more improvements to LR Classic's connection with the cloud.

I remember them saying that, but I would not characterize this request as falling under that statement.  This request is not (as I understand) asking for something to be added to the Cloud Sync process but rather asking that a capability present the LR/Cloud ecosystem be added to the LR/Classic platform. 

[Micke, Finland]

Thanks @Jao vdL for the comprehensive answer. I had somehow missed that this is available in LR. And yes, it works pretty well too! 

But that is unfortunatrely pretty useless, at least in my case. A search must be able to address the whole archive. It's IMO unfeasible to keep the archive in the could because of pricing and reliability issues. The cloud is great for collaborating and getting shots from other devices to the archiving system, which runs on LrC. So searches need to be done there. AI-assisted keywording could be done in the cloud before archiving, but that's not available either.

I have been a LR/LrC user since v. 1.0, but if they are cutting back on development it's probably the right time to start looking for alternatives. 😞

Micke

[Jao vdL]

I completely agree and would love AI searching in Classic but we're extremely unlikely to get it unfortunately. This is clearly one of the ways Adobe differentiates their cloud platform from their non-cloud platform. Hopefully enough people vote up that this gets noticed but on other requests to upgrade the capabilities of Classic with respect to this sort of cloud/ai related stuff Adobe has been non-responsive for many many years. Here is an example from 6 years ago with overwhelming support but is just not going to happen (I've made my peace 😉 😞 https://community.adobe.com/t5/lightroom-classic-ideas/p-should-be-able-to-sync-full-raw-files-to-th...

[Seb29]

Can Adobe please allow us to search our Lightroom Classic library by text description. For example, Search: elephant - then it would show all the elephants in our library WITHOUT having to tag them that way.