P: Please add face recognition to Lightroom (ability to specify region metadata)

313 Votes
LEGEND ,
Apr 26, 2011 Apr 26, 2011

Copy link to clipboard

Copied

Do you plan to implement a face recognition defined by keywords in Lightroom someday ?

Idea Released
TOPICS
macOS , Windows

Views

223

Translate

Translate

Report

Report
Community guidelines
Be kind and respectful, give credit to the original source of content, and search for duplicates before posting. Learn more
community guidelines
replies 121 Replies 121
121 Comments
LEGEND ,
Apr 28, 2011 Apr 28, 2011

Copy link to clipboard

Copied

Add face recognition algorithms similar to what Aperture has. Perhaps include something along the lines of people tagging so that people aren't just key words in a photo.

Votes

Translate

Translate

Report

Report
LEGEND ,
Apr 28, 2011 Apr 28, 2011

Copy link to clipboard

Copied

If Adobe decides to add face recognition, I hope they do a better job than they did with Photoshop Elements, which had severe problems with its recognition.

Votes

Translate

Translate

Report

Report
Explorer ,
Apr 28, 2011 Apr 28, 2011

Copy link to clipboard

Copied

I'm all for this IF sufficient Dev resources are committed to to it's being implemented well. In other words, if it's going to be half-assed, don't bother. There's plenty of other things to tweak and improve closer to LR's core functions.

Votes

Translate

Translate

Report

Report
New Here ,
Apr 28, 2011 Apr 28, 2011

Copy link to clipboard

Copied

@bend: Well Put

Votes

Translate

Translate

Report

Report
Engaged ,
May 19, 2011 May 19, 2011

Copy link to clipboard

Copied

First a face detection would be OK
-> I mean just detect faces with out saying who is there can help a lot.
Then add face recognition

But the most important thing is to be able to tag an image region (like a face for instance)
1. Start to make it general : ability to associate a region (saved in xmp) with a Keyword (normal kind of keyword we have already)
2. then these Keywords can be used for face taging
3. then in the database some of these keywords can be associated to face characteristic allowing an algorithm to make face recognition.

Finally the most important in face recognition is not how well the algorithm performs, but how well results are presented so that you can easily correct any errors or validate good guess.
Maybe we can group faces by similarities (with a given threshold) like Picasa seem to do.
A same person may then appear in different such group (because the person got older, or ...) and a same keyword (person keyword for instance) would then be associated with 2 or more face characteristic. this way we can eleminate the problems of photoshop element who get worse at guessing people faces when you have tagged too many faces of the same person (old faces pollute the ability to detect youger faces and vice versa)
regards
Eric

Votes

Translate

Translate

Report

Report
LEGEND ,
May 19, 2011 May 19, 2011

Copy link to clipboard

Copied

Presentation is very important and something Picasa has got right (even over iPhoto). The annoying thing about Picasa Face recognition is that you can't tweak anything, or even tell if it's still running... until you suddenly get new results (try the Grouping Faces feature)

LR integration with Keywords is crucial, and possibly a way to integrate EXISTING Keywords to help with the detection would be great.

I typically take have a shooting spree where I have taken dozens of photos with the same people, so presenting that / building an algorithm should prefer that I would hope.

Votes

Translate

Translate

Report

Report
Adobe Community Professional ,
May 19, 2011 May 19, 2011

Copy link to clipboard

Copied

I really would not want face recognition data in keywords. There's a proper IPTC field - Person Shown - and that's what should be used.

Votes

Translate

Translate

Report

Report
LEGEND ,
May 19, 2011 May 19, 2011

Copy link to clipboard

Copied

You're right and I've confused the issue... For EXISTING metadata (e.g. IPTC:Person Shown, Keywords) of photos I'd like the algorithm/interface to give great weight to those edits I've already made for those fields. When "tagging" a Face on the photo, I think it should be stored in IPTC:Person Shown field.

Votes

Translate

Translate

Report

Report
Adobe Community Professional ,
May 19, 2011 May 19, 2011

Copy link to clipboard

Copied

Understood, though I suspect I also misread you! Do you know if Picasa uses existing IPTC as part of the algorithm? I can see why it would make sense (and fit LR's style), but I hadn't seen an example of software doing this.

Votes

Translate

Translate

Report

Report
Engaged ,
May 19, 2011 May 19, 2011

Copy link to clipboard

Copied

no they don't. At least in the version I use,I did not checked if it got updated.
By the way the anoying thing with PICASA and IPTC: person shown is that there is no hierarchy
-> whenyou have 1000 of names it becomes a real pain to find the one you need for tagging (though PICASA lets you type it and auto complete, which helps a lot)

Votes

Translate

Translate

Report

Report
Adobe Community Professional ,
May 19, 2011 May 19, 2011

Copy link to clipboard

Copied

"By the way the anoying thing with PICASA and IPTC: person shown is that there is no hierarchy"

Lightroom could still add hierarchy without it being IPTC-supported (as it does with collections for instance). The trouble is, family structures are often messy, and can be fluid over time.

Votes

Translate

Translate

Report

Report
Engaged ,
May 22, 2011 May 22, 2011

Copy link to clipboard

Copied

I would hate if the face information were not stored in the XMP data.
That is already one of the biggest issue with PICASA, and is why I do not use it anymore.
Note that Microsoft already created a XMP structure to store face information. (It is just a little bit too much microsoft centric since one of the record is related to a MSN account, but you do not need to fill it)
By the way it would be nice if lightroom could read these tags (and write them) as well.
PS: As for family structure I have no problem with them so far, keeping it simple, with just the family name.

But maybe we could invent a XMP tag that would allow for complex tree such as family tree ...

Votes

Translate

Translate

Report

Report
Engaged ,
May 22, 2011 May 22, 2011

Copy link to clipboard

Copied

I added a related feature request:

ability to tag a picture region

Votes

Translate

Translate

Report

Report
Adobe Community Professional ,
May 22, 2011 May 22, 2011

Copy link to clipboard

Copied

Remember that XMP is only the language or syntax used. There's an IPTC standard field - Person Shown. Build out from there - and the X stands for (user) extensible.

Votes

Translate

Translate

Report

Report
LEGEND ,
May 22, 2011 May 22, 2011

Copy link to clipboard

Copied

The Metadata Working Group, of which Adobe and Microsoft are members, has already defined a standard method for representing regions and metadata associated with those regions. In particular, keywords, map locations, and persons (as already defined by the standards) can be associated with regions. This all gets stored in XMP metadata, of course.

See "Guidelines for Handling Image Metadata, Version 2", section 5.9 for more details.

Votes

Translate

Translate

Report

Report
Engaged ,
May 24, 2011 May 24, 2011

Copy link to clipboard

Copied

that is exactly what we need!
I would like then LR to offer us the ability to tag region and link them with Keywords(whether it is a face region or not),( and Person In Photo IPTC/XMP tags when we specify it is a face region).
That would be the firrst step towards face recognition.
Second step would be to extract faces (just face recognition - no person identification) , so that it would improve manual face tagging.
Third step would add the face recognition.
When I speak in term of step I mean version of lightroom, as I understand that developping all that at once may take time and may not be free of bugs.
So we can take time to get there.

Votes

Translate

Translate

Report

Report
Community Beginner ,
Jul 13, 2011 Jul 13, 2011

Copy link to clipboard

Copied

Picassa's face recognition works really well..

I would hope though that if Adobe do add this feature (please do) that they do not get tempted to incorporate this into social networking sites... I do not like the idea that people can tag your picture on line without your permission. let alone be able to publish your photo online.....

Votes

Translate

Translate

Report

Report
Community Beginner ,
Jul 13, 2011 Jul 13, 2011

Copy link to clipboard

Copied

add into the product facial recognition

Votes

Translate

Translate

Report

Report
Explorer ,
Jul 24, 2011 Jul 24, 2011

Copy link to clipboard

Copied

Google just acquired a facial recognition software company named Pittsburgh Pattern Recognition. See

http://blogs.wsj.com/digits/2011/07/2...

So Apple has it, and it looks like Google will be using it. It sure would be easier to keyword photos with face recognition, assuming it worked well. Instead of viewing it as a gimmick for the masses, as opposed to serious photographers, try viewing it as a workflow automation improvement that will become a requirement over time.

Fast forward a few years. Imagine LR creates an XML file, or mini DB of attributes attached to each photo, derived from things like image processing, GPS coordinates and date/time. Potential keywords could be presented for easy selection like: Dad, Julie, John Warnock, Christmas, Wedding, River, Mountains, Horse, Fog, Dawn, Yosemite, Motorcycle, Woman, Rain, Tornado, Fire, Red, Fruit ... You get the idea.

This kind of stuff will be prevalent for still and video captures in a few years, by all the computer-based applications (desktop and laptop and maybe tablet).

So Adobe - lead or follow?

Dan

Votes

Translate

Translate

Report

Report
Explorer ,
Aug 02, 2011 Aug 02, 2011

Copy link to clipboard

Copied

And not just Macs and PCs. What if Picasa and YouTube have auto keywording assistance and LR doesn't?

Will more LR users begin uploading their photos to a cloud for post processing that LR doesn't provide?

Votes

Translate

Translate

Report

Report
Guest
Aug 10, 2011 Aug 10, 2011

Copy link to clipboard

Copied

add feature Face Detection with easy way to zoom, magnifying glass.
to test for large photo facial expressions

Votes

Translate

Translate

Report

Report
Mentor ,
Aug 10, 2011 Aug 10, 2011

Copy link to clipboard

Copied

I decided to take a second look at face recognition after my disastrous first test with PS Elements 8. I tried out Windows Live Photo Gallery's version.

I gave it a folder of about a thousand images, pretty much all of them of people (my kids, mostly). It took about 10 minutes, and came up with a bunch of faces for me to identify. That took a few minutes. Done right?

I then went through image-by-image and had a look. It missed about 75% of the people in the images, not identifying them as faces at all. This seemed to be caused by the fact that the full face wasn't in the image, either in profile, partially obstructed, wearing sun glasses, or something else.

I then proceeded to manually do what it hadn't done. It took a little over two hours.

Since I had to touch each image manually anyway, I estimate that the face recognition technology only saved me a few minutes over doing the whole thing myself manually.

I think this is a difficult problem and I don't see a way to overcome it.

Votes

Translate

Translate

Report

Report
Engaged ,
Aug 11, 2011 Aug 11, 2011

Copy link to clipboard

Copied

From my experience : picasa is doing a much better job you Should try it.
Saved me several weeeks of work. But it also has difficulties to detect profile...

Votes

Translate

Translate

Report

Report
LEGEND ,
Aug 11, 2011 Aug 11, 2011

Copy link to clipboard

Copied

"I think this is a difficult problem and I don't see a way to overcome it." - this is the crux of innovation. Adobe needs to find/acquire/dedicate the resources to make this possible.

To Eric's comment: Picasa is a good alternative for now, but the workflow is a large burden. I used Picasa to index photos, recognize faces and then added standard Keywords for those images. In LR, I had to re-read metadata from this files and then assign the "Person Shown" in IPTC metadata. Ridiculous

Votes

Translate

Translate

Report

Report
Engaged ,
Aug 11, 2011 Aug 11, 2011

Copy link to clipboard

Copied

Yes, and I gave up on this as well...Too much work to bring it back to lightroom.

Votes

Translate

Translate

Report

Report