Skip to main content
A
allengambrell2
Participant
August 27, 2023
Question

Lr SDK: Get people data and face location for cropping?

  • August 27, 2023
  • 1 reply
  • 861 views

Is there a way to get the face data and location of each image using the Lightroom SDK.

I would like to have a plugin to click one button, tell Lr to find face (dont know how with sdk) in the photos and then use that face location (how to access this in sdk) then use this location to crop every image so that the head size is the same (for school portraits).

 

I see nothing in the sdk on how to trigger find faces or access the face location data. Anyone have any idea?

I saw a post that this info is in the xmp sidecar file (maybe a workaround), but to use that I have to manually tell Lr to create the xmps for the files. I cannot find a way to trigger the sidecar xmp creation using the sdk.

This topic has been closed for replies.

1 reply

johnrellis
johnrellis
Legend
August 27, 2023

"I saw a post that this info is in the xmp sidecar file ( I cannot find a way to trigger the sidecar xmp creation using the sdk."

 

Use the undocumented method photo:saveMetadata().  Or set the option Catalog Settings > Metadata > Automatically Write Changes Into XMP.

 

Then you can use Exiftool to read the face data from the XMP stored in the raw file's .xmp sidecar or in the XMP metadata stored directly in non-raws.

 

* * *

 

Alternatively, the plugin can use the "sqlite3" utility to read directly from the catalog database file. If you're experienced working with SQL databases, it's not hard to grovel around in the database to find the relevant tables. If you go that route, use the "-readonly" argument to "sqlite3" to ensure that it doesn't delete the transaction log files when it exits.

 

My Any Filter plugin goes this route to access the face data. It's much faster, but it's likely more fragile than reading the file XMP data, since the former is subject to change by Adobe at any time, whereas the latter must conform to industry standards.

 

 

A
allengambrell2Author
Participant
August 28, 2023

Thanks for the suggestion. I really wish some of those undocumented methods were documented somewhere! Took me forver to learn how to set the crop of a image, It is not documented anywhere I can find.

I figured out how to get the face loction data from sqlite3 to a csv file.
If I am processing lots for files would you suggest running 1 query to a csv for each photo or running one big query with a csv output for all the photos I need? Just not sure of how much the overhead would be for every file, and it seems like you have used it before.

johnrellis
johnrellis
Legend
August 28, 2023

"I really wish some of those undocumented methods were documented somewhere!"

 

Most aspects of develops settings are undocumented -- Adobe has never removed this warning from the SDK API documentation for photo:getDevelopSettings(): "The develop settings APIs are considered experimental. You should not depend on the contents of the settings table remaining compatible in future versions of Lightroom. The definitive list is the one shown in the UI."

 

I wrote a post last summer about how crops are represented:

https://community.adobe.com/t5/lightroom-classic-discussions/sdk-computing-the-corners-of-a-crop-rectangle/m-p/12995794

Firefly Community Gallery
Adobe Firefly

Remix with Firefly Community Gallery

Thousands of free creations to fall in love with and remix in Firefly.

Explore now
Terms & ConditionsAccessibility statement
Using the community Terms of use Privacy Cookie preferences Do not sell or share my personal information ad choicesAdChoices