How to: action/script for changing layer styles in different smart objects in different documents

And here is the final working code to automate everything!

// Apply Layer Style To Content Of All Smart Object Layers.jsx

/*
community.adobe.com/t5/photoshop/how-to-action-script-for-changing-layer-styles-in-different-smart-objects-in-different-documents/m-p/10879157

With special thanks to Christoph Pfaffenbichler for the recursive SO processing framework:
feedback.photoshop.com/photoshop_family/topics/rasterize_all_smart_objects_in_a_psd_file_to_shrink_down_its_size
*/

#target photoshop

var myDocument = app.activeDocument;
myDocument.suspendHistory("processAllSmartObjects", "processSOLayers(myDocument)");

////// Function to process all smart objects ////// 
function processSOLayers(theParent) {
    for (var m = theParent.layers.length - 1; m >= 0; m--) {
        var theLayer = theParent.layers[m];
        // apply the funtion to layersets; 
        if (theLayer.typename == "ArtLayer") {
            if (theLayer.kind == LayerKind.SMARTOBJECT) {
                var theVisibility = theLayer.visible;
                myDocument.activeLayer = theLayer;

                ////////// Start: Apply layer style to all child layers inside parent smart object layer //////////
                app.runMenuItem(stringIDToTypeID('placedLayerEditContents'));

                var doc = activeDocument;
                for (var i = 0; i < doc.layers.length; i++) {
                    try {
                        doc.activeLayer = doc.layers[i];
                        // Apply Cleaner Function
                        clearLayerStyle();
                        // Change layer style name as required
                        doc.activeLayer.applyStyle('Button'); 
                    } catch (e) {}
                }
                doc.close(SaveOptions.SAVECHANGES);
                ////////// Finish: Apply layer style to all child layers inside parent smart object layer //////////

                // Reset visibility; 
                theLayer.visible = theVisibility;
            };
        } else {
            processSOLayers(theLayer)
        }
    }
    return
};

// Define Cleaner Function
function clearLayerStyle() {
    var iddisableLayerStyle = stringIDToTypeID( "disableLayerStyle" );
    var desc536 = new ActionDescriptor();
    var idnull = charIDToTypeID( "null" );
        var ref134 = new ActionReference();
        var idLyr = charIDToTypeID( "Lyr " );
        var idOrdn = charIDToTypeID( "Ordn" );
        var idTrgt = charIDToTypeID( "Trgt" );
        ref134.putEnumerated( idLyr, idOrdn, idTrgt );
    desc536.putReference( idnull, ref134 );
executeAction( iddisableLayerStyle, desc536, DialogModes.NO );
}

OK, perhaps this visual will help... I selected the layer style called "Button" as it was a factory default, which I hoped would exist on your system which would have made the testing/demo easy. So, you need to use the exact same layer style name in the script code as is found in the style panel.

If I remember your original sample file which I deleted a few days ago, your layer style was called OUTLINE or similar... So change "Button" to "OUTLINE" or whatever the required layer style is called, then test again.

Once you can successfully change one selected layer's linked/embedded smart objects using this script, we can then move forward into the discussion about how to automatically change all of the parent SO layers content...

Good luck!

Do you have a layer style called "Button"?

Have you changed the script code to match your particular style name? If so, double-check the name of the style and the name in the script.

Try this version, it still references a style called "Button"...

app.runMenuItem(stringIDToTypeID('placedLayerEditContents'));

var doc = activeDocument;
for (var i = 0; i < doc.layers.length; i++) {
     try {
          doc.activeLayer = doc.layers[i];

          applyStyle(true);

          function applyStyle(group) {
               var c2t = function (s) {
                    return app.charIDToTypeID(s);
               };
               var s2t = function (s) {
                    return app.stringIDToTypeID(s);
               };
               var descriptor = new ActionDescriptor();
               var reference = new ActionReference();
               var reference2 = new ActionReference();
               reference.putName(s2t("style"), "Button"); // Change style name here
               descriptor.putReference(c2t("null"), reference);
               reference2.putEnumerated(s2t("layer"), s2t("ordinal"), s2t("targetEnum"));
               descriptor.putReference(s2t("to"), reference2);
               descriptor.putBoolean(s2t("group"), group);
               executeAction(s2t("applyStyle"), descriptor, DialogModes.NO);
          }

     } catch (e) {}
}

doc.close(SaveOptions.SAVECHANGES);

The code works for me if I have a smart object layer selected before running the 3rd combined "proof of concept" script... But I'm just a beginner.

https://prepression.blogspot.com/2017/11/downloading-and-installing-adobe-scripts.html

The question remains:

How will you automate the selection of the linked smart object layers in the main file?

They are called "test_rocks" and "test_trees" in the sample file and they are linked smart objects and they are the bottom and next layer up in that test file. I'm guessing that the real production file is not the same.

Are you happy to manually select all of the layers, before the script loops through them all and adjusts everything else automatically?

I have looked at your sample file and this is all possible. The devil is in the details, your production files will not be exactly the same, which will require some changes to any sample code based on the test file.

(1) You will need to automatically target all of the smart object layers in the main PSD file: "test_rocks" and "test_trees" in your sample file. Will this be done by name, position in the layer stack, based on the layer content being a smart object etc? How will this be automated/repeated?

(2) Once you have the required smart object layer selected/targeted, then the following code can open the smart object:

app.runMenuItem(stringIDToTypeID('placedLayerEditContents'));

(3) With the smart object layer file open, you will need to iterate/loop/cycle over all layers and change their colour by applying the desired colour overlay layer effect or some other method, then saving and closing the file.

var doc = activeDocument;  
for(var i=0;i<doc.layers.length;i++){  
     try{
          doc.activeLayer = doc.layers[i];  
          doc.activeLayer.applyStyle('Button'); // Change layer style name as required
     }  
     catch(e){}  
}

So, automating the colour change of the multiple embedded smart object layers in the parent linked smart object layers should not be too great a challenge – the main issue will probably be selecting the correct SO layers in the main file.

Building upon the previous two blocks of code, the following "proof of concept" code example will process a single targeted (SO) layer in the main PSD file and apply the layer style "Button" to all of the linked SO layer's embedded layers:

// Presuming that the appropriate SO layer is selected...

app.runMenuItem(stringIDToTypeID('placedLayerEditContents'));

var doc = activeDocument;  
for(var i=0;i<doc.layers.length;i++){  
     try{
          doc.activeLayer = doc.layers[i];  
          doc.activeLayer.applyStyle('Button'); // Change layer style name as required
     }  
     catch(e){}  
} 

doc.close(SaveOptions.SAVECHANGES);

Again, the key step is automating the selection of the multiple SO layers. It would be best if you could provide better info on your production files layer structure.

All of this is the first stage of the project... Then, the second stage would be changing the initial colour overlay style to other styles/colours.

If I can understand your question then things may be doable using actions. Can you confirm some facts:

You want to change color overlay for specific layer inside Smart Object layer. 

You want to change color inside 10 smart object layers per document.

If I understand what you want then here are some questions since there are some requirements to fully automate process:

Do you have layers on which you want to change color overlay always named with the same name or, at least in the same relative position to top most or bottom most layer? If answer is yes then we can proceed, otherwise if you have random arranged layers to change color you can automate process with pause to select layer then to resume playing action.

Sounds Script-able and a platform-switch would seem unnecessary as the generally preferred Photoshop-Scripting-language JavaScript works on both Windoes and MacOS. 

Could you provide sample-files? 

But it’s possible I won’t have time to properly look into it until next weekend. 

I am not sure how frequently the regulars of the former Photoshop Scripting Forum post on this Forum nowaways, so you might also try looking for help over on 

https://www.ps-scripts.com