Skip to main content
S
sanic_the_hedgefond
Participant
February 4, 2020
Question

(SDK) pix2pix CycleGAN style transfer

  • February 4, 2020
  • 2 replies
  • 678 views

Hey there,

I am new to the ae sdk and want to implement some kind of style transfer like this:

https://github.com/junyanz/pytorch-CycleGAN-and-pix2pix

 

Is it possible to send input from the afx plugin to a pythonscript and get back the output to show in the afx composition?

 

Otherwise I guess that I have to implement the algorithm in c++ with cuda. Are there some good readings to get started beside the documentary?

 

Thanks in advance,

Marius

This topic has been closed for replies.

2 replies

S
Community Expert
shachar carmiCommunity Expert
Community Expert
February 6, 2020

a plug-in, being a dll, can do pretty much whatever it wants. if you know how to envoke that process from any other c program, then you can do the same from the plug-in.

the AE SDK is merely means for the plug-in to recieve data from AE, send data back, and a bunch of utilties all accessed via C calls. beyond that, do whatever you like using whatever techniligy suites you.

    Mylenium
    Mylenium
    Legend
    February 5, 2020

    You would have to set up your own Python virtual machine/ interpreter inside your plug-in or connect to an external install with sockets or whatever. AE doesn't have provision for any of that and unfortunately that single awesome Python plug-in called Useful Things has been dead for more than ten years now or else you could have used that.

     

    Mylenium

      Terms & ConditionsAccessibility statement
      Using the community Terms of use Privacy Cookie preferences Do not sell or share my personal information ad choicesAdChoices