Skip to main content
A
adam@blueapplestudio
Known Participant
May 8, 2012
Answered

After Effects error: Ray-trace 3D ( 5070 :: 0 )

  • May 8, 2012
  • 19 replies
  • 208421 views

I am trying to create extruded vector shapes in AE CS6 and get the below error after clicking on the enable 3D toggle for the layer.

After Effects error: Ray-trace 3D: Out of paged mapped memory for ray tracer.

( 5070 :: 0 )

Any thoughts on how to solve this?

    This topic has been closed for replies.
    Correct answer Todd_Kopriva

    I agree with you. The Raytrace engine seems to handle gpu ram rather poorly and I don´t understand why it is requiring so much computer power compared to any other ray-trace engine I came across in any 3d software. I have recently finished a project were I used the ray-trace engine a lot - and I had to reboot my machine more than I´ve ever done before (like 5-10 times a day). If I did as much as look at a website, chances were the render would crash and give me the cryptic message of 5070. And upping the sampling from 3 was just too risky, so the final result became more grainy than what I would have hoped for. And changing to CPU render would make the ray trace engine unusably slow. So, with the extremely limited possibilities with the ray trace engine compared to f.example Element 3d and considering how much VRAM it needs the whole engine seems to me as being unfinished and badly optimized. I think I will invest in Element 3D, its performing faster and giving a better result anyway and you have much more options. ..Adobe should give us the option to purge the GPU RAM in AE until they improved the code, so we would be able to multitask without rebooting EVERY time doing anything else than AE on the machine.

    As for specs, I thought I bought a good machine last december when I bought a fully specced iMac late 2012, with a 680MX with 2gb VRAM.... But obviously thats far from ok specs according to what Adobe expect AE users to have for the GPU . That leaves the new unavailable Mac Pro the only option for Mac Users wanting to use the AE ray trace engine efficiently without trouble while still multitasking. That´s a bit disappointing, I hope it will get better over time .


    The After Effects CC (12.2) update and After Effects CS6 (11.0.4) update include fixes and changes regarding the OptiX library for the ray-traced 3D renderer that make VRAM handling better, prevent crashes, and otherwise improve the experience in this area.

    Let us know how it's working for you after you've installed the updates.

    19 replies

    Show previous replies
    S
    someofmywork
    Participant
    May 14, 2012

    Same issue here.

    Getting an error on opening After Effects CS6.

    After Effects error: Ray-traced 3D: Initial Shader compile failed ( 5070 :: 0 )

    When it opens and I try to set the comp to raytrace mode it's not ecen an option, just classic 3D.


    Specs copied from AE GPU info below, running on a Mac Pro (3,1) running Lion 10.7.4. This is supposed to be a support card I'e got, yet it doesn't work and it does work on my Macbook Pro, puzzling.

    I've updated to the latest Nvidia and CUDA drivers since too and still no success

    Fast Draft:Available
    Texture Memory:768.00 MB
    Ray-tracing:GPU

    OpenGL

    Vendor:NVIDIA Corporation
    Device:NVIDIA GeForce GTX 285 OpenGL Engine
    Version:2.1 NVIDIA-7.18.18
    Total Memory:1.00 GB
    Shader Model:-

    CUDA

    Driver Version:4.2
    Devices:1 (GeForce GTX 285)
    Current Usable Memory:567.00 MB (at application launch)
    Maximum Usable Memory:1023.00 MB
    R
    RickJMcClelland
    Participating Frequently
    May 14, 2012

    I'm having the same issue and I think I can help pinpoint what's wrong.

    I'm running at 15" Macbook Pro with 8 GB of RAM and the 6750M Radeon ATI graphics card and 2.2 GHZ Intel i7 Processor.

    I originally downloaded CS6 on Mac OS 10.6.X.   I then purchased Lion 10.7.4, which is what I'm now running.

    I tested the ray-traced renderer before I upgraded and it worked fine. After the upgrade, I started getting this error.

    That's my guess as to what's going wrong. Any fixes??

    T
    Tavis Dunn
    Participating Frequently
    May 14, 2012

    I'm thinking it's probably a 10.7.4 thing as well, i think that's what most of us with problems are using (though there seems to be a couple of windows users as well). Especially considering it just came out last week. Hopefully Adobe/Apple/Nvidia/Whoever can come up with a fix soon as the issue disables a pretty major feature of the upgrade....

    R
    Ric G
    Known Participant
    May 11, 2012

    Mac people,

    NVIDIA posted a Quadro FX4800 driver update for 10.7.4: http://www.nvidia.com/object/macosx-270.00.00f06-driver.html. I seem to run into glitches like this if I do an OS update too quickly for NVIDIA.

    Ric

    M
    MA SHEPHERD
    Participant
    May 10, 2012

    Re: After Effects error: Ray-traced 3D: Initial Shader compile failed. (5070::0) refers to an incompatible graphics card or GPU device. The solution is to remove the incompatible graphics card or replace with compatible graphics card and re-install the software.

    For me I had to remove a nVidia Tesla C1060 card which is incompatible. My main graphics card is a nVidia Quadro fx 5800 which is compatible. After re-installing After Effects the error message was gone.

    Hope that helps.

    A
    adam@blueapplestudioAuthor
    Known Participant
    May 10, 2012

    I disabled the GeForce card and am now only using the Quadro.  For those of you hunting, here is a list of cards that, according to Adobe, AE CS6 supports.

    http://www.adobe.com/products/aftereffects/tech-specs.html

    The following NVIDIA GPUs are supported in After Effects CS6.

    Mac:

    1. GeForce GTX 285
    2. Quadro CX
    3. Quadro FX 4800
    4. Quadro 4000

    Windows:

    1. GeForce GTX 285
    2. GeForce GTX 470
    3. GeForce GTX 570
    4. GeForce GTX 580
    5. Quadro CX
    6. Quadro FX 3700M
    7. Quadro FX 3800
    8. Quadro FX 3800M
    9. Quadro FX 4800
    10. Quadro FX 5800
    11. Quadro 2000
    12. Quadro 2000D
    13. Quadro 2000M
    14. Quadro 3000M
    15. Quadro 4000
    16. Quadro 4000M
    17. Quadro 5000
    18. Quadro 5000M
    19. Quadro 5010M
    20. Quadro 6000
    21. Tesla C2075 (Windows)/Maximus configuration
    
    L
    lehiboo69
    Participating Frequently
    May 10, 2012

    thanx for the list...but not easy to change a card on an I mac... ;-)

    R
    rowlkr
    Participating Frequently
    May 9, 2012

    Plus one.  Mac Pro 3,1 OSX 10.6.8, 32gb RAM.  I add a Ray-Traced 3D pre-comp into a Ray-Traced 3D comp.  The pre-comp shows up and is visible, but when I move the CTI past the pre-comp into section where the comp's own 3D ray-traced layers exist, the machine times out and I get the error:

    After Effects error: Ray-trace 3D: Ray tracer failed to launch.

    ( 5070 :: 0 )

    Fast Draft:Available
    Texture Memory:818.00 MB
    Ray-tracing:GPU

    OpenGL

    Vendor:NVIDIA Corporation
    Device:NVIDIA Quadro 4000 OpenGL Engine
    Version:2.1 NVIDIA-1.6.37
    Total Memory:2.00 GB
    Shader Model:-

    CUDA

    Driver Version:4.0
    Devices:1 (Quadro 4000)
    Current Usable Memory:559.00 MB (at application launch)
    Maximum Usable Memory:2.00 GB
    R
    rowlkr
    Participating Frequently
    May 9, 2012

    Now I have removed the pre-comp from the Ray-Traced 3D comp and still getting the error.

    A
    Anonymous
    May 9, 2012

    Add me to the list with this problem. Here's my GPU info:

    Fast Draft:Available
    Texture Memory:409.00 MB
    Ray-tracing:CPU

    (GPU not available - incompatible device or CUDA driver)

    OpenGL

    Vendor:ATI Technologies Inc.
    Device:ATI Radeon HD 5770 OpenGL Engine
    Version:2.1 ATI-7.18.11
    Total Memory:1.00 GB
    Shader Model:-

    CUDA

    Driver Version:-
    Devices:-
    Current Usable Memory:-
    Maximum Usable Memory:-
    A
    adam@blueapplestudioAuthor
    Known Participant
    May 9, 2012

    On the Windows side of things, I can report that some of my co-workers have hit this problem and some have not.  Those that have not had the problem are using a Quadro FX 4800 card.  Those of us that are having the error are using both the aforementioned Quadro, in addition to a GeForece 8400 GS to drive three displays.

    I have not updated drivers yet, but will post with my results if I do.

    A
    Adamdanielpalmer
    Participating Frequently
    May 9, 2012

    Same Error: using Mac OS Lion 10.7.3 and ATI Radeon HD 5510 1024 Mb, 24 GB ram with 17 GB available for after effects.

    Cannot use Raytraced 3D renderer at all, very dissapointing.  Adobe, any plans to fix so AE CS6 has 3D raytracer support for Mac and ATI?

    A
    Adamdanielpalmer
    Participating Frequently
    May 9, 2012
    Fast Draft:Available
    Texture Memory:768.00 MB
    Ray-tracing:CPU

    (GPU not available - incompatible device or CUDA driver)

    OpenGL

    Vendor:ATI Technologies Inc.
    Device:ATI Radeon HD 5770 OpenGL Engine
    Version:2.1 ATI-7.18.11
    Total Memory:1.00 GB
    Shader Model:-

    CUDA

    Driver Version:-
    Devices:-
    Current Usable Memory:-
    Maximum Usable Memory:-
    happy_Dreamer16B8
    happy_Dreamer16B8
    Participating Frequently
    May 9, 2012

    I am also experiencing the same error. As a quick work around while creating your masterpiece, I changed by view to Fast Draft (the box with the lightning inside). However, when trying to render whether in foreground or background ends up in the same 5070 :: 0 Failure

    Here are my card specs as well for the devs:

    Fast Draft:Available
    Texture Memory:512.00 MB
    Ray-tracing:CPU

    (GPU not available - incompatible device or CUDA driver)

    OpenGL

    Vendor:ATI Technologies Inc.
    Device:ATI Radeon HD 5870 OpenGL Engine
    Version:2.1 ATI-7.18.11
    Total Memory:1.00 GB
    Shader Model:-

    CUDA

    Driver Version:-
    Devices:-
    Current Usable Memory:-
    Maximum Usable Memory:-
    A
    adam@blueapplestudioAuthor
    Known Participant
    May 9, 2012

    Apologies- forgot my specs weren't in my signature.

    I am away from my work computer but I am running Win 7 64bit, over 8 GB RAM, a NVidia card that costs over $2k, though I don't recall the precise model right now.  I can relay more in the morning.

    In preferences I set everything to cache on my D drive, which is dedicated only to temp files and has over 100 GB space.  I restarted AE after this change and still saw the error.

    Thanks for the fast response Todd, I appreciate any help you can offer.

    C
    ChrisProsser
    Participating Frequently
    May 9, 2012

    Hi Adam,

    Did you have the latest drivers installed from NVidia?

    --chris

    Jeff Almasol
    Adobe Employee
    Jeff Almasol
    Adobe Employee
    May 9, 2012

    Also, if you open Previews preferences (Preferences > Previews) and click the GPU Information button, what appears in the dialog box? You can click the Copy button at the bottom of the dialog box, then paste that here.

    Todd_Kopriva
    Todd_Kopriva
    Inspiring
    May 8, 2012

    Tell us about you computer system, including GPU and OS.

    A
    Anonymous
    May 18, 2012

    Hi,

    I'm having similar problems getting the Ray-tracer engine to work in AE CS6. Each time I try to enable it and turn a layer into a 3D layer, I get the following errors:

    and

    I am running on the following specs:

    Win7 x64

    AE CS6

    i7-990X (stock speed)

    24GB RAM

    GTX580 (1536MB, Driver: 296.10)

    Fast Draft:     Available

    Texture Memory:     601.00 MB

    Ray-tracing:     GPU

    OpenGL

    Vendor:     NVIDIA Corporation

    Device:     GeForce GTX 580/PCIe/SSE2

    Version:     3.0.0

    Total Memory:     1.45 GB

    Shader Model:     4.0 or later

    CUDA

    Driver Version:     4.2

    Devices:     1 (GeForce GTX 580)

    Current Usable Memory:     1.33 GB (at application launch)

    Maximum Usable Memory:     1.50 GB

    A
    Anonymous
    May 22, 2012

    Right, here we go!

    I got mine to work with a GTX580 on win7 x64 by changing the Timeout Detection and Recovery of GPUs in the Windows registry. By changing it from 2 seconds recovery to 10, the Nvidia driver will get enough time to respond before crashing!

    I do realize that this is probably not the "correct" way of taking care of the problem but seems to be working fine for now. If anyone else would like to try, please make a backup of you registry before changing any values!

    What did I do? I set the value for object MaxObjectNumber to 10 in the following folder:  HKLM\HARDWARE\DEVICEMAP\VIDEO

    After that, launch AE and everything works fine (for me)


    Magnus Allgurén wrote:

    Right, here we go!

    I got mine to work with a GTX580 on win7 x64 by changing the Timeout Detection and Recovery of GPUs in the Windows registry. By changing it from 2 seconds recovery to 10, the Nvidia driver will get enough time to respond before crashing!

    I do realize that this is probably not the "correct" way of taking care of the problem but seems to be working fine for now. If anyone else would like to try, please make a backup of you registry before changing any values!

    What did I do? I set the value for object MaxObjectNumber to 10 in the following folder:  HKLM\HARDWARE\DEVICEMAP\VIDEO

    After that, launch AE and everything works fine (for me)

    It worked fine for a few days, until I had to do some work on another project, which is strictly 2D. Once I switched back to my Ray-trace project it does not work any more, giving me the same problem as before (5070 :: 0) and my previous method of getting it to work is not working anymore...

    Terms & ConditionsAccessibility statement
    Using the community Terms of use Privacy Cookie preferences Do not sell or share my personal information ad choicesAdChoices