Keyframes bot working with Time Remapping

So maybe my workflow is wrong, but I film at a higher frame rate and then I modify the clip down to 24 fps for slow motion. Then I change the speed of the clips accordingly (250% or 500%) to playback at normal speed in order to find the clips I want to use in a timely manner. Then I add those sections one by one to my timeline and convert back to 100% on my timeline so it's in slow motion. The problem I have is when I go to do my speed ramps the cmd + button doesnt work. It shows an arrow instead.

So I'm wondering if there's something wrong with the way I'm doing things or if anyone else has experienced this problem because it happens to me all the time!