You are applying correct method but somehow I am noticing we do not use "smile" much on keywords attached to images, I do suggest that you be more descriptive on non-smiling keywords i.e. frown, sad, angry - this will give more desirable result. I will by the way convey this issue to product management.
Regards,
... View more