Fidelity settings on Pen tool either too much or too smoothing

I am having a major issue with the pen tool. I find that putting anything above the lowest fidelity setting is smoothing the path too much. Yet if you put it on the lowest then it is much too rough with hundreds of anchor points.
I want to be able to create lines with details in it, but allow for some slight smoothing, but although there are a number of settings on the scale, it seems to go from rough to very smooth and no inbetween.
Is there another setting that may be skewing this effect that I am missing, because it is making sketching extremely difficult and somewhat impossible to achieve the level of detail I need.

Thanks.