My opinion, it is not going to make much difference because it is so close to perfect. I have a jack plate on several boats whereby the engine height is infinitely adjustable from stock up to 6" higher and it makes no appreciable difference in speed, or economy where it is set. If you were to change props and motor height it may be helpful but 50 is hauling the mail..You have it close to perfect anyhow.
