The best golfers swing the club play at a speed that they can control. The control they are after is the consistency of their swing and as an extension the direction of their shots and the control of how far their ball will fly. Here are a couple of points you should consider.
If you swing the club as fast as you can and you make perfect contact then the ball will go 100% of the potential distance available to you. It can’t go further as you are using 100% of your energy. The interesting thing about golf is that if you swing at 50% of your maximum speed the ball doesn’t go 50% of your maximum distance it goes something like 75% of your maximum distance.
Now consider how accurate you are when you swing at 100%. If you are honest with yourself you will find that it is 20% at best. Remember that accuracy is not just direction it is also how far the ball will fly. At 100% you are very likely to mishit your shots and therefore come up significantly short and crooked.
If you were to swing at 50% of your maximum then I would contend that you will be more likely to hit the ball clean and hit the ball straighter and your accuracy is likely to rise to something like 75%.
The point here is that if you were to swing at a speed that is something like 75% of your maximum instead of 100%, then you would certainly improve your accuracy. Also you would be trading very little distance swinging at this controllable speed.
Do some experimenting and find the operating level that gives you the accuracy you are after and enough distance to get the scores you are wanting. The answer will be something near to 75%.