You play golf with your hands, just like many other sports.
The mental side of golf is very important. Once your head is in the game, your swing will improve.
Most people don't know what the change of directions feels like. Practice other sports to get a better feel.
What the club face does at impact is crucial. Feel what needs to happen with your hands to make center face hits.