Before you can add speed, you must first understand rhythm. Learn how to create a tempo that will help you practice.
Grab a pair of drumsticks and practice tempo. Once you understand this, bring it to your golf swing.
Using a tempo you are comfortable with across all of your swings is very important. This is how to use tempo to your advantage.