Increasing the CD will have effect for Tai/WM, WM/Fan, Bubble/WM, but not for GF/WM, GF/MED which are even stronger.
Increasing the cooldown sounds like a cheap way to nerf this imo,
U also have to note playing with a weapon swap requires more skill than playing something without a weapon swap.