Can you Drive with Anxiety? Though it is not illegal to drive with anxiety, drivers should do so with caution. Those dealing with it may have severe physical responses like panic attacks, shaking, or even fainting, which can severely inhibit your driving ability and create a ...