Can simply drinking water help alleviate a headache without taking medication?

Can simply drinking water help alleviate a headache without taking medication?