i usually just take a nap and then when i wake up usually the headache is gone, but if u don't want to sleep usually nurofen and ibuprofen tablets should do the trick.
Didn't read the posts above, but a fairly quick fix is to drink 1-2 cups of coffee and hyperventilate (NOT) into a bag. Breath deeply 20-30 times per min for 1-2 min. The common tension/migraine headache is due to vasodilation of your cerebral vasculature. Caffeine and hyperoxia helps constrict those blood vessels to abort the headache. However, if you have any other symptoms, if your headache is something you've never had before, or if it's the WORST headache of your life, then go see a doctor immediately. Cheers!
All the messages and suggestions herein are all well intentioned, but absolutely meaningless insofar as none of us have examined you. Why you're having persistent intermittent headaches can be something as simple as stress or something as serious as a brain tumor or slow internal bleed. While periodic headaches are not unusual, headaches that won't go away, especially with other general neurological symptoms such as dizziness and nausea should always be investigated. I suggest that you see your doctor as soon as possible and get a CT (Cat Scan) done. If you do need to take OTC analgesics until you do, you're correct in avoiding Aspirin and Advil (or other Ibuprofen based products) as both can affect your ability to clot; stick with Acetaminophen (aka Paracetamol in the UK) at the recommended dosages, and see your doctor at your earliest opportunity. I wish you well, and good luck.