Sounds like low blood sugar to me. (hypoglycemia)
* hunger
* nervousness and shakiness
* perspiration
* dizziness or light-headedness
* sleepiness
* confusion
* difficulty speaking
* feeling anxious or weak
Do you get any of those symptoms too? You might even pass out if you start to feel shaky and don't eat, so be careful.