Should you only eat when your hungry? Like if your stomache is growling?

Such as if your not hungy in the morning, should you still eat breakfast? I'm trying to loose weight...:(