[wheettebott]

Is it still considered a hazard even if there is no water?

Yup, designated by a red line/stakes around it, in this case a lateral water hazard.

The same is true inside the red boundry even when it's just grass you're playing on.

Same holds true for sand bunkers.