More to the point how do you judge it especially a hundred feet up.
Don't forget Obstacle Avoidance turned on reduces top speed.
Flicking into sport mode quickly over-rides that and is much faster so it can cope with higher winds.

Up to about 20mph should be OK but precision is affected
Much above that and gusts will take it away.
If it's windy try so far as possible to go mainly upwind or you may not get it back.
Have a plan B for possible emergency landing point if it suddenly picks up and you can't get back.