If it is honestly open feild no ones house definatly go for it, if it is a yard you could ask, but I am terrible we never ask about dandilions or anything, I know all my neighbors try to kill them anyway, so I can get some fun first. (well my kids do) less there is any reason to believe it was 'planted on purpose' a couple flowers wont hurt.
The only thing if it is dangerous at all, like around construction (where I live) you may find the feild cleared in response, I did
.