everywhere in the universe at once, because the entire universe (including space itself) was a point
First the fabric of space came into existence; then the Big Bang appeared at some arbitrary point within it.
All of these statements are equally correct.
at a single point in the center of the then-existing universe
at all points simultaneously on the surface of an expanding balloon