The point is infinite regression. If it’s the big bang, what put the singularity there for that to happen… What was there before that… and before that… It seems silly to argue over whether there’s a creator or not, when it’s impossible to prove one way or the other, and much easier to err on the safe side.