Some atheists do have their God-substitutes. Some believe in fate, karma, influence of planets (astrology) and such. In other social contexts: some replace God with Dear Leader (what are Lenin and Stalin but local deities?).

This doesn’t apply to all atheists.