Being less religious correlates very strongly with having fewer children. Weekly churchgoers in America barely have children at the replacement rate of 2.1 children per women: https://ifstudies.org/blog/americas-growing-religious-secular-fertility-divide

Numbers don't lie, and you can't ignore the reality of cold hard math.