All changes made are immediate. Only make changes to setup on a test site. If you make changes on a live site, you can break your site.