Yes, you can do that by login to your Seller Dashboard, then "Settings", go to "Store" tab, check on "Enable Vacation Mode"