To protect your duplicate pages or with unpublished listings on the website, will not send these pages to Google, in order to prevent these contents from being found by users.

It is important to mention that even if it is unavailable for reading on Google, you will be able to access these pages normally for validation, from the following address in your browser: 

For more information about robots.txt and Google, see the link below: