If I do not intend to set any kind of unique actions, is it ALRIGHT if I never mind to have a robots.txt documents?
The absence of a robots.txt documents leaves it approximately the spider to determine what it can and also can refrain. Given that it takes just secs to stay clear of any kind of sort of obscurity, why not simply make one that permits all representatives to accessibility every little thing?
Lack of a robots.txt documents will certainly not be unsafe. From the robotstxt.org website :
To permit all robotics full accessibility
User-agent : *
(or simply create a vacant "/ robots.txt" documents, or do not make use of one in all )
However, also if you are not defining anything in your robots.txt documents, it is an excellent way of informing search engines of the location of your XML Sitemap. You can do this by including a line on top of your robots.txt documents that looks something like :
Sitemap : http://www.example.com/sitemap-host1.xml
You need to additionally realize that not having it will certainly create a great deal of 404 access in your internet logs.