Include a functionality to read and parse existing robots.txt files with manipulation support.
Include a functionality to read and parse existing robots.txt files with manipulation support.