Fetching a URL with file_get_contents()
<?php $page = file_get_contents('http://www.example.com/robots.txt'); ?>