Download robots.js Free Java Code

Description

Parser for robots.txt for node.js.

Source Files

The download file robots.js-master.zip has the following entries.

.gitignore//from  ww w.ja  va 2 s  . co m
LICENSE
Makefile
README.md
index.js
lib/entry.js
lib/parser.js
lib/rule.js
lib/utils.js
package.json
tests/parser.read.test.js
tests/parser.test.js

Download

Click the following link to download robots.js-master.zip.