No recent searches
Nokogiri
HTML
Document
WebRobots
Error
ParseError
RobotsTxt
AccessControlLine
AgentLine
AllowLine
CrawlDelayLine
DisallowLine
ExtentionLine
Line
Parser
Record
Webrobots
# File lib/webrobots/robotstxt.rb, line 728 def allow? false end