Commit History

Author SHA1 Message Date
  Thibaut Courouble b8658d9708 Refactor FixRedirectionsBehavior 9 years ago
  Thibaut 3eb5ccb7ea Raise error and stop scraping on 4xx/5xx status code 10 years ago
  ShaneQful 3465933543 Added dojo to devdocs & ability to define headers in scraper requests 10 years ago
  Thibaut 018628ea7d Add two-pass redirection rewriter 10 years ago
  Thibaut cd6057e392 Make Docs::UrlScraper#request_all accept an array of URLs 12 years ago
  Thibaut 18986c1814 Going open source 12 years ago