 Thibaut Courouble
|
ad9276e901
Add rate limiter
|
8 years ago |
|
Thibaut Courouble
|
914100a657
Improve error message on failed requests
|
8 years ago |
|
Thibaut Courouble
|
65e8236ab5
Switch to headless Chrome for capybara/selenium scraping
|
8 years ago |
|
Thibaut Courouble
|
6fc48db8af
Improve error logging
|
8 years ago |
|
Thibaut Courouble
|
476c69e419
Improve MDN scrapers
|
8 years ago |
|
Thibaut Courouble
|
4e41ed9f25
Add <base> support
|
9 years ago |
|
Thibaut Courouble
|
0d4c6b51bb
Update TensorFlow documentation (0.11)
|
9 years ago |
|
Thibaut Courouble
|
6fdf81e649
Update Elixir documentation (1.3.3)
|
9 years ago |
|
Thibaut Courouble
|
46a9ed16f6
Refactor scrapers with multiple base URLs
|
9 years ago |
|
Thibaut Courouble
|
b279f84a4c
Update and version Meteor documentation
|
9 years ago |
|
Thibaut Courouble
|
f6530eddcf
Update Angular.js documentation (1.5.6)
|
9 years ago |
|
Thibaut Courouble
|
1a4bea8510
Change User-Agent to 'DevDocs'
|
9 years ago |
|
Thibaut Courouble
|
b8658d9708
Refactor FixRedirectionsBehavior
|
9 years ago |
|
Thibaut
|
3eb5ccb7ea
Raise error and stop scraping on 4xx/5xx status code
|
10 years ago |
 ShaneQful
|
3465933543
Added dojo to devdocs & ability to define headers in scraper requests
|
10 years ago |
|
Thibaut
|
018628ea7d
Add two-pass redirection rewriter
|
10 years ago |
|
Thibaut
|
cd6057e392
Make Docs::UrlScraper#request_all accept an array of URLs
|
12 years ago |
|
Thibaut
|
18986c1814
Going open source
|
12 years ago |
