Commit graph

36 commits

Author SHA1 Message Date
Thu Trang Pham
642c1cff7d Make sure that home_url can be nil 2015-03-03 11:34:29 -05:00
Thibaut
a59ef1cdb6 Add db_size attribute in doc manifest 2015-01-02 15:29:13 -05:00
Thibaut
456c4cb811 Add Store#size 2015-01-02 15:22:14 -05:00
Thibaut
bc5488faa2 Make docs mtime the greatest of the index and db files' mtime 2014-12-31 14:12:39 -05:00
Thibaut
ca7ff6086e Exclude docs without a db file from the manifest 2014-12-31 14:11:30 -05:00
Thibaut
ca61a2b746 Add Doc#db_path 2014-12-31 14:00:20 -05:00
Thibaut
5c46eabc67 Output a JSON file containing all the pages' content 2014-12-31 13:54:29 -05:00
Thibaut
e9125c6ec2 Refactor Doc.store_pages 2014-12-31 12:44:33 -05:00
Thibaut
ecf774e22c Add EntryIndex#blank? 2014-12-31 12:10:59 -05:00
Thibaut
1655a00fb6 Refactor Doc.store_page 2014-12-31 12:06:28 -05:00
Thibaut
a9c8c228bc Fix default argument assignment for Ruby 2.2 2014-12-28 13:50:09 -05:00
Thibaut
c68133eb8c Revert "Replace colons with dashes in internal URL paths"
This reverts commit d51a6f9042.
2014-09-07 12:31:14 -04:00
Thibaut
c122caa7c4 Add :skip_link option for ignoring certain links in scrapers 2014-09-07 12:31:14 -04:00
Thibaut
ab1de67032 Update Nokogiri 2014-05-17 11:20:25 -04:00
Thibaut
bcd4a5b522 Use String#remove 2014-04-19 12:11:24 -04:00
Thibaut
d51a6f9042 Replace colons with dashes in internal URL paths 2014-01-26 15:35:55 -05:00
Thibaut
c0be178556 Auto-require gems in the "docs" bundle 2014-01-26 15:34:49 -05:00
Thibaut
864188e24c Use String#sub instead of String#gsub when possible 2013-12-13 11:21:38 +00:00
Thibaut
b92db88506 Refactor Docs::Scraper 2013-12-12 11:17:55 +00:00
Thibaut
ca06cc7ad9 Implement Docs::Filter#initial_page? 2013-12-11 18:52:15 +00:00
Thibaut
f8298181e9 Implement initial_paths scraper option 2013-12-11 18:46:32 +00:00
Thibaut
5e69d6df5e Make Docs::FileScraper#request_all accept an array of URLs 2013-12-11 11:48:34 +00:00
Thibaut
cd6057e392 Make Docs::UrlScraper#request_all accept an array of URLs 2013-12-11 11:48:11 +00:00
Thibaut
c6be9b6ae4 Make Docs:Requester#request accept an array of URLs 2013-12-11 10:49:43 +00:00
Thibaut
562a4c74fe Fix failing Docs::Requester test 2013-12-11 09:59:16 +00:00
Thibaut
95ec3a5dc3 Refactor :trailing_slash option tests 2013-12-02 18:48:45 +00:00
Thibaut
4a2a393ed4 Refactor :follow_links option 2013-12-02 18:28:48 +00:00
Thibaut
bf6c900ca7 Make :skip_links option work with true/false 2013-12-02 18:24:06 +00:00
Thibaut
47eb7eec7f Make :skip_links option apply to pages instead of individual links 2013-12-02 18:18:21 +00:00
Thibaut
6c8eea1adb Add :follow_links option to not follow links on select pages 2013-12-01 17:59:07 +00:00
Thibaut
706270d89c Don't store pages with no entries 2013-11-18 22:39:36 +01:00
Thibaut
9089d03211 Set the default FileScraper::base_url to localhost 2013-11-16 16:32:43 +01:00
Thibaut
d964fd4ca9 Make Docs::URL#relative_path_to work with unqualified URLs 2013-11-16 12:02:31 +01:00
Thibaut
4df387d475 Make Docs::URL#subpath_to work with unqualified URLs 2013-11-16 11:42:44 +01:00
Thibaut
1204390f81 Make Docs::Scraper.root_path inheritable 2013-11-12 14:23:06 +01:00
Thibaut
18986c1814 Going open source 2013-10-24 20:49:33 +02:00