Wild Spider
Overview
Wild Spider is a Chrome extension developed by Xuan Wu.
According to the data from Chrome web store, current version of Wild Spider is 0.0.3, updated on 2019-03-08.
40 users have installed this extension.
1 users have rated this extension with an average rating of .
web pages are crawled by being loaded into browser using multiple tabs parallelly
WATCH OUT: more tabs you use, more computer resources (CPU, memory) will be used, and each page costs a bit disk to save the content (in IndexedDb, accessible from extensions -> Inspect views: background page).
The "spider" works in this way:
1) The current url is used as the starting point, and it's loaded again in a new tab.
2) After this page is loaded, fetch all the links on the page.
3) Get all the links on the page, including relative urls.
4) Open the extracted link parallelly in all the tabs used (by default 3, set in eventPage).
5) repeat 2-4
All source code at: https://github.com/nobodxbodon/ChromeCrawlerWildSpider
Wild Spider Alternatives
Name | Category | Rating | Rating Count | Installs |
---|---|---|---|---|
Page Crawler | Developer Tools | (5) | 1,000+ | |
Semantic Spider | Accessibility | (3) | 395 | |
Link Collector | Productivity | (1) | 375 | |
JIRA Crawler | Productivity | (1) | 23 | |
DirectFN web scraping tools | Developer Tools | (3) | 210 | |
Fun Crawler | Developer Tools | (3) | 68 | |
Creeper | Productivity | (4) | 274 | |
Link Crawler | Search Tools | (0) | 676 | |
Recursive | Search Tools | (12) | 614 | |
LinkAnalysis | Developer Tools | (18) | 298 | |
beABot | Fun | (2) | 191 | |
Crawler | Developer Tools | (12) | 1,000+ | |
Search Spider | Developer Tools | (2) | 108 | |
Gallery Builder | Productivity | (4) | 286 | |
Scraper Crawler V3 | Developer Tools | (28) | 2,000+ | |
Cloump U-Scraper Plugin | Productivity | (0) | 106 | |
Spider Free - The simplest web scraper | Productivity | (24) | 8,000+ | |
Input hidden Monitor | Developer Tools | (1) | 371 | |
get-set, Fetch! web scraper | Productivity | (1) | 431 | |
Webmapper | Productivity | (11) | 0 | |
Grabbly | Productivity | (12) | 907 | |
SearchMage | Search Tools | (2) | 619 | |
Grab 'n Tag | Search Tools | (4) | 253 | |
Link Extractor | Search Tools | (3) | 875 |
Latest Reviews
See More
Matt C
2018-03-19
doesnt work |
Matt C
2018-03-19
doesnt work |
Matt C
2018-03-19
doesnt work |
Matt C
2018-03-19
doesnt work |
Matt C
2018-03-19
doesnt work |