Mc's Gems

icon
#Total RankDaily RankNameSummary
124,39033,215generalscraperScrapes Google
226,33720,012linkedindataScrapes all LinkedIn profiles including terms you specify.
328,00020,689jsontochartTake JSON files and outputs html for various types of charts
430,51066,054entityextractorExtracts entities and terms from any JSON.
531,19121,492linkedincrawlerCrawls public LinkedIn profiles via Google
633,89337,719dircrawlRun block on all files in dir
740,93466,054wordcloudTakes input and outputs the same text with word size changed based on frequency.
841,85581,172uploadconvertConverts documents to the appropriate format for Transparency Toolkit.
943,16324,680linkedinparserParses public LinkedIn profiles
1044,48081,172parsefileOCR file and extract metadata using Apache Tika and Tesseract
1148,89181,172urlarchiverSaves html and pdfs of websites.
1250,03081,172twittercrawlerCrawls Twitter
1352,778107,324extractpatternsExtracts entities and terms from any JSON.
1454,86366,054timelinegenTimelineGen generates JSON files for use as TimelineJS data.
1556,88866,054sunlightcongressAccess to Sunlight Foundation's congress data.
1657,839152,870indeedparserParses Indeed resumes
1760,85535,231jsontonetworkgraphGenerates node and link data from any JSON.
1863,257107,324piplrequestGets data from Pipl
1965,75866,054tsjobcrawlerCrawls job listing websites for jobs requiring security clearance.
2071,54966,054requestmanagerManages proxies, wait intervals, etc
2175,69081,172countryconvertConverts 2-char ISO country codes to 3-char.
2276,127107,324effscraperScrapes EFF court documents then extracts the plaintext and metadata.
2376,36481,172termextractorExtracts entities and terms from any JSON.
2479,94956,338jsontomapConverts a JSON into a GeoJSON.
2580,560107,324indeedcrawlerCrawls Indeed resumes
2681,472152,870sunlightpartytimeAccess to Sunlight Foundation's Party Time data.
2788,65666,054acluscraperScrapes ACLU court documents then extracts the plaintext and metadata.
2891,463107,324piplcollectorGets data from Pipl for dir of files
2991,58056,338jsoncrossreferenceCrossreferences JSONs and returns the matches
3096,506152,870wlsearchscraperGets a list of documents from the WikiLeaks search that match certain terms.
31107,454107,324datacalcSome data calculation/manipulation for Transparency Toolkit.
32112,13881,172jsoncombinerInput multiple JSONs, get back one with all the data
33113,962107,324doc_integrity_checkEncrypts, verifies, and checks hashes of files
34115,03281,172jsontochoroplethConverts as JSON to a world choropleth map.
35117,797152,870ttcalcCalculation functions for Transparency Toolkit.
36118,254107,324sigadparseExtracts SIGADs from documents
37132,519152,870harvesterreporterIncremental result reporting for Transparency Toolkit
38150,189107,324guardianscraperScrapes Guardian articles.
39151,937152,870indeedscraperGet resumes and job listings from indeed based on search terms and locations.
40152,007152,870nametoemailGets a list of possible email addresses.
41174,226152,870docintegritycheckEncrypts, verifies, and checks hashes of files