Mc's Gems

icon
#Total RankDaily RankNameSummary
124,69941,970generalscraperScrapes Google
226,68297,318linkedindataScrapes all LinkedIn profiles including terms you specify.
328,43055,892jsontochartTake JSON files and outputs html for various types of charts
430,95097,318entityextractorExtracts entities and terms from any JSON.
531,59697,318linkedincrawlerCrawls public LinkedIn profiles via Google
634,28055,892dircrawlRun block on all files in dir
741,44541,970wordcloudTakes input and outputs the same text with word size changed based on frequency.
842,43155,892uploadconvertConverts documents to the appropriate format for Transparency Toolkit.
943,71397,318linkedinparserParses public LinkedIn profiles
1045,03855,892parsefileOCR file and extract metadata using Apache Tika and Tesseract
1149,47255,892urlarchiverSaves html and pdfs of websites.
1250,58055,892twittercrawlerCrawls Twitter
1353,39855,892extractpatternsExtracts entities and terms from any JSON.
1455,51355,892timelinegenTimelineGen generates JSON files for use as TimelineJS data.
1557,52841,970sunlightcongressAccess to Sunlight Foundation's congress data.
1658,50623,104indeedparserParses Indeed resumes
1761,65641,970jsontonetworkgraphGenerates node and link data from any JSON.
1863,97555,892piplrequestGets data from Pipl
1966,50455,892tsjobcrawlerCrawls job listing websites for jobs requiring security clearance.
2072,38097,318requestmanagerManages proxies, wait intervals, etc
2176,56197,318countryconvertConverts 2-char ISO country codes to 3-char.
2277,01497,318effscraperScrapes EFF court documents then extracts the plaintext and metadata.
2377,26097,318termextractorExtracts entities and terms from any JSON.
2480,87097,318jsontomapConverts a JSON into a GeoJSON.
2581,43229,191indeedcrawlerCrawls Indeed resumes
2682,43497,318sunlightpartytimeAccess to Sunlight Foundation's Party Time data.
2789,61341,970acluscraperScrapes ACLU court documents then extracts the plaintext and metadata.
2892,45497,318piplcollectorGets data from Pipl for dir of files
2992,59697,318jsoncrossreferenceCrossreferences JSONs and returns the matches
3097,61997,318wlsearchscraperGets a list of documents from the WikiLeaks search that match certain terms.
31108,51755,892datacalcSome data calculation/manipulation for Transparency Toolkit.
32113,35997,318jsoncombinerInput multiple JSONs, get back one with all the data
33114,88697,318doc_integrity_checkEncrypts, verifies, and checks hashes of files
34116,34297,318jsontochoroplethConverts as JSON to a world choropleth map.
35119,14397,318ttcalcCalculation functions for Transparency Toolkit.
36119,51397,318sigadparseExtracts SIGADs from documents
37133,73655,892harvesterreporterIncremental result reporting for Transparency Toolkit
38151,77397,318guardianscraperScrapes Guardian articles.
39153,51797,318nametoemailGets a list of possible email addresses.
40153,51755,892indeedscraperGet resumes and job listings from indeed based on search terms and locations.
41175,92997,318docintegritycheckEncrypts, verifies, and checks hashes of files