Mc's Gems

icon
#Total RankDaily RankNameSummary
123,04249,224generalscraperScrapes Google
224,91732,129linkedindataScrapes all LinkedIn profiles including terms you specify.
326,81727,130jsontochartTake JSON files and outputs html for various types of charts
428,92036,338entityextractorExtracts entities and terms from any JSON.
529,62459,263linkedincrawlerCrawls public LinkedIn profiles via Google
632,45733,380dircrawlRun block on all files in dir
739,34044,085wordcloudTakes input and outputs the same text with word size changed based on frequency.
840,29329,792uploadconvertConverts documents to the appropriate format for Transparency Toolkit.
941,81329,792linkedinparserParses public LinkedIn profiles
1042,83739,837parsefileOCR file and extract metadata using Apache Tika and Tesseract
1146,89073,587urlarchiverSaves html and pdfs of websites.
1248,94528,864twittercrawlerCrawls Twitter
1351,05946,526extractpatternsExtracts entities and terms from any JSON.
1452,68627,938timelinegenTimelineGen generates JSON files for use as TimelineJS data.
1554,77141,906sunlightcongressAccess to Sunlight Foundation's congress data.
1656,12044,085indeedparserParses Indeed resumes
1759,55952,232jsontonetworkgraphGenerates node and link data from any JSON.
1861,75439,837piplrequestGets data from Pipl
1965,09044,085tsjobcrawlerCrawls job listing websites for jobs requiring security clearance.
2068,89852,232requestmanagerManages proxies, wait intervals, etc
2173,33752,232effscraperScrapes EFF court documents then extracts the plaintext and metadata.
2273,85846,526termextractorExtracts entities and terms from any JSON.
2373,90349,224countryconvertConverts 2-char ISO country codes to 3-char.
2478,45459,263indeedcrawlerCrawls Indeed resumes
2578,51163,493jsontomapConverts a JSON into a GeoJSON.
2678,62486,482sunlightpartytimeAccess to Sunlight Foundation's Party Time data.
2785,85046,526acluscraperScrapes ACLU court documents then extracts the plaintext and metadata.
2889,01163,493jsoncrossreferenceCrossreferences JSONs and returns the matches
2989,13073,587piplcollectorGets data from Pipl for dir of files
3091,698161,562wlsearchscraperGets a list of documents from the WikiLeaks search that match certain terms.
31103,63568,264datacalcSome data calculation/manipulation for Transparency Toolkit.
32109,00979,620jsoncombinerInput multiple JSONs, get back one with all the data
33112,54168,264doc_integrity_checkEncrypts, verifies, and checks hashes of files
34112,66286,482jsontochoroplethConverts as JSON to a world choropleth map.
35114,52279,620ttcalcCalculation functions for Transparency Toolkit.
36115,291104,717sigadparseExtracts SIGADs from documents
37130,201117,132harvesterreporterIncremental result reporting for Transparency Toolkit
38144,991117,132guardianscraperScrapes Guardian articles.
39147,091131,144indeedscraperGet resumes and job listings from indeed based on search terms and locations.
40148,810117,132nametoemailGets a list of possible email addresses.
41169,778117,132docintegritycheckEncrypts, verifies, and checks hashes of files