Mc's Gems

icon
#Total RankDaily RankNameSummary
124,60181,756generalscraperScrapes Google
226,58535,247linkedindataScrapes all LinkedIn profiles including terms you specify.
328,28881,756jsontochartTake JSON files and outputs html for various types of charts
430,81635,247entityextractorExtracts entities and terms from any JSON.
531,48544,980linkedincrawlerCrawls public LinkedIn profiles via Google
634,16439,155dircrawlRun block on all files in dir
741,29581,756wordcloudTakes input and outputs the same text with word size changed based on frequency.
842,26281,756uploadconvertConverts documents to the appropriate format for Transparency Toolkit.
943,55281,756linkedinparserParses public LinkedIn profiles
1044,87081,756parsefileOCR file and extract metadata using Apache Tika and Tesseract
1149,28881,756urlarchiverSaves html and pdfs of websites.
1250,41056,018twittercrawlerCrawls Twitter
1353,23181,756extractpatternsExtracts entities and terms from any JSON.
1455,33256,018timelinegenTimelineGen generates JSON files for use as TimelineJS data.
1557,39081,756sunlightcongressAccess to Sunlight Foundation's congress data.
1658,33981,756indeedparserParses Indeed resumes
1761,45781,756jsontonetworkgraphGenerates node and link data from any JSON.
1863,79656,018piplrequestGets data from Pipl
1966,32581,756tsjobcrawlerCrawls job listing websites for jobs requiring security clearance.
2072,14181,756requestmanagerManages proxies, wait intervals, etc
2176,33881,756countryconvertConverts 2-char ISO country codes to 3-char.
2276,80481,756effscraperScrapes EFF court documents then extracts the plaintext and metadata.
2377,05144,980termextractorExtracts entities and terms from any JSON.
2480,63956,018jsontomapConverts a JSON into a GeoJSON.
2581,22581,756indeedcrawlerCrawls Indeed resumes
2682,20381,756sunlightpartytimeAccess to Sunlight Foundation's Party Time data.
2789,35244,980acluscraperScrapes ACLU court documents then extracts the plaintext and metadata.
2892,22481,756piplcollectorGets data from Pipl for dir of files
2992,34481,756jsoncrossreferenceCrossreferences JSONs and returns the matches
3097,35856,018wlsearchscraperGets a list of documents from the WikiLeaks search that match certain terms.
31108,26181,756datacalcSome data calculation/manipulation for Transparency Toolkit.
32113,06181,756jsoncombinerInput multiple JSONs, get back one with all the data
33114,66981,756doc_integrity_checkEncrypts, verifies, and checks hashes of files
34116,00081,756jsontochoroplethConverts as JSON to a world choropleth map.
35118,80881,756ttcalcCalculation functions for Transparency Toolkit.
36119,25081,756sigadparseExtracts SIGADs from documents
37133,46981,756harvesterreporterIncremental result reporting for Transparency Toolkit
38151,43881,756guardianscraperScrapes Guardian articles.
39153,11856,018nametoemailGets a list of possible email addresses.
40153,16481,756indeedscraperGet resumes and job listings from indeed based on search terms and locations.
41175,61581,756docintegritycheckEncrypts, verifies, and checks hashes of files