Mc's Gems

icon
#Total RankDaily RankNameSummary
124,46173,233generalscraperScrapes Google
226,41337,856linkedindataScrapes all LinkedIn profiles including terms you specify.
328,09073,233jsontochartTake JSON files and outputs html for various types of charts
430,59273,233entityextractorExtracts entities and terms from any JSON.
531,29537,856linkedincrawlerCrawls public LinkedIn profiles via Google
633,97230,749dircrawlRun block on all files in dir
741,04773,233wordcloudTakes input and outputs the same text with word size changed based on frequency.
841,96537,856uploadconvertConverts documents to the appropriate format for Transparency Toolkit.
943,29073,233linkedinparserParses public LinkedIn profiles
1044,61037,856parsefileOCR file and extract metadata using Apache Tika and Tesseract
1149,00873,233urlarchiverSaves html and pdfs of websites.
1250,13837,856twittercrawlerCrawls Twitter
1352,88073,233extractpatternsExtracts entities and terms from any JSON.
1454,98773,233timelinegenTimelineGen generates JSON files for use as TimelineJS data.
1557,00673,233sunlightcongressAccess to Sunlight Foundation's congress data.
1657,97973,233indeedparserParses Indeed resumes
1761,03273,233jsontonetworkgraphGenerates node and link data from any JSON.
1863,36673,233piplrequestGets data from Pipl
1965,89073,233tsjobcrawlerCrawls job listing websites for jobs requiring security clearance.
2071,68437,856requestmanagerManages proxies, wait intervals, etc
2175,81473,233countryconvertConverts 2-char ISO country codes to 3-char.
2276,27573,233effscraperScrapes EFF court documents then extracts the plaintext and metadata.
2376,54037,856termextractorExtracts entities and terms from any JSON.
2480,12073,233jsontomapConverts a JSON into a GeoJSON.
2580,69073,233indeedcrawlerCrawls Indeed resumes
2681,63273,233sunlightpartytimeAccess to Sunlight Foundation's Party Time data.
2788,81173,233acluscraperScrapes ACLU court documents then extracts the plaintext and metadata.
2891,63073,233piplcollectorGets data from Pipl for dir of files
2991,73037,856jsoncrossreferenceCrossreferences JSONs and returns the matches
3096,71473,233wlsearchscraperGets a list of documents from the WikiLeaks search that match certain terms.
31107,64237,856datacalcSome data calculation/manipulation for Transparency Toolkit.
32112,35037,856jsoncombinerInput multiple JSONs, get back one with all the data
33114,07773,233doc_integrity_checkEncrypts, verifies, and checks hashes of files
34115,26937,856jsontochoroplethConverts as JSON to a world choropleth map.
35118,04173,233ttcalcCalculation functions for Transparency Toolkit.
36118,49773,233sigadparseExtracts SIGADs from documents
37132,85173,233harvesterreporterIncremental result reporting for Transparency Toolkit
38150,53773,233guardianscraperScrapes Guardian articles.
39152,30737,856indeedscraperGet resumes and job listings from indeed based on search terms and locations.
40152,36173,233nametoemailGets a list of possible email addresses.
41174,67173,233docintegritycheckEncrypts, verifies, and checks hashes of files