Shidash's Gems

icon
#Total RankDaily RankNameSummary
121,9739,761generalscraperScrapes Google
223,70420,872linkedindataScrapes all LinkedIn profiles including terms you specify.
325,52523,834jsontochartTake JSON files and outputs html for various types of charts
427,61825,591entityextractorExtracts entities and terms from any JSON.
528,52217,287linkedincrawlerCrawls public LinkedIn profiles via Google
631,17611,656dircrawlRun block on all files in dir
737,77294,831wordcloudTakes input and outputs the same text with word size changed based on frequency.
838,69994,831uploadconvertConverts documents to the appropriate format for Transparency Toolkit.
940,68329,054linkedinparserParses public LinkedIn profiles
1041,42816,842parsefileOCR file and extract metadata using Apache Tika and Tesseract
1145,164135,887urlarchiverSaves html and pdfs of websites.
1248,16417,685twittercrawlerCrawls Twitter
1349,91635,772extractpatternsExtracts entities and terms from any JSON.
1450,953135,887timelinegenTimelineGen generates JSON files for use as TimelineJS data.
1552,93694,831sunlightcongressAccess to Sunlight Foundation's congress data.
1655,00538,118indeedparserParses Indeed resumes
1757,91744,572jsontonetworkgraphGenerates node and link data from any JSON.
1860,61321,572piplrequestGets data from Pipl
1964,24629,054tsjobcrawlerCrawls job listing websites for jobs requiring security clearance.
2067,261135,887requestmanagerManages proxies, wait intervals, etc
2171,25354,969effscraperScrapes EFF court documents then extracts the plaintext and metadata.
2271,91554,969countryconvertConverts 2-char ISO country codes to 3-char.
2372,196135,887termextractorExtracts entities and terms from any JSON.
2476,238135,887sunlightpartytimeAccess to Sunlight Foundation's Party Time data.
2576,62254,969jsontomapConverts a JSON into a GeoJSON.
2677,37149,264indeedcrawlerCrawls Indeed resumes
2783,36575,441acluscraperScrapes ACLU court documents then extracts the plaintext and metadata.
2886,83363,366jsoncrossreferenceCrossreferences JSONs and returns the matches
2987,84754,969piplcollectorGets data from Pipl for dir of files
3089,29994,831wlsearchscraperGets a list of documents from the WikiLeaks search that match certain terms.
31101,00975,441datacalcSome data calculation/manipulation for Transparency Toolkit.
32106,53875,441jsoncombinerInput multiple JSONs, get back one with all the data
33110,16475,441jsontochoroplethConverts as JSON to a world choropleth map.
34112,000135,887ttcalcCalculation functions for Transparency Toolkit.
35112,14063,366doc_integrity_checkEncrypts, verifies, and checks hashes of files
36112,709135,887sigadparseExtracts SIGADs from documents
37128,89638,118harvesterreporterIncremental result reporting for Transparency Toolkit
38141,86894,831guardianscraperScrapes Guardian articles.
39144,07694,831indeedscraperGet resumes and job listings from indeed based on search terms and locations.
40146,21994,831nametoemailGets a list of possible email addresses.
41167,17194,831docintegritycheckEncrypts, verifies, and checks hashes of files