The Scalable Hyperlink Store is a specialized "database" for the web graph. SHS maintains the web graph in main memory, distributed over many machines. The system is available as C# source code as well as precompiled binaries.
- Marc Najork, The Scalable Hyperlink Store, in 20th ACM Conference on Hypertext and Hypermedia, Association for Computing Machinery, Inc., June 2009
- Marc Najork, Dennis Fetterly, Alan Halverson, Krishnaram Kenthapadi, and Sreenivas Gollapudi, Of Hammers and Nails: An Empirical Comparison of Three Paradigms for Processing Large Graphs, in 5th ACM International Conference on Web Search and Data Mining (WSDM), ACM, February 2012
Scalable Hyperlink Store (Download)
The Scalable Hyperlink Store is a specialized "database" for the web graph. SHS maintains the web graph in main memory, distributed over many machines.
File Name: SHS-release-v1.0.zip
Date Published: 18 December 2013
Download Size: 4.44 MB
Hum... how to use this... There's got to be a way I can do something with this...
Here's a snip from the zip;
NOTE: This is a MSR-LA licensed project (so no commercial usage)