Klout collects and processes an enormous amount of data to measure online influence — over 19 terabytes every day! To handle the ingestion and storage of this data, we’ve turned to open-source, distributed technologies. At next year’s SXSW we want to share the technical challenges and best practices we’ve found when using open source technology.
I’d love for you to vote for our panel where I’ll be joined by some of Klout’s thought leaders in this area. Ramya Krishnamurthy leads our science team and oversees the development of algorithms for topic detection, scoring, and ranking. Tyke Lewis leads our consumer teams and has been instrumental in our adoption of Node.js to provide a scalable platform to deliver realtime streams. Derek Wollenstein, a key member of our platform team, builds massively scalable systems to ingest, analyze, and deliver Big Data.
You will leave this workshop with tips on some of the shortcomings of open source technologies and actionable knowledge on how to build your own Big Data pipeline.
