Riak Pipe: Distributing the Load

By Erlang Central | Published: June 13, 2013

Riak Pipe is most simply described as “UNIX pipes for Riak.” In much the same way you would pipe the output of one program to another on the command line, Riak Pipe allows you to pipe the output of a function on one vnode to the input of a function on another. This talk covers the basic structure of Riak Pipe,  with an emphasis on the structures and practices used to prevent overload. An analysis of the strengths and weaknesses of the approaches chosen, and potentials for future improvement, will also be presented.
Talk objectives: This talk aims to introduce Riak Pipe, covering good practices for managing overload in a distributed systems.
Target audience: This talk would appeal to anyone interested in any part of Riak (the key-value store, the MapReduce system, the base “core” platform), as well as anyone interested in distributed computing and load regulation.
Download Presentation Download


  • Bryan Fink

    WebMachine and Riak Committer
    Basho Technologies

    Bryan started using Erlang to develop a website (BeerRiot) in 2007. His blog caught Basho's eye, who snatched him up to write applications on top of the projects that eventually became Webmachine and Riak. He soon transitioned to working directly on the platform, and of late he's been leading its extension through Riak Pipe. Prior to Basho Bryan worked on a realtime analysis platform for the financial industry, and also worked on bus testing for the aeronautics and automotive industries.

    Twitter: @hobbyist

    Bryan Fink

Follow Erlang Central:

Have an Erlang Question?

Reach out to the Erlang community