Tag Archives: erlang

  • Building Riak CS on Riak
    2013-03-18 Erlang Central

    Videos



    Riak CS is an Erlang application that exposes the S3 API on top of Riak: an eventually consistent fault-tolerant distributed key-value store. Riak CS design faced many challenges: supporting large files, distributed garbage collection and quick time to market. We'll dive into implementation details and lessons applicable to anyone building distributed systems, such as the power of immutability in large-scale system design. Time will also be given to less obviously exciting issues like versioning ...


    Read more


  • Services Platform: Experiments in OTP-Compliant Dataflow Programming
    2013-03-18 Erlang Central

    Videos



    Erlang Services Platform (Erlang/SP) is a library that is fully integrated and compliant with existing OTP libraries, but attempts to enable Dataflow Programming techniques. The library anticipates future chips with 100s - 10Ks of cores, allowing problems to be solved by organizing Cooperating Processes (co-ops) around Directed Acyclic Graphs (DAGs) as an augmentation to traditional gen_* system architectures Talk objectives: Compares and contrasts typical OTP programming techniques with Dat ...


    Read more


  • KVDB – A Database System for Configuration Data and Connected Devices
    2013-03-18 Erlang Central

    Videos



    Deciding to write your own database management system while implementing a commercial online service must surely be a grand example of hubris! Yet, this is what we did at Feuerlabs. We wanted a database framework that could work equally well on an embedded device as on the server side, with easy interoperability; we wanted to handle tree-structured data and a huge amount of persistent queues; and we needed transaction support. We are now releasing the result as part of our Open Source Exosense d ...


    Read more


  • Location, Location, Location
    2013-03-18 Erlang Central

    Videos



    A simple mechanism for tracking user location and finding others nearby is presented and contributed as open source. Geohashes expressed as integers padded with MSB=1 are used to store user location information with timestamps in Redis. An OTP application built on Mochiweb exposes a RESTful interface for setting user location information and finding neighboring users. If time permits, an integration with Mongoose may also be presented. Talk objectives: Location Matters. Users of websites sho ...


    Read more


  • Introducing LeoFS – the Lion of Storage Systems
    2013-03-18 Erlang Central

    Videos



    To quote Ludwig Mies van der Rohe, "Less is more" and "God is in the details". This is the philosophy behind LeoFS, a DFS(Distributed File System) open source storage system developed and used by Rakuten, Japan's answer to Amazon and its #1 Shopping Site. LeoFS is a Web shaped object storage system that stores and serves many Rakuten’s image files. It is built to operate in highly distributed environments, such as the cloud, and consists of loosely connected nodes with no SPOF(single po ...


    Read more


  • A Layered Architecture: Robustness and Efficiency
    2013-03-18 Erlang Central

    Videos



    The redesign of our technology stack into robust and cleanly separated layers. The importance of efficient and strict communication between them.Talk objectives: Giving an understanding of the problems when reimplementing an existing architecture. Sharing the technologies we've used and some insight on the roadblocks we've encountered.Target audience: Architects, CTOs, backend developers. ...


    Read more


  • Kazoo: An Erlang-Based Elegant, Distributed Cloud Architecture for Communications
    2013-03-18 Erlang Central

    Videos



    This is a frank discussion about the benefits and challenges of scaling Erlang for massive communications applications in distributed environments. The talk will focus on how 2600hz uses Erlang, some of the Best practices we've learned while building our stack and how Erlang has really helped us get to market faster and easier. Kazoo leverages Erlang as a core component of the infrastructure and so we have developed some unique insight into how Erlang can be run at scale. In particular, we fo ...


    Read more


  • Lilith – Solving the Distributed Video Operations Challenge @ ESPN
    2013-03-18 Erlang Central

    Videos



    This talk will be about how John came to use Erlang for a system that requires a high-performance control plane and a system for handling long-running requests for video streaming. Talk objectives: Education. Specifically about the use of Websockets, riak_core and video processing in Erlang, and the comparative advantages/disadvantages of Erlang vs. node.js. Target audience: People wishing to understand Erlang's role in distributed systems design. Programmers wanting to know something abou ...


    Read more


  • Beyond MapReduce
    2013-03-18 Erlang Central

    Videos



    The goal of Disco has been to be a simple and usable implementation of MapReduce. To keep things simple, this MapReduce aspect has been hard-coded into Disco, both in the Erlang job scheduler, as well as in the Python library. To fix various issues in the implementation, we decided to take a cold hard look at the dataflow in Disco's version of MapReduce. We came up with a generalization that should be more flexible and hence also more useful than plain old MapReduce. We call this the Pipe ...


    Read more


  • Erlang Engine Tuning: Part 1 – Know your Engine
    2013-03-18 Erlang Central

    Videos



    In this talk we will take a look under the hood of the Erlang RunTime System (ERTS). We will look at compiler options to generate readable machine code, at how a process is represented in memory, at the BEAM instruction set and details about how memory is handled. Talk objectives: After the talk you should know how to generate and read BEAM code. You should understand how Erlang data structures are laid out in memory and how the garbage collector work. With this knowledge you should be able t ...


    Read more


  • Beating the No-Win Scenario: Testing a Distributed System
    2013-03-18 Erlang Central

    Videos



    Testing distributed systems is hard. Testing is hard, but we've been given tools like EUnit and common_test to make it easier. Where is this toolkit for distributed systems? I'm not going to claim that I have all the answers or even that I have a framework you can use to solve your problem. What I do have is an idea and a solution to MY problem, which is ""How do we test Riak?" Come with me on an adventure of design decisions, tradeoffs and deep dark corners of Erlang. We'll go from group l ...


    Read more


  • LDB: The BigData In-Memory Database built with Erlang, C and LISP
    2013-03-18 Erlang Central

    Videos



    Would you believe it that you can feed data coming from various sources (even thousand different resources - like mobile devices) into a system, describe what information you want to extract in a few lines of code and then have all this information in your finger tips? In real time. While the system keeps running? LDB powers BugSense and analyses data coming from more than 200M mobile devices, in realtime. And even though it is In-Memory, data is actually stored in the hard-drive and replicat ...


    Read more


  • Page 23 of 29« First...10...2122232425...Last »