Richard Williamson

Richard has been at the cutting edge of big data since its inception, leading multiple efforts to build multi-petabyte Hadoop platforms, maximizing business value by combining data science with big data. He has extensive experience creating advanced analytic systems using data warehousing and data mining technologies.

Recent Posts

Building a Prediction Engine using Spark, Kudu, and Impala

In this post, Richard walks you through a demo based on the streaming API to illustrate how to predict demand in order to adjust resource allocation.

Flexible Data Architecture with Spark, Cassandra, and Impala

An important aspect of a modern data architecture is the ability to use multiple execution frameworks over the same data.



  • Best Practices for Spark in Production

    Principal Engineers Richard Williamson and Andrew Ray will be on Pepperdata’s webinar panel of industry experts, talking about Spark trends and use cases. Sign up here to attend the webinar, or get the recording.

Past Events


  • Strata + Hadoop World 2015

    San Jose, CA

    Several of us will be presenting and we’d love to see you there. Join us for our tutorials and sessions, or come visit us at our booth in the Expo Hall.

  • Hadoop Summit

    San Jose, CA

    SVDS presents two sessions at Hadoop Summit: one that maps the central concepts in Spark to those in the SAS language, including datasets, queries, and machine learning; and a look at how to choose an HDFS data storage format: Avro vs. Parquet and more.

  • StampedeCon

    St. Louis, MO

    SVDS presents two sessions at StampedeCon: one that examines the benefits of using multiple persistence strategies to build an end-to-end predictive engine; and a look at how to choose an HDFS data storage format: Avro vs. Parquet and more.

  • NWA Tech Summit

    Rogers, AR

    SVDS Principal Engineer Richard Williamson presents a session on “Leveraging Multiple Persistence Layers in Spark to Build a Scalable Prediction Engine.”

Sign up for our newsletter