Easily Spinning up Data Platforms
A quick overview of the motivation behind our instant and repeatable data platform tool.
Mark Mims
Mark has extensive experience architecting and implementing data science solutions across a variety of industries. His passion is Data Plumbing, where Data Science meets the real world of DevOps and Infrastructure Engineering.
Recent Posts
Building Pipelines to Understand User Behavior
In this post, we cover what’s needed to understand user activity, and we look at some pipeline architectures that support this analysis.
Develop Spark Apps on YARN Using Docker
Rather than get bitten by the idiosyncrasies involved in running Spark on YARN vs. standalone when you go to deploy, here’s a way to set up a development environment for Spark that more closely mimics how it’s used in the wild.
Past Events
2017
-
Enterprise Data World 2017
Atlanta, GAEnterprise Data World focuses on data-driven business. Several of us will be there this year, talking about data platforms and enterprise data science. Let us know if you’ll be there, or you can sign up to receive our slides.
2016
-
Data Day Seattle 2016
Seattle, WAJoin us as CTO John Akred gives a talk on alternative approaches to valuing data within an organization, and Data Scientist Chloe Mawer demonstrates the power of Jupyter notebooks using a real-world train-detection problem. We’ll also present a tutorial on building data pipelines with Kafka and Spark.
-
Hadoop with the Best
Principal Engineer Mark Mims will be speaking at this online conference, presenting on how to identify user activity from streams.
-
Data Day Texas
Austin, TXJoin CTO John Akred for a talk on Running Agile Data Science Teams, and VP of Engineering Stephen O’Sullivan for a talk on Choosing an HDFS data storage format (Avro vs. Parquet). Principal Engineer Mark Mims will hold Office Hours.