Following a short introduction to Storage System and BlockManager, this AMA session shows when and how Spark saves data to disk using the storage system. While being fairly low-level, there is still enough high-level info that any Spark user could benefit from.
This session was recorded live as part of our weekly Ask Me Anything sessions, live every Wednesday.
Join us for future Ask Me Anything sessions! More details on our website.