More often than not we find ourselves implementing BigData architectures that include those two technologies. Presto is usually deployed for what we call the “cold layer”, and Elasticsearch for the “hot layer”. Our connector finally allows to inter-connect them seamlessly. Here is how.
Elasticsearch is a real-time search and analytics engine, and it is the core product behind the well-known Elastic Stack. It is mainly used for log analytics and for creating interactive dashboards to browse and drill-down into data, usually events or time based. Response times with Elastic are in most cases subsecond, thus it is being widely used for ad-hoc data investigation and often using an interactive UI or Kibana dashboards.
Presto is a high performance, distributed SQL query engine for BigData. Slowly but surely, it is becoming the de-facto standard for implementing cost-effective Data Lakes and Data Warehouses - mainly thanks to its ability to query huge amounts of data in what we often call “interactive time”.
More often than not we find ourselves implementing BigData architectures that include those two technologies. Presto is usually deployed for what we call the “cold layer”, and Elasticsearch for the “hot layer”. In most systems, real-time access isn’t required for the lion’s share of the data where the main concern is keeping costs low; and so S3 and Presto are a great fit. Usually ultra-low latency queries are only required for a portion of the data, and that is where Elasticsearch, which is more hardware demanding and hence costler, really shines.
And this is where things start being really interesting. Join us in this talk to learn more about Presto and Elasticsearch, and how they can complement each other in the real-world and some really cool use-cases.
Read more about our high-performance, enterprise grade Elasticsearch connector for Presto: https://blog.bigdataboutique.com/2020/04/introducing-our-high-performance-elasticsearch-connector-for-presto-ouvf0w
For commercial services around Presto: https://bigdataboutique.com/services/presto
Take our Presto Monitor product for a spin: https://bigdataboutique.com/solutions/presto-monitor