Breakthrough after Breakthrough
In 2003 Tableau spun out of Stanford University with VizQL™, a technology that completely changes working with data by allowing simple drag and drop functions to create sophisticated visualizations. The fundamental innovation is a patented query language that translates your actions into a database query and then expresses the response graphically.
The next breakthrough was the ability to do ad-hoc analysis of billions of rows of data in seconds with Hyper, Tableau's data engine technology. A core Tableau platform technology, Hyper uses proprietary dynamic code generation and cutting-edge parallelism techniques to achieve fast performance for extract creation and query execution.
Hyper is a high-performance in-memory data engine technology that helps customers analyze large or complex data sets faster, by efficiently evaluating analytical queries directly in the transactional database. A core Tableau platform technology, Hyper uses proprietary dynamic code generation and cutting-edge parallelism techniques to achieve fast performance for extract creation and query execution.
Hyper's unique designOver the past decade, in-memory data engines and analytical database technologies have delivered incredible query performance improvements through techniques such as sampling and summarization. These performance improvements come at a cost, however. Many systems sacrifice write performance—critical for fast extract creation and refresh performance—in favor of optimizing analytical workload performance. Poor write speeds lead to stale and disconnected data. The result? A lag between people and the data they want to analyze. Our mission with Hyper is to bring people closer to their data by giving you fast write speed and fast analytical workload performance. In short, Hyper delivers fresh data, faster—so you can analyze a larger, more complete view of your data.
Rethinking system architecture: one state for transactions and analytical queriesWith Hyper, transactions and analytical queries are processed on the same column store, with no post-processing needed after data ingestion. This reduces stale data and minimizes the connection gap between specialized systems. Hyper's unique approach allows a true combination of read-and write-heavy workloads in a single system. This means you can have fast extract creation without sacrificing fast query performance. (We call that a win-win.)
A new approach to query execution: dynamic code generationHyper uses a novel just-in-time compilation execution model. Many other systems use a traditional query execution model that cannot take full advantage of modern multicore hardware. Instead, Hyper optimizes and compiles queries into custom machine code to make better use of the underlying hardware. When Hyper receives a query, it creates a tree, logically optimizes the tree, and then uses it as a blueprint to create a unique program, which is then executed. The end result is better utilization of modern hardware for faster query execution.
Leveraging more of your hardware: morsel-driven parallelizationWe designed Hyper from the ground up with large, multi-core environments in mind. Our parallelization model is based on very small units of work (morsels.) These morsels are assigned efficiently across all available cores, allowing Hyper to more efficiently account for differences in core speed. This translates into a more efficient hardware utilization and faster performance.
Hyper began as an academic research project at the Technical University of Munich (TUM) in 2010. It spun off into an independent organization in 2015 with the goal of bringing Hyper to industry and shipping a commercial version of the technology. Hyper was acquired by Tableau in 2016; the core technology now powers the Tableau data engine.
Natively visual and therefore fasterAt the heart of Tableau is a proprietary technology that makes interactive data visualization an integral part of understanding data. A traditional analysis tool forces you to analyze data in rows and columns, choose a subset of your data to present, organize that data into a table, then create a chart from that table. VizQL skips those steps and creates a visual representation of your data right away, giving you visual feedback as you analyze. As a result you get a much deeper understanding of your data and can work much faster than conventional methods–up to 100 times faster.