MySQL Heatwave Lakehouse

MySQL Heatwave Lakehouse

May 28, 2024 | seedling, permanent

tags :

Data Lakehouse #

Object Storage

ref

OCR of Images #

2023-12-05_15-27-44_screenshot.png #

MySQL HeatWave Lakehouse Data in object store remains in object store CSV AVRO h Parquet MySQL. AWS Aurora export AWS Redshift export HeatWave Object Store

2023-12-05_15-44-01_screenshot.png #

MySQL HeatWave Lakehouse Data at rest is always in object store MySQL Social, eCommerce, gaming, healthcare, fintech apps. Analytics and ML tools S ORACLE jupyter A Analytics Cloud Apache Zeppelin Queries Results MySQL HeatWave Object Store IlIhi CSV Parquet Data remains in object store, processing is done in HeatWave OLTP Analytics AutoML Autopilot Scales from 16 GB  - E AVRO Database exports

2023-12-05_15-44-27_screenshot.png #

Query performance of HeatWave Lakehouse 9X FASTER THAN REDSHIFT, 17X FASTER THAN SNOWFLAKE, 17X FASTER THAN DATABRICKS, 36X FASTER THAN BIGQUERY Query execution time: 500 TB TPC-H dower 361 1,800 1 1,600 1,400 28 mins 1,200 Significantly reduce time-to-insights 1,000 E 800 Slower ATA dower ATK 600 Sower q1 14 mins 13 mins 400 7 mins L 200 47 seconds HeatWave Amazon Redshift Databricks Snowflake Google BigQuery Lakehouse

2023-12-05_15-44-44_screenshot.png #

Very simple to query files in the object store STANDARD SQL SYNTAX GENERATED BY MYSQL AUTOPILOT, NO HUMAN REQUIRED Advisor System Setup Auto Provisioning Run MySQLAutopilot on setue er y Data lec objectstore to determine cluster size and schema mapping Auto Schema Inference MySQL Autopilot Data-driven Query-driven ML automation Adaptive Data Sampling  Execute DDLS generated oe et e Quers by Autopilot Run query across files and tables ocne mysql> SELECT count (*) FROM Sensor, SALES WHERE Sensor.degrees > 30 AND Sensor.date = Automated SALES.date;

2023-12-05_15-45-45_screenshot.png #

Same performance with HeatWave for L data in DB or in object store DEVELOP APPLICATIONS WITH DATA ON OBJECT STORE WITHOUT ANY PERFORMANCE IMPACT Query execution time: 10 TB TPC-H 120 100  a 80 a e 60 - a 40 5 20 Significantly in flexibility and reduces costs 1.75 minutes 1.3 minutes 59 seconds 47 seconds 14 seconds HeatWave 14 seconds HeatWave Lakehouse 0 Snowflake Amazon Redshift Google Big Query Databricks


Links to this note

Go to random page

Previous Next