How much data does metabase scans?

Get Help FAQ
1

We are using Athena DB. If we have total 100GB data in all the tables. Then does metabase scan 100GB data daily in “Scanning for field values” ?

2

Hi @outlier
When Metabase scans, it does a query like SELECT DISTINCT column FROM table LIMIT 5000

3

A simple test with v0.39.2 I did did not have "DISTINCT".

With "DISTINCT" I'm worried that if I have a table with hundreds of millions of rows with columns that have only 1 or 0 values, I might scan all the data. If you are using Athena etc., the billing may become enormous. Therefore, in my case, it is better not to have "DISTINCT".