BigQuery NoClassDefFoundError

We encountered an issue when attempting to upgrade from v0.42.4 -> 0.43.1
We're self-hosting the OSS package built with JDK 11 / clojure 1.11.1 on Google Cloud with postgres (for metadata) and BigQuery.

All migrations ran successfully against the postgres db on deployment. We're able to login without any problems. However, we're unable to query any BigQuery data sources.

The logs seem to indicate the BigQuery driver was loaded without issue, but then the stacktrace is showing java.lang.NoClassDefFoundError for com.google.cloud.bigquery.BigQueryOptions:

[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:35-04:00 INFO metabase.core
Metabase vUNKNOWN (ee8bbe2 ?)

Copyright © 2022 Metabase, Inc.

Metabase Enterprise Edition extensions are NOT PRESENT.
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:35-04:00 INFO metabase.core Starting Metabase in STANDALONE mode
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:35-04:00 INFO metabase.server Launching Embedded Jetty Webserver with config:
{:port 8080, :host "0.0.0.0"}

[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:35-04:00 INFO metabase.core Starting Metabase version vUNKNOWN (ee8bbe2 ?) ...
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:35-04:00 INFO metabase.core System info:
{"file.encoding" "ANSI_X3.4-1968",
"java.runtime.name" "OpenJDK Runtime Environment",
"java.runtime.version" "11.0.6+10-post-Debian-1bpo91",
"java.vendor" "Debian",
"java.vendor.url" "https:// tracker .debian.org/openjdk-11",
"java.version" "11.0.6",
"java.vm.name" "OpenJDK 64-Bit Server VM",
"java.vm.version" "11.0.6+10-post-Debian-1bpo91",
"os.name" "Linux",
"os.version" "5.10.107+",
"user.language" "en",
"user.timezone" "UTC"}

[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:35-04:00 INFO metabase.plugins Loading plugins in /plugins...
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:36-04:00 INFO metabase.util.files Extract file /modules/sqlserver.metabase-driver.jar -> /plugins/sqlserver.metabase-driver.jar
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:36-04:00 INFO metabase.util.files Extract file /modules/sparksql.metabase-driver.jar -> /plugins/sparksql.metabase-driver.jar
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:36-04:00 INFO metabase.util.files Extract file /modules/presto-common.metabase-driver.jar -> /plugins/presto-common.metabase-driver.jar
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:36-04:00 INFO metabase.util.files Extract file /modules/druid.metabase-driver.jar -> /plugins/druid.metabase-driver.jar
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:36-04:00 INFO metabase.util.files Extract file /modules/presto-jdbc.metabase-driver.jar -> /plugins/presto-jdbc.metabase-driver.jar
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:36-04:00 INFO metabase.util.files Extract file /modules/snowflake.metabase-driver.jar -> /plugins/snowflake.metabase-driver.jar
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:36-04:00 INFO metabase.util.files Extract file /modules/bigquery-cloud-sdk.metabase-driver.jar -> /plugins/bigquery-cloud-sdk.metabase-driver.jar
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:36-04:00 INFO metabase.util.files Extract file /modules/vertica.metabase-driver.jar -> /plugins/vertica.metabase-driver.jar
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:36-04:00 INFO metabase.util.files Extract file /modules/sqlite.metabase-driver.jar -> /plugins/sqlite.metabase-driver.jar
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:36-04:00 INFO metabase.util.files Extract file /modules/redshift.metabase-driver.jar -> /plugins/redshift.metabase-driver.jar
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:36-04:00 INFO metabase.util.files Extract file /modules/mongo.metabase-driver.jar -> /plugins/mongo.metabase-driver.jar
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 INFO metabase.util.files Extract file /modules/oracle.metabase-driver.jar -> /plugins/oracle.metabase-driver.jar
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 INFO metabase.util.files Extract file /modules/googleanalytics.metabase-driver.jar -> /plugins/googleanalytics.metabase-driver.jar
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 INFO metabase.util.files Extract file /modules/presto.metabase-driver.jar -> /plugins/presto.metabase-driver.jar
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 INFO metabase.plugins.dependencies Plugin 'Metabase Presto Driver' depends on plugin 'Presto Common Driver'
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 INFO metabase.plugins.dependencies Metabase Presto Driver dependency {:plugin Presto Common Driver} satisfied? false
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 INFO metabase.plugins.dependencies Plugins with unsatisfied deps: ["Metabase Presto Driver"]
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 DEBUG metabase.plugins.lazy-loaded-driver Registering lazy loading driver :googleanalytics...
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 INFO metabase.driver.impl Registered driver :googleanalytics
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 DEBUG metabase.plugins.lazy-loaded-driver Registering lazy loading driver :hive-like...
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 INFO metabase.driver.impl Registered abstract driver :hive-like (parents: [:sql-jdbc])
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 DEBUG metabase.plugins.lazy-loaded-driver Registering lazy loading driver :sparksql...
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 INFO metabase.driver.impl Registered driver :sparksql (parents: [:hive-like])
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 DEBUG metabase.plugins.lazy-loaded-driver Registering lazy loading driver :sqlite...
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 INFO metabase.driver.impl Registered driver :sqlite (parents: [:sql-jdbc])
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 DEBUG metabase.plugins.lazy-loaded-driver Registering lazy loading driver :sqlserver...
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 INFO metabase.driver.impl Registered driver :sqlserver (parents: [:sql-jdbc])
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 DEBUG metabase.plugins.lazy-loaded-driver Registering lazy loading driver :bigquery-cloud-sdk...
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 INFO metabase.driver.impl Registered driver :bigquery-cloud-sdk (parents: [:sql])
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 DEBUG metabase.plugins.lazy-loaded-driver Registering lazy loading driver :presto-common...
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 INFO metabase.driver.impl Registered abstract driver :presto-common
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 INFO metabase.plugins.dependencies Metabase Presto Driver dependency {:plugin Presto Common Driver} satisfied? true
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 DEBUG metabase.plugins.initialize Dependencies satisfied; these plugins will now be loaded: ["Metabase Presto Driver"]
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 DEBUG metabase.plugins.lazy-loaded-driver Registering lazy loading driver :presto...
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 INFO metabase.driver.impl Registered driver :presto (parents: [:presto-common])
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 DEBUG metabase.plugins.lazy-loaded-driver Registering lazy loading driver :mongo...
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 INFO metabase.driver.impl Registered driver :mongo
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 INFO metabase.plugins.dependencies Plugin 'Metabase Presto JDBC Driver' depends on plugin 'Presto Common Driver'
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 INFO metabase.plugins.dependencies Metabase Presto JDBC Driver dependency {:plugin Presto Common Driver} satisfied? true
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 DEBUG metabase.plugins.lazy-loaded-driver Registering lazy loading driver :presto-jdbc...
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 INFO metabase.driver.impl Registered driver :presto-jdbc (parents: [:presto-common])
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 INFO metabase.plugins.dependencies Metabase cannot initialize plugin Metabase Vertica Driver due to required dependencies. Metabase requires the Vertica JDBC driver in order to connect to Vertica databases, but we can't ship it as part of Metabase due to licensing restrictions. See https:// metabase .com/docs/latest/administration-guide/databases/vertica.html for more details.

[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 INFO metabase.plugins.dependencies Metabase Vertica Driver dependency {:class com.vertica.jdbc.Driver} satisfied? false
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 INFO metabase.plugins.dependencies Plugins with unsatisfied deps: ["Metabase Vertica Driver"]
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 DEBUG metabase.plugins.lazy-loaded-driver Registering lazy loading driver :snowflake...
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 INFO metabase.driver.impl Registered driver :snowflake (parents: [:sql-jdbc])
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 DEBUG metabase.plugins.lazy-loaded-driver Registering lazy loading driver :druid...
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 INFO metabase.driver.impl Registered driver :druid
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 DEBUG metabase.plugins.lazy-loaded-driver Registering lazy loading driver :redshift...
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 INFO metabase.driver.impl Registered driver :redshift (parents: [:postgres])
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 INFO metabase.plugins.dependencies Metabase cannot initialize plugin Metabase Oracle Driver due to required dependencies. Metabase requires the Oracle JDBC driver in order to connect to Oracle databases, but we can't ship it as part of Metabase due to licensing restrictions. See https:// metabase .com/docs/latest/administration-guide/databases/oracle.html for more details.

[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 INFO metabase.plugins.dependencies Metabase Oracle Driver dependency {:class oracle.jdbc.OracleDriver} satisfied? false
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 INFO metabase.plugins.dependencies Plugins with unsatisfied deps: ["Metabase Oracle Driver" "Metabase Vertica Driver"]
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 INFO metabase.core Setting up and migrating Metabase DB. Please sit tight, this may take a minute...
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:37-04:00 INFO metabase.db.setup Verifying postgres Database Connection ...
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:38-04:00 INFO metabase.core
Metabase vUNKNOWN (ee8bbe2 ?)

Copyright © 2022 Metabase, Inc.

Metabase Enterprise Edition extensions are NOT PRESENT.
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:38-04:00 INFO metabase.core Starting Metabase in STANDALONE mode
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:38-04:00 INFO metabase.server Launching Embedded Jetty Webserver with config:
{:port 8080, :host "0.0.0.0"}

[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:38-04:00 INFO metabase.core Starting Metabase version vUNKNOWN (ee8bbe2 ?) ...
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:39-04:00 INFO metabase.core System info:
{"file.encoding" "ANSI_X3.4-1968",
"java.runtime.name" "OpenJDK Runtime Environment",
"java.runtime.version" "11.0.6+10-post-Debian-1bpo91",
"java.vendor" "Debian",
"java.vendor.url" "https:// tracker .debian.org/openjdk-11",
"java.version" "11.0.6",
"java.vm.name" "OpenJDK 64-Bit Server VM",
"java.vm.version" "11.0.6+10-post-Debian-1bpo91",
"os.name" "Linux",
"os.version" "5.10.107+",
"user.language" "en",
"user.timezone" "UTC"}

[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:39-04:00 INFO metabase.plugins Loading plugins in /plugins...
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:39-04:00 INFO metabase.util.files Extract file /modules/sqlserver.metabase-driver.jar -> /plugins/sqlserver.metabase-driver.jar
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:39-04:00 INFO metabase.util.files Extract file /modules/sparksql.metabase-driver.jar -> /plugins/sparksql.metabase-driver.jar
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:39-04:00 INFO metabase.util.files Extract file /modules/presto-common.metabase-driver.jar -> /plugins/presto-common.metabase-driver.jar
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:39-04:00 INFO metabase.util.files Extract file /modules/druid.metabase-driver.jar -> /plugins/druid.metabase-driver.jar
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:39-04:00 INFO metabase.util.files Extract file /modules/presto-jdbc.metabase-driver.jar -> /plugins/presto-jdbc.metabase-driver.jar
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:39-04:00 INFO metabase.util.files Extract file /modules/snowflake.metabase-driver.jar -> /plugins/snowflake.metabase-driver.jar
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:40-04:00 INFO metabase.util.files Extract file /modules/bigquery-cloud-sdk.metabase-driver.jar -> /plugins/bigquery-cloud-sdk.metabase-driver.jar
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:40-04:00 INFO metabase.util.files Extract file /modules/vertica.metabase-driver.jar -> /plugins/vertica.metabase-driver.jar
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:40-04:00 INFO metabase.util.files Extract file /modules/sqlite.metabase-driver.jar -> /plugins/sqlite.metabase-driver.jar
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:40-04:00 INFO metabase.util.files Extract file /modules/redshift.metabase-driver.jar -> /plugins/redshift.metabase-driver.jar
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:40-04:00 INFO metabase.util.files Extract file /modules/mongo.metabase-driver.jar -> /plugins/mongo.metabase-driver.jar
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:40-04:00 INFO metabase.util.files Extract file /modules/oracle.metabase-driver.jar -> /plugins/oracle.metabase-driver.jar
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:40-04:00 INFO metabase.util.files Extract file /modules/googleanalytics.metabase-driver.jar -> /plugins/googleanalytics.metabase-driver.jar
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:40-04:00 INFO metabase.util.files Extract file /modules/presto.metabase-driver.jar -> /plugins/presto.metabase-driver.jar
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:40-04:00 INFO metabase.plugins.dependencies Plugin 'Metabase Presto Driver' depends on plugin 'Presto Common Driver'
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:40-04:00 INFO metabase.plugins.dependencies Metabase Presto Driver dependency {:plugin Presto Common Driver} satisfied? false
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:40-04:00 INFO metabase.plugins.dependencies Plugins with unsatisfied deps: ["Metabase Presto Driver"]
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:40-04:00 DEBUG metabase.plugins.lazy-loaded-driver Registering lazy loading driver :googleanalytics...
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:40-04:00 INFO metabase.driver.impl Registered driver :googleanalytics
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:40-04:00 DEBUG metabase.plugins.lazy-loaded-driver Registering lazy loading driver :hive-like...
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:40-04:00 INFO metabase.driver.impl Registered abstract driver :hive-like (parents: [:sql-jdbc])
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:40-04:00 DEBUG metabase.plugins.lazy-loaded-driver Registering lazy loading driver :sparksql...
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:40-04:00 INFO metabase.driver.impl Registered driver :sparksql (parents: [:hive-like])
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:40-04:00 DEBUG metabase.plugins.lazy-loaded-driver Registering lazy loading driver :sqlite...
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:40-04:00 INFO metabase.driver.impl Registered driver :sqlite (parents: [:sql-jdbc])
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:40-04:00 DEBUG metabase.plugins.lazy-loaded-driver Registering lazy loading driver :sqlserver...
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:40-04:00 INFO metabase.driver.impl Registered driver :sqlserver (parents: [:sql-jdbc])
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:41-04:00 DEBUG metabase.plugins.lazy-loaded-driver Registering lazy loading driver :bigquery-cloud-sdk...
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:41-04:00 INFO metabase.driver.impl Registered driver :bigquery-cloud-sdk (parents: [:sql])
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:41-04:00 DEBUG metabase.plugins.lazy-loaded-driver Registering lazy loading driver :presto-common...
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:41-04:00 INFO metabase.plugins.dependencies Metabase Presto Driver dependency {:plugin Presto Common Driver} satisfied? true
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:41-04:00 INFO metabase.driver.impl Registered abstract driver :presto-common
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:41-04:00 DEBUG metabase.plugins.initialize Dependencies satisfied; these plugins will now be loaded: ["Metabase Presto Driver"]
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:41-04:00 DEBUG metabase.plugins.lazy-loaded-driver Registering lazy loading driver :presto...
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:41-04:00 INFO metabase.driver.impl Registered driver :presto (parents: [:presto-common])
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:41-04:00 DEBUG metabase.plugins.lazy-loaded-driver Registering lazy loading driver :mongo...
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:41-04:00 INFO metabase.driver.impl Registered driver :mongo
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:41-04:00 INFO metabase.plugins.dependencies Plugin 'Metabase Presto JDBC Driver' depends on plugin 'Presto Common Driver'
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:41-04:00 INFO metabase.plugins.dependencies Metabase Presto JDBC Driver dependency {:plugin Presto Common Driver} satisfied? true
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:41-04:00 DEBUG metabase.plugins.lazy-loaded-driver Registering lazy loading driver :presto-jdbc...
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:41-04:00 INFO metabase.driver.impl Registered driver :presto-jdbc (parents: [:presto-common])
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:41-04:00 INFO metabase.db.setup Successfully verified PostgreSQL 13.6 application database connection.
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:41-04:00 INFO metabase.plugins.dependencies Metabase cannot initialize plugin Metabase Vertica Driver due to required dependencies. Metabase requires the Vertica JDBC driver in order to connect to Vertica databases, but we can't ship it as part of Metabase due to licensing restrictions. See https:// metabase .com/docs/latest/administration-guide/databases/vertica.html for more details.

[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:41-04:00 INFO metabase.db.setup Running Database Migrations...
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:41-04:00 INFO metabase.plugins.dependencies Metabase Vertica Driver dependency {:class com.vertica.jdbc.Driver} satisfied? false
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:41-04:00 INFO metabase.plugins.dependencies Plugins with unsatisfied deps: ["Metabase Vertica Driver"]
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:41-04:00 INFO metabase.db.setup Setting up Liquibase...
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:41-04:00 DEBUG metabase.plugins.lazy-loaded-driver Registering lazy loading driver :snowflake...
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:41-04:00 INFO metabase.driver.impl Registered driver :snowflake (parents: [:sql-jdbc])
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:41-04:00 DEBUG metabase.plugins.lazy-loaded-driver Registering lazy loading driver :druid...
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:41-04:00 INFO metabase.driver.impl Registered driver :druid
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:41-04:00 DEBUG metabase.plugins.lazy-loaded-driver Registering lazy loading driver :redshift...
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:41-04:00 INFO metabase.driver.impl Registered driver :redshift (parents: [:postgres])
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:41-04:00 INFO metabase.plugins.dependencies Metabase cannot initialize plugin Metabase Oracle Driver due to required dependencies. Metabase requires the Oracle JDBC driver in order to connect to Oracle databases, but we can't ship it as part of Metabase due to licensing restrictions. See https:// metabase .com/docs/latest/administration-guide/databases/oracle.html for more details.

[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:41-04:00 INFO metabase.plugins.dependencies Metabase Oracle Driver dependency {:class oracle.jdbc.OracleDriver} satisfied? false
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:41-04:00 INFO metabase.plugins.dependencies Plugins with unsatisfied deps: ["Metabase Oracle Driver" "Metabase Vertica Driver"]
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:41-04:00 INFO metabase.core Setting up and migrating Metabase DB. Please sit tight, this may take a minute...
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:41-04:00 INFO metabase.db.setup Verifying postgres Database Connection ...
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:41-04:00 INFO metabase.db.setup Liquibase is ready.
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:41-04:00 INFO metabase.db.liquibase Checking if Database has unrun migrations...
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:44-04:00 INFO metabase.db.liquibase Database has unrun migrations. Waiting for migration lock to be cleared...
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:44-04:00 INFO metabase.db.setup Successfully verified PostgreSQL 13.6 application database connection.
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:44-04:00 INFO metabase.db.setup Running Database Migrations...
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:44-04:00 INFO metabase.db.setup Setting up Liquibase...
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:44-04:00 INFO metabase.db.liquibase Migration lock is cleared. Running migrations...
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:45-04:00 INFO metabase.db.setup Database Migrations Current ...
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:45-04:00 INFO metabase.db.data-migrations Running all necessary data migrations, this may take a minute.
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:45-04:00 INFO metabase.db.liquibase Checking if Database has unrun migrations...
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:45-04:00 INFO metabase.db.setup Liquibase is ready.
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:45-04:00 INFO metabase.db.data-migrations Finished running data migrations.
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:45-04:00 INFO metabase.util Database setup took 7.5 s
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:45-04:00 INFO metabase.events Starting events listener: :metabase.events.dependencies/Dependencies
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:45-04:00 INFO metabase.events Starting events listener: :metabase.events.activity-feed/ActivityFeed
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:45-04:00 INFO metabase.events Starting events listener: :metabase.events.last-login/LastLogin
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:45-04:00 INFO metabase.events Starting events listener: :metabase.events.notifications/Notifications
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:45-04:00 INFO metabase.events Starting events listener: :metabase.events.sync-database/Sync
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:45-04:00 INFO metabase.events Starting events listener: :metabase.events.driver-notifications/DriverNotifications
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:45-04:00 INFO metabase.events Starting events listener: :metabase.events.revision/Revisions
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:45-04:00 INFO metabase.events Starting events listener: :metabase.events.view-log/ViewLog
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:45-04:00 INFO org.quartz.impl.StdSchedulerFactory Using default implementation for ThreadExecutor
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:45-04:00 INFO org.quartz.core.SchedulerSignalerImpl Initialized Scheduler Signaller of type: class org.quartz.core.SchedulerSignalerImpl
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:45-04:00 INFO org.quartz.core.QuartzScheduler Quartz Scheduler v.2.3.2 created.
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:45-04:00 INFO org.quartz.impl.jdbcjobstore.JobStoreTX Using db table-based data access locking (synchronization).
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:45-04:00 INFO org.quartz.impl.jdbcjobstore.JobStoreTX JobStoreTX initialized.
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:45-04:00 INFO org.quartz.impl.StdSchedulerFactory Quartz scheduler 'MetabaseScheduler' initialized from default resource file in Quartz package: 'quartz.properties'
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:45-04:00 INFO org.quartz.core.QuartzScheduler Scheduler meta-data: Quartz Scheduler (v2.3.2) 'MetabaseScheduler' with instanceId '50d21dc5cc971653338085752'
Scheduler class: 'org.quartz.core.QuartzScheduler' - running locally.
NOT STARTED.
Currently in standby mode.
Number of jobs executed: 0
Using thread pool 'org.quartz.simpl.SimpleThreadPool' - with 10 threads.
Using job-store 'org.quartz.impl.jdbcjobstore.JobStoreTX' - which supports persistence. and is clustered.

[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:45-04:00 INFO org.quartz.impl.StdSchedulerFactory Quartz scheduler version: 2.3.2
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:46-04:00 INFO org.quartz.core.QuartzScheduler Scheduler MetabaseScheduler_$50d21dc5cc971653338085752 paused.
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:46-04:00 INFO metabase.task Task scheduler initialized into standby mode.
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:46-04:00 INFO metabase.task Initializing task SyncDatabases
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:46-04:00 INFO metabase.task.sync-databases Updated default schedules for 0 databases
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:46-04:00 INFO metabase.task Initializing task CheckForNewVersions
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:46-04:00 INFO metabase.task Initializing task SendAnonymousUsageStats
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:46-04:00 INFO metabase.task Initializing task RefreshSlackChannelsAndUsers
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:46-04:00 INFO metabase.task Initializing task SendAbandomentEmails
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:46-04:00 INFO metabase.task Initializing task SendPulses
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:46-04:00 INFO metabase.task Initializing task SendFollowUpEmails
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:46-04:00 INFO metabase.task Initializing task TaskHistoryCleanup
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:46-04:00 INFO org.quartz.core.QuartzScheduler Scheduler MetabaseScheduler
$_50d21dc5cc971653338085752 started.
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:46-04:00 INFO metabase.task Task scheduler started
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:46-04:00 INFO metabase.core Metabase Initialization COMPLETE
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:34:46-04:00 INFO metabase.task.refresh-slack-channel-user-cache Slack is not configured, not refreshing slack user/channel cache.
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:48-04:00 INFO metabase.db.liquibase Database has unrun migrations. Waiting for migration lock to be cleared...
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:48-04:00 INFO metabase.db.liquibase Migration lock is cleared. Running migrations...
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:49-04:00 INFO metabase.db.setup Database Migrations Current ...
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:49-04:00 INFO metabase.db.data-migrations Running all necessary data migrations, this may take a minute.
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:49-04:00 INFO metabase.db.data-migrations Finished running data migrations.
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:49-04:00 INFO metabase.util Database setup took 7.8 s
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:49-04:00 INFO metabase.events Starting events listener: :metabase.events.dependencies/Dependencies
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:49-04:00 INFO metabase.events Starting events listener: :metabase.events.activity-feed/ActivityFeed
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:49-04:00 INFO metabase.events Starting events listener: :metabase.events.last-login/LastLogin
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:49-04:00 INFO metabase.events Starting events listener: :metabase.events.notifications/Notifications
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:49-04:00 INFO metabase.events Starting events listener: :metabase.events.sync-database/Sync
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:49-04:00 INFO metabase.events Starting events listener: :metabase.events.driver-notifications/DriverNotifications
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:49-04:00 INFO metabase.events Starting events listener: :metabase.events.revision/Revisions
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:49-04:00 INFO metabase.events Starting events listener: :metabase.events.view-log/ViewLog
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:49-04:00 INFO org.quartz.impl.StdSchedulerFactory Using default implementation for ThreadExecutor
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:49-04:00 INFO org.quartz.core.SchedulerSignalerImpl Initialized Scheduler Signaller of type: class org.quartz.core.SchedulerSignalerImpl
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:49-04:00 INFO org.quartz.core.QuartzScheduler Quartz Scheduler v.2.3.2 created.
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:49-04:00 INFO org.quartz.impl.jdbcjobstore.JobStoreTX Using db table-based data access locking (synchronization).
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:49-04:00 INFO org.quartz.impl.jdbcjobstore.JobStoreTX JobStoreTX initialized.
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:49-04:00 INFO org.quartz.core.QuartzScheduler Scheduler meta-data: Quartz Scheduler (v2.3.2) 'MetabaseScheduler' with instanceId 'd00e68a1672e1653338089651'
Scheduler class: 'org.quartz.core.QuartzScheduler' - running locally.
NOT STARTED.
Currently in standby mode.
Number of jobs executed: 0
Using thread pool 'org.quartz.simpl.SimpleThreadPool' - with 10 threads.
Using job-store 'org.quartz.impl.jdbcjobstore.JobStoreTX' - which supports persistence. and is clustered.

[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:49-04:00 INFO org.quartz.impl.StdSchedulerFactory Quartz scheduler 'MetabaseScheduler' initialized from default resource file in Quartz package: 'quartz.properties'
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:49-04:00 INFO org.quartz.impl.StdSchedulerFactory Quartz scheduler version: 2.3.2
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:49-04:00 INFO org.quartz.core.QuartzScheduler Scheduler MetabaseScheduler_$d00e68a1672e1653338089651 paused.
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:49-04:00 INFO metabase.task Task scheduler initialized into standby mode.
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:49-04:00 INFO metabase.task Initializing task SyncDatabases
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:50-04:00 INFO metabase.task.sync-databases Updated default schedules for 0 databases
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:50-04:00 INFO metabase.task Initializing task CheckForNewVersions
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:50-04:00 INFO metabase.task Initializing task SendAnonymousUsageStats
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:50-04:00 INFO metabase.task Initializing task RefreshSlackChannelsAndUsers
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:50-04:00 INFO metabase.task Initializing task SendAbandomentEmails
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:50-04:00 INFO metabase.task Initializing task SendPulses
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:50-04:00 INFO metabase.task Initializing task SendFollowUpEmails
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:50-04:00 INFO metabase.task Initializing task TaskHistoryCleanup
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:50-04:00 INFO org.quartz.core.QuartzScheduler Scheduler MetabaseScheduler
$d00e68a1672e1653338089651 started.
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:50-04:00 INFO metabase.task Task scheduler started
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:50-04:00 INFO metabase.core Metabase Initialization COMPLETE
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:34:50-04:00 INFO metabase.task.refresh-slack-channel-user-cache Slack is not configured, not refreshing slack user/channel cache.
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:35:49-04:00 INFO metabase.models.setting.cache Settings have been changed on another instance, and will be reloaded here.
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:37:01-04:00 INFO metabase.driver.impl Initializing driver :sql...
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:37:01-04:00 INFO metabase.driver.impl Initializing driver :postgres...
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:37:01-04:00 INFO metabase.driver.impl Initializing driver :sql-jdbc...
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:37:02-04:00 INFO metabase.util.i18n.impl Reading available locales from locales.clj...
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:37:02-04:00 INFO metabase.driver.impl Initializing driver :sql...
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:37:02-04:00 INFO metabase.driver.impl Initializing driver :sql-jdbc...
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:37:02-04:00 INFO metabase.driver.impl Initializing driver :postgres...
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:37:04-04:00 INFO metabase.util.i18n.impl Reading available locales from locales.clj...
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:37:04-04:00 DEBUG metabase.server.middleware.log GET /api/session/properties 200 385.3 ms (5 DB calls) App DB connections: 0/4 Jetty threads: 3/50 (4 idle, 0 queued) (40 total active threads) Queries in flight: 0 (0 queued)
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:37:05-04:00 DEBUG metabase.server.middleware.log GET /api/user/current 200 1.1 s (10 DB calls) App DB connections: 0/4 Jetty threads: 3/50 (4 idle, 0 queued) (40 total active threads) Queries in flight: 0 (0 queued)
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:37:05-04:00 DEBUG metabase.server.middleware.log GET /api/bookmark 200 141.6 ms (1 DB calls) App DB connections: 0/4 Jetty threads: 4/50 (3 idle, 0 queued) (41 total active threads) Queries in flight: 0 (0 queued)
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:37:05-04:00 DEBUG metabase.server.middleware.log GET /api/database 200 152.2 ms (3 DB calls) App DB connections: 1/4 Jetty threads: 6/50 (2 idle, 0 queued) (42 total active threads) Queries in flight: 0 (0 queued)
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:37:05-04:00 DEBUG metabase.server.middleware.log GET /api/collection/tree 200 254.4 ms (19 DB calls) App DB connections: 0/4 Jetty threads: 3/50 (4 idle, 0 queued) (41 total active threads) Queries in flight: 0 (0 queued)
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:37:06-04:00 DEBUG metabase.server.middleware.log GET /api/activity/recent_views 200 716.3 ms (8 DB calls) App DB connections: 0/4 Jetty threads: 5/50 (3 idle, 0 queued) (42 total active threads) Queries in flight: 0 (0 queued)
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:37:06-04:00 DEBUG metabase.server.middleware.log GET /api/activity/popular_items 200 852.6 ms (10 DB calls) App DB connections: 1/4 Jetty threads: 4/50 (4 idle, 0 queued) (42 total active threads) Queries in flight: 0 (0 queued)
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:37:06-04:00 DEBUG metabase.server.middleware.log GET /api/collection/root 200 905.4 ms (2 DB calls) App DB connections: 0/4 Jetty threads: 4/50 (4 idle, 0 queued) (42 total active threads) Queries in flight: 0 (0 queued)
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:37:09-04:00 DEBUG metabase.server.middleware.log GET /api/dashboard/26 200 257.2 ms (13 DB calls) App DB connections: 1/4 Jetty threads: 3/50 (5 idle, 0 queued) (42 total active threads) Queries in flight: 0 (0 queued)
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:37:09-04:00 DEBUG metabase.server.middleware.log GET /api/database/8/schemas 200 22.5 ms (4 DB calls) App DB connections: 0/4 Jetty threads: 3/50 (5 idle, 0 queued) (42 total active threads) Queries in flight: 0 (0 queued)
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:37:10-04:00 INFO metabase.driver.impl Initializing driver :bigquery-cloud-sdk...
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:37:10-04:00 INFO metabase.plugins.classloader Added URL file:/plugins/bigquery-cloud-sdk.metabase-driver.jar to classpath
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:37:10-04:00 DEBUG metabase.plugins.init-steps Loading plugin namespace metabase.driver.bigquery-cloud-sdk...
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:37:10-04:00 INFO metabase.driver.impl Registered driver :bigquery-cloud-sdk (parents: [:sql])
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:37:10-04:00 INFO metabase.util Load lazy loading driver :bigquery-cloud-sdk took 252.3 ms
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:37:10-04:00 DEBUG metabase.server.middleware.log GET /api/table/card__45/query_metadata 200 1.0 s (9 DB calls) App DB connections: 0/4 Jetty threads: 3/50 (4 idle, 0 queued) (41 total active threads) Queries in flight: 0 (0 queued)
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:37:11-04:00 DEBUG metabase.server.middleware.log GET /api/table/77/query_metadata 200 297.1 ms (8 DB calls) App DB connections: 0/4 Jetty threads: 3/50 (4 idle, 0 queued) (41 total active threads) Queries in flight: 0 (0 queued)
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:37:11-04:00 INFO metabase.driver.impl Initializing driver :bigquery-cloud-sdk...
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:37:11-04:00 INFO metabase.plugins.classloader Added URL file:/plugins/bigquery-cloud-sdk.metabase-driver.jar to classpath
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:37:11-04:00 DEBUG metabase.plugins.init-steps Loading plugin namespace metabase.driver.bigquery-cloud-sdk...
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:37:12-04:00 INFO metabase.driver.impl Registered driver :bigquery-cloud-sdk (parents: [:sql])
[0bd400fa-5729-404e-b2f9-7213f7b6dda4] 2022-05-23T16:37:12-04:00 INFO metabase.util Load lazy loading driver :bigquery-cloud-sdk took 230.3 ms
[b4c2ce11-1d1a-48da-8cab-44dfaa7df28b] 2022-05-23T16:37:12-04:00 ERROR metabase.query-processor.middleware.catch-exceptions Error processing query: null
{:database_id 8,
:started_at #t "2022-05-23T20:37:11.910057Z[UTC]",
:json_query
{:constraints {:max-results 10000, :max-results-bare-rows 2000},
:type :native,
:middleware {:js-int-to-string? true, :ignore-cached-results? false},
:native
{:query
"REDACTED",
:template-tags {}},
:database 8,
:parameters [],
:async? true,
:cache-ttl nil},
:status :failed,
:class java.lang.NoClassDefFoundError,
:stacktrace
["--> driver.bigquery_cloud_sdk$database__GT_client.invokeStatic(bigquery_cloud_sdk.clj:48)"
"driver.bigquery_cloud_sdk$database__GT_client.invoke(bigquery_cloud_sdk.clj:45)"
"driver.bigquery_cloud_sdk$execute_bigquery_on_db.invokeStatic(bigquery_cloud_sdk.clj:220)"
"driver.bigquery_cloud_sdk$execute_bigquery_on_db.invoke(bigquery_cloud_sdk.clj:217)"
"driver.bigquery_cloud_sdk$process_native_STAR
$thunk__83556.invoke(bigquery_cloud_sdk.clj:279)"
"driver.bigquery_cloud_sdk$process_native_STAR_.invokeStatic(bigquery_cloud_sdk.clj:291)"
"driver.bigquery_cloud_sdk$process_native_STAR_.invoke(bigquery_cloud_sdk.clj:271)"
"driver.bigquery_cloud_sdk$fn__83562.invokeStatic(bigquery_cloud_sdk.clj:307)"
"driver.bigquery_cloud_sdk$fn__83562.invoke(bigquery_cloud_sdk.clj:299)"
"query_processor.context$executef.invokeStatic(context.clj:59)"
"query_processor.context$executef.invoke(context.clj:48)"
"query_processor.context.default$default_runf.invokeStatic(default.clj:67)"
"query_processor.context.default$default_runf.invoke(default.clj:65)"
"query_processor.context$runf.invokeStatic(context.clj:45)"
"query_processor.context$runf.invoke(context.clj:39)"
"query_processor.reducible$identity_qp.invokeStatic(reducible.clj:12)"
"query_processor.reducible$identity_qp.invoke(reducible.clj:9)"
"query_processor.middleware.cache$maybe_return_cached_results$maybe_return_cached_results_STAR___51883.invoke(cache.clj:220)"
"query_processor.middleware.permissions$check_query_permissions$fn__47199.invoke(permissions.clj:109)"
"query_processor.middleware.mbql_to_native$mbql__GT_native$fn__50138.invoke(mbql_to_native.clj:23)"
"query_processor$fn__53356$combined_post_process__53361$combined_post_process_STAR___53362.invoke(query_processor.clj:207)"
"query_processor$fn__53356$combined_pre_process__53357$combined_pre_process_STAR___53358.invoke(query_processor.clj:204)"
"query_processor.middleware.resolve_database_and_driver$resolve_database_and_driver$fn__51804$fn__51809.invoke(resolve_database_and_driver.clj:35)"
"driver$do_with_driver.invokeStatic(driver.clj:75)"
"driver$do_with_driver.invoke(driver.clj:71)"
"query_processor.middleware.resolve_database_and_driver$resolve_database_and_driver$fn__51804.invoke(resolve_database_and_driver.clj:34)"
"query_processor.middleware.fetch_source_query$resolve_card_id_source_tables$fn__47442.invoke(fetch_source_query.clj:281)"
"query_processor.middleware.store$initialize_store$fn__47984$fn__47985.invoke(store.clj:11)"
"query_processor.store$do_with_store.invokeStatic(store.clj:44)"
"query_processor.store$do_with_store.invoke(store.clj:38)"
"query_processor.middleware.store$initialize_store$fn__47984.invoke(store.clj:10)"
"query_processor.middleware.normalize_query$normalize$fn__52076.invoke(normalize_query.clj:22)"
"query_processor.middleware.constraints$add_default_userland_constraints$fn__48949.invoke(constraints.clj:52)"
"query_processor.middleware.process_userland_query$process_userland_query$fn__52015.invoke(process_userland_query.clj:145)"
"query_processor.middleware.catch_exceptions$catch_exceptions$fn__52387.invoke(catch_exceptions.clj:162)"
"query_processor.reducible$async_qp$qp_STAR___44169$thunk__44171.invoke(reducible.clj:100)"
"query_processor.reducible$async_qp$qp_STAR___44169$fn__44173.invoke(reducible.clj:105)"],
:card_id 81,
:context :dashboard,
:error "Could not initialize class com.google.cloud.bigquery.BigQueryOptions",
:row_count 0,
:running_time 0,
:data {:rows [], :cols []}}

I pulled the Uber jar and verified that the class is contained in bigquery-cloud-sdk.metabase-driver.jar:

$ jar -t < modules/bigquery-cloud-sdk.metabase-driver.jar | grep BigQueryOptions
com/google/cloud/bigquery/BigQueryOptions.class
com/google/cloud/bigquery/BigQueryOptions$1.class
com/google/cloud/bigquery/BigQueryOptions$DefaultBigQueryFactory.class
com/google/cloud/bigquery/BigQueryOptions$DefaultBigQueryRpcFactory.class
com/google/cloud/bigquery/BigQueryOptions$BigQueryDefaults.class
com/google/cloud/bigquery/BigQueryOptions$Builder.class

Any idea what might be causing the issue?

Adding the BigQuery dependency in the main deps.edn seems to have resolved the issue. I'm still not sure why this is needed though.

Hi @t12y
If you try an official release instead of a custom build, are you seeing the same errors there?
I've not seen this error before, so right now I guess it's something to do with your build.

@flamber Unfortunately, we're unable to use an official build due to https://github.com/metabase/metabase/pull/19302.

The issue definitely could be something in our build pipeline, though I'm not sure what it could be since we've not changed anything recently. We're using GitlabCI to build / deploy new versions and it has been working fine up until v0.43.1 (we skipped v0.43.0). We just just run bin/build unmodified and deploy the resulting target/uberjar/metabase.jar. Obviously, if no one else is experiencing this issue then it must be something in our env. We'll continue to investigate and will report back if we find the issue.

Thanks for your response.

@t12y I have a feeling that you are including old drivers, which were build on different commit, into the uberjar. Try doing a completely new repo clone and only make the single commit modification.

@flamber We're not do any caching in the CI pipeline (i.e. it does a fresh checkout / build each time). I also pulled down the v0.43.1 uber jar that was deployed / caused this error to double check:

$ ls -1 modules/
bigquery-cloud-sdk.metabase-driver.jar
druid.metabase-driver.jar
googleanalytics.metabase-driver.jar
mongo.metabase-driver.jar
oracle.metabase-driver.jar
presto-common.metabase-driver.jar
presto-jdbc.metabase-driver.jar
presto.metabase-driver.jar
redshift.metabase-driver.jar
snowflake.metabase-driver.jar
sparksql.metabase-driver.jar
sqlite.metabase-driver.jar
sqlserver.metabase-driver.jar
vertica.metabase-driver.jar

Seems there is only one BigQuery driver in the uber jar. Thanks for the idea though!