Hello all.
I can't seem to get the SparkSQL connector working. According to Querying hive from metabase using sparksql - #6 by akila it should work with Hive, right?
My setup is all local. I have a minimal Hive server in the form of a Docker container that I can connect to and query perfectly fine with beeline -u jdbc:hive2://localhost:10000
. But neither the macOS App nor the .jar want to connect to it. I did put the metabase-sparksql-deps-1.2.1.spark2-standalone.jar
in the plugin folders (and set the env var respectively).
With the macOS App it seems to connect fine, but when I open the database, I can't see any table:
I tried syncing and scanning and don't get any errors, but it doesn't help.
With the running .jar I get java.sql.SQLException: Could not open client transport with JDBC Uri: jdbc:hive2://localhost:10000/default: java.net.ConnectException: Connection refused (Connection refused)
when trying to 'Save'. I've also had "Server error encountered" before, but I can't replicate that. I'll paste the concole output below.
All components are the most recent version, at least I hope. Downloaded both .jars yesterday, updated the macOS App yesterday and today.
Now what do I do? Where can I find additional logs (other than in the 'Console' app, which doesn't contain anything useful)?
Thanks in advance!
-Elisa
$ java -jar metabase.jar
05-14 14:33:10 INFO metabase.util :: Loading Metabase...
05-14 14:33:10 INFO metabase.util :: Maximum memory available to JVM: 3.6 GB
05-14 14:33:14 INFO util.encryption :: Saved credentials encryption is DISABLED for this Metabase instance. π
For more information, see https://metabase.com/docs/latest/operations-guide/start.html#encrypting-your-database-connection-details-at-rest
05-14 14:33:17 INFO metabase.driver :: Registered abstract driver :sql π
05-14 14:33:23 INFO metabase.core :: Starting Metabase in STANDALONE mode
05-14 14:33:23 INFO metabase.server :: Launching Embedded Jetty Webserver with config:
{:port 3000}
05-14 14:33:24 INFO metabase.core :: Starting Metabase version v0.32.7 (e309f28 release-0.32.x) ...
05-14 14:33:24 INFO metabase.core :: System timezone is 'Europe/Berlin' ...
05-14 14:33:24 INFO metabase.plugins :: Loading plugins in /Users/elisae/themenmanagement/metabase/plugins...
05-14 14:33:24 DEBUG plugins.classloader :: Setting current thread context classloader to NEWLY CREATED classloader clojure.lang.DynamicClassLoader@1a445b5...
05-14 14:33:24 INFO plugins.classloader :: Added URL file:/Users/elisae/themenmanagement/metabase/plugins/metabase-sparksql-deps-1.2.1.spark2-standalone.jar to classpath
05-14 14:33:24 INFO plugins.dependencies :: Plugin 'Metabase Google Analytics Driver' depends on plugin 'Metabase Google Drivers Shared Dependencies'
05-14 14:33:24 INFO plugins.dependencies :: Metabase Google Analytics Driver dependency {:plugin Metabase Google Drivers Shared Dependencies} satisfied? false
05-14 14:33:24 INFO plugins.dependencies :: Plugins with unsatisfied deps: ["Metabase Google Analytics Driver"]
05-14 14:33:24 INFO plugins.lazy-loaded-driver :: Registering lazy loading driver :snowflake...
05-14 14:33:24 INFO metabase.driver :: Registered abstract driver :sql-jdbc (parents: :sql) π
Load driver :sql-jdbc took 52 ms
05-14 14:33:24 INFO metabase.driver :: Registered driver :snowflake (parents: #{:sql-jdbc}) π
05-14 14:33:25 INFO plugins.dependencies :: Metabase cannot initialize plugin Metabase Oracle Driver due to required dependencies. Metabase requires the Oracle JDBC driver in order to connect to Oracle databases, but we can't ship it as part of Metabase due to licensing restrictions. See https://metabase.com/docs/latest/administration-guide/databases/oracle.html for more details.
05-14 14:33:25 INFO plugins.dependencies :: Metabase Oracle Driver dependency {:class oracle.jdbc.OracleDriver} satisfied? false
05-14 14:33:25 INFO plugins.dependencies :: Plugins with unsatisfied deps: ["Metabase Oracle Driver" "Metabase Google Analytics Driver"]
05-14 14:33:25 INFO plugins.lazy-loaded-driver :: Registering lazy loading driver :google...
05-14 14:33:25 INFO metabase.driver :: Registered abstract driver :google π
05-14 14:33:25 INFO plugins.dependencies :: Metabase Google Analytics Driver dependency {:plugin Metabase Google Drivers Shared Dependencies} satisfied? true
05-14 14:33:25 DEBUG plugins.initialize :: Dependencies satisfied; these plugins will now be loaded: ["Metabase Google Analytics Driver"]
05-14 14:33:25 INFO plugins.lazy-loaded-driver :: Registering lazy loading driver :googleanalytics...
05-14 14:33:25 INFO metabase.driver :: Registered driver :googleanalytics (parents: #{:google}) π
05-14 14:33:25 INFO plugins.lazy-loaded-driver :: Registering lazy loading driver :mongo...
05-14 14:33:25 INFO metabase.driver :: Registered driver :mongo π
05-14 14:33:25 INFO plugins.lazy-loaded-driver :: Registering lazy loading driver :druid...
05-14 14:33:25 INFO metabase.driver :: Registered driver :druid π
05-14 14:33:25 INFO plugins.lazy-loaded-driver :: Registering lazy loading driver :presto...
05-14 14:33:25 INFO metabase.driver :: Registered driver :presto (parents: #{:sql}) π
05-14 14:33:25 INFO plugins.lazy-loaded-driver :: Registering lazy loading driver :redshift...
05-14 14:33:25 INFO metabase.driver :: Registered driver :postgres (parents: :sql-jdbc) π
Load driver :postgres took 729 ms
05-14 14:33:25 INFO metabase.driver :: Registered driver :redshift (parents: #{:postgres}) π
05-14 14:33:25 INFO plugins.dependencies :: Metabase cannot initialize plugin Metabase Vertica Driver due to required dependencies. Metabase requires the Vertica JDBC driver in order to connect to Vertica databases, but we can't ship it as part of Metabase due to licensing restrictions. See https://metabase.com/docs/latest/administration-guide/databases/vertica.html for more details.
05-14 14:33:25 INFO plugins.dependencies :: Metabase Vertica Driver dependency {:class com.vertica.jdbc.Driver} satisfied? false
05-14 14:33:25 INFO plugins.dependencies :: Plugins with unsatisfied deps: ["Metabase Oracle Driver" "Metabase Vertica Driver"]
05-14 14:33:25 INFO plugins.lazy-loaded-driver :: Registering lazy loading driver :sqlite...
05-14 14:33:25 INFO metabase.driver :: Registered driver :sqlite (parents: #{:sql-jdbc}) π
05-14 14:33:25 INFO plugins.lazy-loaded-driver :: Registering lazy loading driver :sqlserver...
05-14 14:33:25 INFO metabase.driver :: Registered driver :sqlserver (parents: #{:sql-jdbc}) π
05-14 14:33:26 INFO plugins.dependencies :: Plugin 'Metabase BigQuery Driver' depends on plugin 'Metabase Google Drivers Shared Dependencies'
05-14 14:33:26 INFO plugins.dependencies :: Metabase BigQuery Driver dependency {:plugin Metabase Google Drivers Shared Dependencies} satisfied? true
05-14 14:33:26 INFO plugins.lazy-loaded-driver :: Registering lazy loading driver :bigquery...
05-14 14:33:26 INFO metabase.driver :: Registered driver :bigquery (parents: #{:sql :google}) π
05-14 14:33:26 INFO plugins.lazy-loaded-driver :: Registering lazy loading driver :hive-like...
05-14 14:33:26 INFO metabase.driver :: Registered abstract driver :hive-like (parents: #{:sql-jdbc}) π
05-14 14:33:26 INFO plugins.lazy-loaded-driver :: Registering lazy loading driver :sparksql...
05-14 14:33:26 INFO metabase.driver :: Registered driver :sparksql (parents: #{:hive-like}) π
05-14 14:33:26 INFO metabase.driver :: Registered driver :mysql (parents: :sql-jdbc) π
Load driver :mysql took 17 ms
05-14 14:33:26 INFO metabase.driver :: Registered driver :h2 (parents: :sql-jdbc) π
Load driver :h2 took 22 ms
05-14 14:33:26 INFO metabase.core :: Setting up and migrating Metabase DB. Please sit tight, this may take a minute...
05-14 14:33:26 WARN metabase.db :: WARNING: Using Metabase with an H2 application database is not recommended for production deployments. For production deployments, we highly recommend using Postgres, MySQL, or MariaDB instead. If you decide to continue to use H2, please be sure to back up the database file regularly. See https://metabase.com/docs/latest/operations-guide/start.html#migrating-from-using-the-h2-database-to-mysql-or-postgres for more information.
05-14 14:33:26 INFO metabase.db :: Verifying h2 Database Connection ...
05-14 14:33:26 INFO metabase.driver :: Initializing driver :sql...
05-14 14:33:26 INFO metabase.driver :: Initializing driver :sql-jdbc...
05-14 14:33:26 INFO metabase.driver :: Initializing driver :h2...
05-14 14:33:26 INFO metabase.db :: Verify Database Connection ... β
05-14 14:33:26 INFO metabase.db :: Running Database Migrations...
05-14 14:33:26 INFO metabase.db :: Setting up Liquibase...
05-14 14:33:27 INFO metabase.db :: Liquibase is ready.
05-14 14:33:27 INFO metabase.db :: Checking if Database has unrun migrations...
05-14 14:33:28 INFO metabase.db :: Database Migrations Current ... β
05-14 14:33:28 INFO db.migrations :: Running all necessary data migrations, this may take a minute.
05-14 14:33:28 INFO db.migrations :: Finished running data migrations.
05-14 14:33:28 INFO metabase.events :: Starting events listener: metabase.events.notifications π
05-14 14:33:28 INFO metabase.events :: Starting events listener: metabase.events.metabot-lifecycle π
05-14 14:33:28 INFO metabase.events :: Starting events listener: metabase.events.dependencies π
05-14 14:33:28 INFO metabase.events :: Starting events listener: metabase.events.activity-feed π
05-14 14:33:28 INFO metabase.events :: Starting events listener: metabase.events.last-login π
05-14 14:33:28 INFO metabase.events :: Starting events listener: metabase.events.revision π
05-14 14:33:28 INFO metabase.events :: Starting events listener: metabase.events.sync-database π
05-14 14:33:28 INFO metabase.events :: Starting events listener: metabase.events.view-log π
05-14 14:33:28 INFO metabase.events :: Starting events listener: metabase.events.driver-notifications π
05-14 14:33:28 INFO metabase.task :: Initializing task SyncDatabases π
05-14 14:33:28 INFO task.send-pulses :: Sending scheduled pulses...
05-14 14:33:28 INFO task.send-pulses :: Sending scheduled pulses...
05-14 14:33:28 INFO task.send-pulses :: Sending scheduled pulses...
05-14 14:33:28 INFO task.send-pulses :: Sending scheduled pulses...
05-14 14:33:29 INFO task.send-pulses :: Sending scheduled pulses...
05-14 14:33:29 DEBUG sync.util :: Sync operations in flight: {:sync-metadata #{1}}
05-14 14:33:29 INFO sync.util :: STARTING: Sync metadata for h2 Database 1 'Sample Dataset'
05-14 14:33:29 DEBUG sync.util :: STARTING: step 'sync-timezone' for h2 Database 1 'Sample Dataset'
05-14 14:33:29 INFO metabase.task :: Initializing task CheckForNewVersions π
05-14 14:33:29 INFO metabase.task :: Initializing task SendAnonymousUsageStats π
05-14 14:33:29 INFO metabase.task :: Initializing task SendAbandomentEmails π
05-14 14:33:29 INFO metabase.task :: Initializing task SendPulses π
05-14 14:33:29 INFO metabase.task :: Initializing task SendFollowUpEmails π
05-14 14:33:29 INFO metabase.task :: Initializing task TaskHistoryCleanup π
05-14 14:33:29 INFO metabase.core :: Looks like this is a new installation ... preparing setup wizard
05-14 14:33:29 INFO metabase.core :: Please use the following URL to setup your Metabase installation:
http://localhost:3000/setup/
```