Sync Issues with BQ

Get Help
1

I’ve just set up the docker image and pointed it at my bigquery data. The data model is not set yet, so as I learn things about Metabase I make some changes to the schema in BQ. (IE metabase seems not to be able to access bq struct fields)

Metabase doesn’t pick up these changes, even after going to admin->database->(my dataset) and clicking both the “sync schema” and “sync fields” buttons. IE I created a new view over an hour ago, and it now shows up on the home page; but when I click “ask a question” that view is not available in the “Pick your starting point” drop down.

How can I get all parts of Metabase to sync up?

2

Hi @AccurateHamilton
Please post “Diagnostic Info” from Admin > Troubleshooting.
There has been a lot of fixes lately to the sync process, but you might still see some errors in the log during the sync - Admin > Troubleshooting > Logs.
I know we still have some issues with Views on Redshift and MySQL, but I don’t know if this issue is still valid:
https://github.com/metabase/metabase/issues/9428

3

I’ve put the diag info into the block below, but it appears the update did finally come through sometime in the last couple hours. I didn’t see any errors in the logs, but it looks like there may be some progress messages in the logs I can use to gauge where its at in the process. (I had assumed that when the button changed back to its “Sync Now” state, that meant the sync was complete). Thanks for your help.

{
  "browser-info": {
    "language": "en-US",
    "platform": "Linux x86_64",
    "userAgent": "Mozilla/5.0 (X11; Linux x86_64; rv:76.0) Gecko/20100101 Firefox/76.0",
    "vendor": ""
  },
  "system-info": {
    "file.encoding": "UTF-8",
    "java.runtime.name": "OpenJDK Runtime Environment",
    "java.runtime.version": "11.0.8+10",
    "java.vendor": "AdoptOpenJDK",
    "java.vendor.url": "https://adoptopenjdk.net/",
    "java.version": "11.0.8",
    "java.vm.name": "OpenJDK 64-Bit Server VM",
    "java.vm.version": "11.0.8+10",
    "os.name": "Linux",
    "os.version": "4.15.0-1039-aws",
    "user.language": "en",
    "user.timezone": "GMT"
  },
  "metabase-info": {
    "databases": [
      "h2",
      "bigquery"
    ],
    "hosting-env": "unknown",
    "application-database": "h2",
    "application-database-details": {
      "database": {
        "name": "H2",
        "version": "1.4.197 (2018-03-18)"
      },
      "jdbc-driver": {
        "name": "H2 JDBC Driver",
        "version": "1.4.197 (2018-03-18)"
      }
    },
    "run-mode": "prod",
    "version": {
      "date": "2020-08-17",
      "tag": "v0.36.4",
      "branch": "release-0.36.x",
      "hash": "196c1f6"
    },
    "settings": {
      "report-timezone": null
    }
  }
}
4

@AccurateHamilton No, currently the progress of the sync/scan procedures isn’t available in the UI. Depending on your database size, this can take anything from a few seconds to several hours.
https://github.com/metabase/metabase/issues/11354 - upvote by clicking :+1: on the first post

By the way, remember to migrate away from H2 if you’re using Metabase in production:
https://www.metabase.com/docs/latest/operations-guide/migrating-from-h2.html