Avoid Database sync

Hello,

I have connected to a Presto server, and I want to avoid the database sync, as there are many tables and it is blocking the other queries.

I followed the steps mentioned here: I want to stop auto scanning for tables in metabase

Where in I updated the 'has_field_values' from 'metabase_field' table to 'none'. But it did not work.

Could you please help?

Thanks.

Hi @Anuraag

Post "Diagnostic Info" from Admin > Troubleshooting.

Post the queries blocking, since you're asking for disabling sync, but referencing a topic about scan.

And what are your settings in Scheduling?
https://www.metabase.com/docs/latest/administration-guide/01-managing-databases.html#choose-when-metabase-syncs-and-scans

@flamber, @shadma even I am getting this issue, where the scans are not getting disabled.
I have updated the column 'has_field_value' to 'none', still that didn't work for me.
Could you please help me?

Thanks!

{
"browser-info": {
"language": "en-GB",
"platform": "MacIntel",
"userAgent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/96.0.4664.93 Safari/537.36",
"vendor": "Google Inc."
},
"system-info": {
"file.encoding": "UTF-8",
"java.runtime.name": "OpenJDK Runtime Environment",
"java.runtime.version": "11.0.8+10-LTS",
"java.vendor": "Amazon.com Inc.",
"java.vendor.url": "https://aws.amazon.com/corretto/",
"java.version": "11.0.8",
"java.vm.name": "OpenJDK 64-Bit Server VM",
"java.vm.version": "11.0.8+10-LTS",
"os.name": "Linux",
"os.version": "5.4.0-1060-aws",
"user.language": "en",
"user.timezone": "Asia/Kolkata"
},
"metabase-info": {
"databases": [
"h2",
"presto"
],
"hosting-env": "unknown",
"application-database": "postgres",
"application-database-details": {
"database": {
"name": "PostgreSQL",
"version": "12.8"
},
"jdbc-driver": {
"name": "PostgreSQL JDBC Driver",
"version": "42.2.23"
}
},
"run-mode": "prod",
"version": {
"date": "2021-12-10",
"tag": "v0.41.4",
"branch": "release-x.41.4",
"hash": "471cfb9"
},
"settings": {
"report-timezone": null
}
}
}

@flamber,

These are the scheduling settings.

@Anuraag And now post the queries you're seeing. I would probably also recommend that you switch to the newer Presto driver, which is much faster than the old one.

@flamber,

SELECT TRUE AS "_" FROM "schema_name"."table_name" WHERE 1 <> 1 LIMIT 0

This is the query I see on the server.

Also for the driver, I tried with the latest Presto driver, but it didnt work, so had to use the deprecated driver.

@flamber,

It is running in a burst, like this:


Which I basically need to avoid.
The Running Queries number goes beyond this.

@flamber

Apart from SELECT queries, I'm also seeing below queries:

DESCRIBE "catalog_name"."schema_name"."table_name"

@Anuraag Post exactly which Presto type and version you're using.
If no one reports problems with the new driver, then we have absolutely no way of knowing there's problems.

It's very important to understand the difference between sync and scan.

The SELECT TRUE AS "_"... query is part of sync and is used to detect the a table exists and can be queried.
It should only run daily, as that is what you have selected.

@flamber,

While using the latest presto driver, I'm getting Timed out error message.

java.util.concurrent.TimeoutException: Timed out after 10.0 s at metabase.util$deref_with_timeout.invokeStatic(util.clj:345) at metabase.util$deref_with_timeout.invoke(util.clj:337) at metabase.util$do_with_timeout.invokeStatic(util.clj:351) at metabase.util$do_with_timeout.invoke(util.clj:348) at metabase.driver.util$can_connect_with_details_QMARK_.invokeStatic(util.clj:42) at metabase.driver.util$can_connect_with_details_QMARK_.doInvoke(util.clj:31) at clojure.lang.RestFn.invoke(RestFn.java:442) at metabase.api.database$test_database_connection.invokeStatic(database.clj:421) at metabase.api.database$test_database_connection.doInvoke(database.clj:411) at clojure.lang.RestFn.invoke(RestFn.java:425) at metabase.api.database$fn__77076$test_connection_details__77081$fn__77082.invoke(database.clj:460) at metabase.api.database$fn__77076$test_connection_details__77081.invoke(database.clj:450) at metabase.api.database$fn__77113.invokeStatic(database.clj:519) at metabase.api.database$fn__77113.invoke(database.clj:512) at compojure.core$wrap_response$fn__32066.invoke(core.clj:160) at compojure.core$wrap_route_middleware$fn__32050.invoke(core.clj:132) at compojure.core$wrap_route_info$fn__32055.invoke(core.clj:139) at compojure.core$wrap_route_matches$fn__32059.invoke(core.clj:151) at compojure.core$routes$fn__32078$f__32079.invoke(core.clj:198) at compojure.core$routes$fn__32078$f__32079$respond_SINGLEQUOTE___32080.invoke(core.clj:197) at compojure.core$wrap_route_matches$fn__32059.invoke(core.clj:153) at compojure.core$routes$fn__32078$f__32079.invoke(core.clj:198) at compojure.core$routes$fn__32078$f__32079$respond_SINGLEQUOTE___32080.invoke(core.clj:197) at compojure.core$wrap_route_matches$fn__32059.invoke(core.clj:152) at compojure.core$routes$fn__32078$f__32079.invoke(core.clj:198) at compojure.core$routes$fn__32078$f__32079$respond_SINGLEQUOTE___32080.invoke(core.clj:197) at compojure.core$wrap_route_matches$fn__32059.invoke(core.clj:152) at compojure.core$routes$fn__32078$f__32079.invoke(core.clj:198) at compojure.core$routes$fn__32078$f__32079$respond_SINGLEQUOTE___32080.invoke(core.clj:197) at compojure.core$wrap_route_matches$fn__32059.invoke(core.clj:152) at compojure.core$routes$fn__32078$f__32079.invoke(core.clj:198) at compojure.core$routes$fn__32078$f__32079$respond_SINGLEQUOTE___32080.invoke(core.clj:197) at compojure.core$wrap_route_matches$fn__32059.invoke(core.clj:153) at compojure.core$routes$fn__32078$f__32079.invoke(core.clj:198) at compojure.core$routes$fn__32078$f__32079$respond_SINGLEQUOTE___32080.invoke(core.clj:197) at compojure.core$wrap_route_matches$fn__32059.invoke(core.clj:152) at compojure.core$routes$fn__32078$f__32079.invoke(core.clj:198) at compojure.core$routes$fn__32078.invoke(core.clj:200) at metabase.server.middleware.auth$enforce_authentication$fn__70282.invoke(auth.clj:14) at compojure.core$routes$fn__32078$f__32079.invoke(core.clj:198) at compojure.core$routes$fn__32078.invoke(core.clj:200) at compojure.core$make_context$handler__32106.invoke(core.clj:289) at compojure.core$make_context$fn__32110.invoke(core.clj:299) at compojure.core$routes$fn__32078$f__32079.invoke(core.clj:198) at compojure.core$routes$fn__32078$f__32079$respond_SINGLEQUOTE___32080.invoke(core.clj:197) at compojure.core$make_context$fn__32110.invoke(core.clj:300) at compojure.core$routes$fn__32078$f__32079.invoke(core.clj:198) at compojure.core$routes$fn__32078$f__32079$respond_SINGLEQUOTE___32080.invoke(core.clj:197) at compojure.core$make_context$fn__32110.invoke(core.clj:300) at compojure.core$routes$fn__32078$f__32079.invoke(core.clj:198) at compojure.core$routes$fn__32078$f__32079$respond_SINGLEQUOTE___32080.invoke(core.clj:197) at compojure.core$make_context$fn__32110.invoke(core.clj:300) at compojure.core$routes$fn__32078$f__32079.invoke(core.clj:198) at compojure.core$routes$fn__32078$f__32079$respond_SINGLEQUOTE___32080.invoke(core.clj:197) at compojure.core$make_context$fn__32110.invoke(core.clj:300) at compojure.core$routes$fn__32078$f__32079.invoke(core.clj:198) at compojure.core$routes$fn__32078$f__32079$respond_SINGLEQUOTE___32080.invoke(core.clj:197) at compojure.core$make_context$fn__32110.invoke(core.clj:300) at compojure.core$routes$fn__32078$f__32079.invoke(core.clj:198) at compojure.core$routes$fn__32078$f__32079$respond_SINGLEQUOTE___32080.invoke(core.clj:197) at compojure.core$make_context$fn__32110.invoke(core.clj:300) at compojure.core$routes$fn__32078$f__32079.invoke(core.clj:198) at compojure.core$routes$fn__32078$f__32079$respond_SINGLEQUOTE___32080.invoke(core.clj:197) at metabase.api.routes$fn__79759$fn__79762.invoke(routes.clj:56) at compojure.core$routes$fn__32078$f__32079.invoke(core.clj:198) at compojure.core$routes$fn__32078.invoke(core.clj:200) at clojure.lang.AFn.applyToHelper(AFn.java:160) at clojure.lang.AFn.applyTo(AFn.java:144) at clojure.core$apply.invokeStatic(core.clj:667) at clojure.core$apply.invoke(core.clj:662) at metabase.server.routes$fn__79904$fn__79905.doInvoke(routes.clj:57) at clojure.lang.RestFn.invoke(RestFn.java:436) at compojure.core$routes$fn__32078$f__32079.invoke(core.clj:198) at compojure.core$routes$fn__32078.invoke(core.clj:200) at compojure.core$make_context$handler__32106.invoke(core.clj:289) at compojure.core$make_context$fn__32110.invoke(core.clj:299) at compojure.core$routes$fn__32078$f__32079.invoke(core.clj:198) at compojure.core$routes$fn__32078$f__32079$respond_SINGLEQUOTE___32080.invoke(core.clj:197) at compojure.core$wrap_route_matches$fn__32059.invoke(core.clj:153) at compojure.core$routes$fn__32078$f__32079.invoke(core.clj:198) at compojure.core$routes$fn__32078$f__32079$respond_SINGLEQUOTE___32080.invoke(core.clj:197) at compojure.core$wrap_route_matches$fn__32059.invoke(core.clj:153) at compojure.core$routes$fn__32078$f__32079.invoke(core.clj:198) at compojure.core$routes$fn__32078$f__32079$respond_SINGLEQUOTE___32080.invoke(core.clj:197) at compojure.core$wrap_route_matches$fn__32059.invoke(core.clj:153) at compojure.core$routes$fn__32078$f__32079.invoke(core.clj:198) at compojure.core$routes$fn__32078$f__32079$respond_SINGLEQUOTE___32080.invoke(core.clj:197) at metabase.server.routes$fn__79892$fn__79894.invoke(routes.clj:41) at compojure.core$routes$fn__32078$f__32079.invoke(core.clj:198) at compojure.core$routes$fn__32078.invoke(core.clj:200) at metabase.server.middleware.exceptions$catch_uncaught_exceptions$fn__77364.invoke(exceptions.clj:98) at metabase.server.middleware.exceptions$catch_api_exceptions$fn__77361.invoke(exceptions.clj:86) at metabase.server.middleware.log$log_api_call$fn__80359$fn__80360$fn__80361.invoke(log.clj:209) at metabase.driver.sql_jdbc.execute.diagnostic$do_with_diagnostic_info.invokeStatic(diagnostic.clj:15) at metabase.driver.sql_jdbc.execute.diagnostic$do_with_diagnostic_info.invoke(diagnostic.clj:9) at metabase.server.middleware.log$log_api_call$fn__80359$fn__80360.invoke(log.clj:201) at toucan.db$_do_with_call_counting.invokeStatic(db.clj:216) at toucan.db$_do_with_call_counting.invoke(db.clj:209) at metabase.server.middleware.log$log_api_call$fn__80359.invoke(log.clj:200) at metabase.server.middleware.browser_cookie$ensure_browser_id_cookie$fn__83572.invoke(browser_cookie.clj:30) at metabase.server.middleware.security$add_security_headers$fn__59226.invoke(security.clj:147) at metabase.server.middleware.json$wrap_json_body$fn__82716.invoke(json.clj:62) at metabase.server.middleware.json$wrap_streamed_json_response$fn__82734.invoke(json.clj:98) at metabase.server.middleware.offset_paging$handle_paging$fn__59250.invoke(offset_paging.clj:42) at ring.middleware.keyword_params$wrap_keyword_params$fn__83839.invoke(keyword_params.clj:55) at ring.middleware.params$wrap_params$fn__83855.invoke(params.clj:69) at metabase.server.middleware.misc$maybe_set_site_url$fn__34077.invoke(misc.clj:59) at metabase.server.middleware.session$bind_current_user$fn__44978$fn__44979.invoke(session.clj:257) at metabase.server.middleware.session$do_with_current_user.invokeStatic(session.clj:238) at metabase.server.middleware.session$do_with_current_user.invoke(session.clj:230) at metabase.server.middleware.session$bind_current_user$fn__44978.invoke(session.clj:256) at metabase.server.middleware.session$wrap_current_user_info$fn__44965.invoke(session.clj:216) at metabase.server.middleware.session$wrap_session_id$fn__44951.invoke(session.clj:162) at metabase.server.middleware.auth$wrap_api_key$fn__70290.invoke(auth.clj:27) at ring.middleware.cookies$wrap_cookies$fn__83759.invoke(cookies.clj:216) at metabase.server.middleware.misc$add_content_type$fn__34060.invoke(misc.clj:27) at metabase.server.middleware.misc$disable_streaming_buffering$fn__34085.invoke(misc.clj:76) at ring.middleware.gzip$wrap_gzip$fn__83801.invoke(gzip.clj:86) at metabase.server.middleware.misc$bind_request$fn__34088.invoke(misc.clj:93) at metabase.server.middleware.ssl$redirect_to_https_middleware$fn__83588.invoke(ssl.clj:38) at metabase.server$async_proxy_handler$fn__80132.invoke(server.clj:71) at metabase.server.proxy$org.eclipse.jetty.server.handler.AbstractHandler$ff19274a.handle(Unknown Source) at org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:127) at org.eclipse.jetty.server.Server.handle(Server.java:516) at org.eclipse.jetty.server.HttpChannel.lambda$handle$1(HttpChannel.java:388) at org.eclipse.jetty.server.HttpChannel.dispatch(HttpChannel.java:633) at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:380) at org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:277) at org.eclipse.jetty.io.AbstractConnection$ReadCallback.succeeded(AbstractConnection.java:311) at org.eclipse.jetty.io.FillInterest.fillable(FillInterest.java:105) at org.eclipse.jetty.io.ChannelEndPoint$1.run(ChannelEndPoint.java:104) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.runTask(EatWhatYouKill.java:338) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.doProduce(EatWhatYouKill.java:315) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.tryProduce(EatWhatYouKill.java:173) at org.eclipse.jetty.util.thread.strategy.EatWhatYouKill.run(EatWhatYouKill.java:131) at org.eclipse.jetty.util.thread.ReservedThreadExecutor$ReservedThread.run(ReservedThreadExecutor.java:386) at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:883) at org.eclipse.jetty.util.thread.QueuedThreadPool$Runner.run(QueuedThreadPool.java:1034) at java.base/java.lang.Thread.run(Thread.java:834)

@Anuraag

Post exactly which Presto type and version you're using.

The error doesn't give any indication of the problem. Check what is happening in the Presto log.