Hi @rkumar6
It looks like the error is coming from the database.
Post "Diagnostic Info" from Admin > Troubleshooting.
Post the full stacktrace error from Admin > Troubleshooting > Logs.
After this error, we have increased the size of the tmp folder.
I would like to share few information.
- This issue is happening to specific db (mentioned in the screenshot) which contains huge amount of data.
- When we delete the DB from Metabase and re-adding it, it works for hours and after that the same issue comes up.
@asain And without understanding where you've increased tmp directory, then it's difficult to understand where the problem is, but I'm guessing it's the database and it's using tmp for temporary cache that it cannot hold in-memory.
Post "Diagnostic Info" from Admin > Troubleshooting.
{
"browser-info": {
"language": "en-US",
"platform": "Win32",
"userAgent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/100.0.4896.75 Safari/537.36",
"vendor": "Google Inc."
},
"system-info": {
"file.encoding": "ANSI_X3.4-1968",
"java.runtime.name": "OpenJDK Runtime Environment",
"java.runtime.version": "11.0.14.1+1-LTS",
"java.vendor": "Red Hat, Inc.",
"java.vendor.url": "https://www.redhat.com/",
"java.version": "11.0.14.1",
"java.vm.name": "OpenJDK 64-Bit Server VM",
"java.vm.version": "11.0.14.1+1-LTS",
"os.name": "Linux",
"os.version": "3.10.0-1160.59.1.el7.x86_64",
"user.language": "en",
"user.timezone": "America/New_York"
},
"metabase-info": {
"databases": [
"h2",
"oracle",
"mysql",
"mongo",
"sqlserver"
],
"hosting-env": "unknown",
"application-database": "mysql",
"application-database-details": {
"database": {
"name": "MySQL",
"version": "5.7.23-log"
},
"jdbc-driver": {
"name": "MariaDB Connector/J",
"version": "2.6.2"
}
},
"run-mode": "prod",
"version": {
"date": "2022-03-28",
"tag": "vUNKNOWN",
"branch": "?",
"hash": "fb961dc"
},
"settings": {
"report-timezone": null
}
}
}
@asain I have absolutely no way of knowing which release you're using, so try with an official release.
And you are not providing enough information to understand where the problem is, so it's difficult to help.
We have increased the size of the tmp folder of the Metabase Internal DB as we found the tmp size being eaten up and threw the error " [Error writing file ‘/tmp/MYC3W8tq’ (Errcode: 28 - No space left on device)" when clicked on that specific DB.
"04-14 10:17:21 WARN jdbcjobstore.JobStoreTX :: This scheduler instance (metabase-b-1-g5sm81649097521641) is still active but was recovered by another instance in the cluster. This may cause inconsistent behavior.
04-14 10:17:21 ERROR async.streaming-response :: Error determining whether HTTP request was canceled
java.io.IOException: Connection reset by peer
at sun.nio.ch.FileDispatcherImpl.read0(Native Method) ~[?:?]
at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:39) ~[?:?]
at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:276) ~[?:?]
at sun.nio.ch.IOUtil.read(IOUtil.java:245) ~[?:?]
at sun.nio.ch.IOUtil.read(IOUtil.java:223) ~[?:?]
at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:356) ~[?:?]
at metabase.async.streaming_response$canceled_QMARK_.invokeStatic(streaming_response.clj:140) [metabase.jar:?]
at metabase.async.streaming_response$canceled_QMARK_.invoke(streaming_response.clj:130) [metabase.jar:?]
at metabase.async.streaming_response$start_async_cancel_loop_BANG_$fn__25349$state_machine__12230__auto____25356$fn__25358$inst_25298__25373.invoke(streaming_response.clj:165) [metabase.jar:?]
at metabase.async.util$cancelable_thread_call$f_STAR___25051$fn__25052.invoke(util.clj:53) [metabase.jar:?]
at metabase.async.util$cancelable_thread_call$f_STAR___25051.invoke(util.clj:52) [metabase.jar:?]
at clojure.lang.AFn.run(AFn.java:22) [metabase.jar:?]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?]
at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?]
at java.lang.Thread.run(Thread.java:829) [?:?]
04-14 10:17:22 ERROR middleware.catch-exceptions :: Error processing query: null
{:database_id 15,
:started_at #t "2022-04-14T10:17:00.198085-04:00[America/New_York]",
:via
[{:status :failed,
:class org.eclipse.jetty.io.EofException,
:error nil,
:stacktrace
["org.eclipse.jetty.io.ChannelEndPoint.flush(ChannelEndPoint.java:279)"
"org.eclipse.jetty.io.WriteFlusher.flush(WriteFlusher.java:422)"
"org.eclipse.jetty.io.WriteFlusher.write(WriteFlusher.java:277)"
"org.eclipse.jetty.io.AbstractEndPoint.write(AbstractEndPoint.java:381)"
"org.eclipse.jetty.server.HttpConnection$SendCallback.process(HttpConnection.java:826)"
"org.eclipse.jetty.util.IteratingCallback.processing(IteratingCallback.java:241)"
"org.eclipse.jetty.util.IteratingCallback.iterate(IteratingCallback.java:223)"
"org.eclipse.jetty.server.HttpConnection.send(HttpConnection.java:550)"
"org.eclipse.jetty.server.HttpChannel.sendResponse(HttpChannel.java:915)"
"org.eclipse.jetty.server.HttpChannel.write(HttpChannel.java:987)"
"org.eclipse.jetty.server.HttpOutput.channelWrite(HttpOutput.java:285)"
"org.eclipse.jetty.server.HttpOutput.channelWrite(HttpOutput.java:269)"
"org.eclipse.jetty.server.HttpOutput.flush(HttpOutput.java:749)"
"java.base/java.util.zip.DeflaterOutputStream.flush(DeflaterOutputStream.java:282)"
"--> async.streaming_response$delay_output_stream$fn__25247.invoke(streaming_response.clj:119)"
"async.streaming_response.proxy$java.io.OutputStream$ff19274a.flush(Unknown Source)"
"query_processor.streaming.json$fn$reify__37231.write_row_BANG_(json.clj:71)"
"query_processor.streaming$streaming_rff$fn__37982$fn__37987.invoke(streaming.clj:122)"
"query_processor.middleware.process_userland_query$add_and_save_execution_info_xform_BANG_$execution_info_rf_STAR___50060.invoke(process_userland_query.clj:101)"
"query_processor.reducible$combine_additional_reducing_fns$fn__42506.invoke(reducible.clj:215)"
"query_processor.middleware.add_rows_truncated$add_rows_truncated_xform$fn__47756.invoke(add_rows_truncated.clj:27)"
"query_processor.middleware.format_rows$format_rows_xform$fn__50278.invoke(format_rows.clj:68)"
"query_processor.reducible$combine_additional_reducing_fns$fn__42506.invoke(reducible.clj:215)"
"query_processor.middleware.limit$limit_xform$fn__47443.invoke(limit.clj:24)"
"query_processor.reducible$reducible_rows$reify__42499.reduce(reducible.clj:159)"
"query_processor.context.default$default_reducef$fn__42395.invoke(default.clj:58)"
"query_processor.context.default$default_reducef.invokeStatic(default.clj:57)"
"query_processor.context.default$default_reducef.invoke(default.clj:48)"
"query_processor.context$reducef.invokeStatic(context.clj:69)"
"query_processor.context$reducef.invoke(context.clj:62)"
"query_processor.context.default$default_runf$respond_STAR___42399.invoke(default.clj:69)"
"driver.oracle$remove_rownum_column.invokeStatic(oracle.clj:323)"
"driver.oracle$remove_rownum_column.invoke(oracle.clj:319)"
"driver.sql_jdbc.execute$execute_reducible_query.invokeStatic(execute.clj:485)"
"driver.sql_jdbc.execute$execute_reducible_query.invoke(execute.clj:463)"
"driver.sql_jdbc.execute$execute_reducible_query.invokeStatic(execute.clj:472)"
"driver.sql_jdbc.execute$execute_reducible_query.invoke(execute.clj:463)"
"driver.sql_jdbc$fn__85045.invokeStatic(sql_jdbc.clj:54)"
"driver.sql_jdbc$fn__85045.invoke(sql_jdbc.clj:52)"
"driver.oracle$fn__88027.invokeStatic(oracle.clj:336)"
"driver.oracle$fn__88027.invoke(oracle.clj:334)"
"query_processor.context$executef.invokeStatic(context.clj:59)"
"query_processor.context$executef.invoke(context.clj:48)"
"query_processor.context.default$default_runf.invokeStatic(default.clj:68)"
"query_processor.context.default$default_runf.invoke(default.clj:66)"
"query_processor.context$runf.invokeStatic(context.clj:45)"
"query_processor.context$runf.invoke(context.clj:39)"
"query_processor.reducible$pivot.invokeStatic(reducible.clj:34)"
"query_processor.reducible$pivot.invoke(reducible.clj:31)"
"query_processor.middleware.mbql_to_native$mbql__GT_native$fn__49073.invoke(mbql_to_native.clj:25)"
"query_processor.middleware.check_features$check_features$fn__49560.invoke(check_features.clj:39)"
"query_processor.middleware.limit$limit$fn__47446.invoke(limit.clj:37)"
"query_processor.middleware.cache$maybe_return_cached_results$fn__49934.invoke(cache.clj:204)"
"query_processor.middleware.optimize_temporal_filters$optimize_temporal_filters$fn__50927.invoke(optimize_temporal_filters.clj:204)"
"query_processor.middleware.validate_temporal_bucketing$validate_temporal_bucketing$fn__50971.invoke(validate_temporal_bucketing.clj:50)"
"query_processor.middleware.auto_parse_filter_values$auto_parse_filter_values$fn__49130.invoke(auto_parse_filter_values.clj:43)"
"query_processor.middleware.wrap_value_literals$wrap_value_literals$fn__39232.invoke(wrap_value_literals.clj:161)"
"query_processor.middleware.annotate$add_column_info$fn__43663.invoke(annotate.clj:615)"
"query_processor.middleware.permissions$check_query_permissions$fn__45601.invoke(permissions.clj:108)"
"query_processor.middleware.pre_alias_aggregations$pre_alias_aggregations$fn__50111.invoke(pre_alias_aggregations.clj:40)"
"query_processor.middleware.cumulative_aggregations$handle_cumulative_aggregations$fn__45999.invoke(cumulative_aggregations.clj:60)"
"query_processor.middleware.visualization_settings$update_viz_settings$fn__45937.invoke(visualization_settings.clj:63)"
"query_processor.middleware.resolve_joined_fields$resolve_joined_fields$fn__47044.invoke(resolve_joined_fields.clj:102)"
"query_processor.middleware.resolve_joins$resolve_joins$fn__50697.invoke(resolve_joins.clj:171)"
"query_processor.middleware.add_implicit_joins$add_implicit_joins$fn__50233.invoke(add_implicit_joins.clj:190)"
"query_processor.middleware.large_int_id$convert_id_to_string$fn__47063.invoke(large_int_id.clj:59)"
"query_processor.middleware.format_rows$format_rows$fn__50285.invoke(format_rows.clj:74)"
"query_processor.middleware.add_default_temporal_unit$add_default_temporal_unit$fn__46435.invoke(add_default_temporal_unit.clj:23)"
"query_processor.middleware.desugar$desugar$fn__45910.invoke(desugar.clj:21)"
"query_processor.middleware.binning$update_binning_strategy$fn__39132.invoke(binning.clj:229)"
"query_processor.middleware.resolve_fields$resolve_fields$fn__45244.invoke(resolve_fields.clj:34)"
"query_processor.middleware.add_dimension_projections$add_remapping$fn__49485.invoke(add_dimension_projections.clj:312)"
"query_processor.middleware.add_implicit_clauses$add_implicit_clauses$fn__49783.invoke(add_implicit_clauses.clj:147)"
"query_processor.middleware.upgrade_field_literals$upgrade_field_literals$fn__47431.invoke(upgrade_field_literals.clj:40)"
"query_processor.middleware.add_source_metadata$add_source_metadata_for_source_queries$fn__46812.invoke(add_source_metadata.clj:123)"
"query_processor.middleware.reconcile_breakout_and_order_by_bucketing$reconcile_breakout_and_order_by_bucketing$fn__50033.invoke(reconcile_breakout_and_order_by_bucketing.clj:100)"
"query_processor.middleware.auto_bucket_datetimes$auto_bucket_datetimes$fn__48382.invoke(auto_bucket_datetimes.clj:147)"
"query_processor.middleware.resolve_source_table$resolve_source_tables$fn__45225.invoke(resolve_source_table.clj:45)"
"query_processor.middleware.parameters$substitute_parameters$fn__48036.invoke(parameters.clj:111)"
"query_processor.middleware.resolve_referenced$resolve_referenced_card_resources$fn__45298.invoke(resolve_referenced.clj:79)"
"query_processor.middleware.expand_macros$expand_macros$fn__51355.invoke(expand_macros.clj:184)"
"query_processor.middleware.add_timezone_info$add_timezone_info$fn__47815.invoke(add_timezone_info.clj:15)"
"query_processor.middleware.splice_params_in_response$splice_params_in_response$fn__50300.invoke(splice_params_in_response.clj:32)"
"query_processor.middleware.resolve_database_and_driver$resolve_database_and_driver$fn__49794$fn__49798.invoke(resolve_database_and_driver.clj:31)"
"driver$do_with_driver.invokeStatic(driver.clj:60)"
"driver$do_with_driver.invoke(driver.clj:56)"
"query_processor.middleware.resolve_database_and_driver$resolve_database_and_driver$fn__49794.invoke(resolve_database_and_driver.clj:25)"
"query_processor.middleware.fetch_source_query$resolve_card_id_source_tables$fn__45848.invoke(fetch_source_query.clj:274)"
"query_processor.middleware.store$initialize_store$fn__46036$fn__46037.invoke(store.clj:11)"
"query_processor.store$do_with_store.invokeStatic(store.clj:44)"
"query_processor.store$do_with_store.invoke(store.clj:38)"
"query_processor.middleware.store$initialize_store$fn__46036.invoke(store.clj:10)"
"query_processor.middleware.validate$validate_query$fn__50083.invoke(validate.clj:10)"
"query_processor.middleware.normalize_query$normalize$fn__50090.invoke(normalize_query.clj:22)"
"query_processor.middleware.add_rows_truncated$add_rows_truncated$fn__47761.invoke(add_rows_truncated.clj:35)"
"query_processor.middleware.results_metadata$record_and_return_metadata_BANG_$fn__49059.invoke(results_metadata.clj:147)"
"query_processor.middleware.constraints$add_default_userland_constraints$fn__47779.invoke(constraints.clj:42)"
"query_processor.middleware.process_userland_query$process_userland_query$fn__50069.invoke(process_userland_query.clj:146)"
"query_processor.middleware.catch_exceptions$catch_exceptions$fn__50380.invoke(catch_exceptions.clj:169)"
"query_processor.reducible$async_qp$qp_STAR___42483$thunk__42484.invoke(reducible.clj:103)"
"query_processor.reducible$async_qp$qp_STAR___42483$fn__42486.invoke(reducible.clj:108)"]}
{:status :failed,
:class clojure.lang.ExceptionInfo,
:error "Error reducing result rows",
:stacktrace
["--> query_processor.context.default$default_reducef$fn__42395.invoke(default.clj:60)"
"query_processor.context.default$default_reducef.invokeStatic(default.clj:57)"
"query_processor.context.default$default_reducef.invoke(default.clj:48)"
"query_processor.context$reducef.invokeStatic(context.clj:69)"
"query_processor.context$reducef.invoke(context.clj:62)"
"query_processor.context.default$default_runf$respond_STAR___42399.invoke(default.clj:69)"
"driver.oracle$remove_rownum_column.invokeStatic(oracle.clj:323)"
"driver.oracle$remove_rownum_column.invoke(oracle.clj:319)"
"driver.sql_jdbc.execute$execute_reducible_query.invokeStatic(execute.clj:485)"
"driver.sql_jdbc.execute$execute_reducible_query.invoke(execute.clj:463)"
"driver.sql_jdbc.execute$execute_reducible_query.invokeStatic(execute.clj:472)"
"driver.sql_jdbc.execute$execute_reducible_query.invoke(execute.clj:463)"
"driver.sql_jdbc$fn__85045.invokeStatic(sql_jdbc.clj:54)"
"driver.sql_jdbc$fn__85045.invoke(sql_jdbc.clj:52)"
"driver.oracle$fn__88027.invokeStatic(oracle.clj:336)"
"driver.oracle$fn__88027.invoke(oracle.clj:334)"
"query_processor.context$executef.invokeStatic(context.clj:59)"
"query_processor.context$executef.invoke(context.clj:48)"
"query_processor.context.default$default_runf.invokeStatic(default.clj:68)"
"query_processor.context.default$default_runf.invoke(default.clj:66)"
"query_processor.context$runf.invokeStatic(context.clj:45)"
"query_processor.context$runf.invoke(context.clj:39)"
"query_processor.reducible$pivot.invokeStatic(reducible.clj:34)"
"query_processor.reducible$pivot.invoke(reducible.clj:31)"
"query_processor.middleware.mbql_to_native$mbql__GT_native$fn__49073.invoke(mbql_to_native.clj:25)"
"query_processor.middleware.check_features$check_features$fn__49560.invoke(check_features.clj:39)"
"query_processor.middleware.limit$limit$fn__47446.invoke(limit.clj:37)"
"query_processor.middleware.cache$maybe_return_cached_results$fn__49934.invoke(cache.clj:204)"
"query_processor.middleware.optimize_temporal_filters$optimize_temporal_filters$fn__50927.invoke(optimize_temporal_filters.clj:204)"
"query_processor.middleware.validate_temporal_bucketing$validate_temporal_bucketing$fn__50971.invoke(validate_temporal_bucketing.clj:50)"
"query_processor.middleware.auto_parse_filter_values$auto_parse_filter_values$fn__49130.invoke(auto_parse_filter_values.clj:43)"
"query_processor.middleware.wrap_value_literals$wrap_value_literals$fn__39232.invoke(wrap_value_literals.clj:161)"
"query_processor.middleware.annotate$add_column_info$fn__43663.invoke(annotate.clj:615)"
"query_processor.middleware.permissions$check_query_permissions$fn__45601.invoke(permissions.clj:108)"
"query_processor.middleware.pre_alias_aggregations$pre_alias_aggregations$fn__50111.invoke(pre_alias_aggregations.clj:40)"
"query_processor.middleware.cumulative_aggregations$handle_cumulative_aggregations$fn__45999.invoke(cumulative_aggregations.clj:60)"
"query_processor.middleware.visualization_settings$update_viz_settings$fn__45937.invoke(visualization_settings.clj:63)"
"query_processor.middleware.resolve_joined_fields$resolve_joined_fields$fn__47044.invoke(resolve_joined_fields.clj:102)"
"query_processor.middleware.resolve_joins$resolve_joins$fn__50697.invoke(resolve_joins.clj:171)"
"query_processor.middleware.add_implicit_joins$add_implicit_joins$fn__50233.invoke(add_implicit_joins.clj:190)"
"query_processor.middleware.large_int_id$convert_id_to_string$fn__47063.invoke(large_int_id.clj:59)"
"query_processor.middleware.format_rows$format_rows$fn__50285.invoke(format_rows.clj:74)"
"query_processor.middleware.add_default_temporal_unit$add_default_temporal_unit$fn__46435.invoke(add_default_temporal_unit.clj:23)"
"query_processor.middleware.desugar$desugar$fn__45910.invoke(desugar.clj:21)"
"query_processor.middleware.binning$update_binning_strategy$fn__39132.invoke(binning.clj:229)"
"query_processor.middleware.resolve_fields$resolve_fields$fn__45244.invoke(resolve_fields.clj:34)"
"query_processor.middleware.add_dimension_projections$add_remapping$fn__49485.invoke(add_dimension_projections.clj:312)"
"query_processor.middleware.add_implicit_clauses$add_implicit_clauses$fn__49783.invoke(add_implicit_clauses.clj:147)"
"query_processor.middleware.upgrade_field_literals$upgrade_field_literals$fn__47431.invoke(upgrade_field_literals.clj:40)"
"query_processor.middleware.add_source_metadata$add_source_metadata_for_source_queries$fn__46812.invoke(add_source_metadata.clj:123)"
"query_processor.middleware.reconcile_breakout_and_order_by_bucketing$reconcile_breakout_and_order_by_bucketing$fn__50033.invoke(reconcile_breakout_and_order_by_bucketing.clj:100)"
"query_processor.middleware.auto_bucket_datetimes$auto_bucket_datetimes$fn__48382.invoke(auto_bucket_datetimes.clj:147)"
"query_processor.middleware.resolve_source_table$resolve_source_tables$fn__45225.invoke(resolve_source_table.clj:45)"
"query_processor.middleware.parameters$substitute_parameters$fn__48036.invoke(parameters.clj:111)"
"query_processor.middleware.resolve_referenced$resolve_referenced_card_resources$fn__45298.invoke(resolve_referenced.clj:79)"
"query_processor.middleware.expand_macros$expand_macros$fn__51355.invoke(expand_macros.clj:184)"
"query_processor.middleware.add_timezone_info$add_timezone_info$fn__47815.invoke(add_timezone_info.clj:15)"
"query_processor.middleware.splice_params_in_response$splice_params_in_response$fn__50300.invoke(splice_params_in_response.clj:32)"
"query_processor.middleware.resolve_database_and_driver$resolve_database_and_driver$fn__49794$fn__49798.invoke(resolve_database_and_driver.clj:31)"
"driver$do_with_driver.invokeStatic(driver.clj:60)"
"driver$do_with_driver.invoke(driver.clj:56)"
"query_processor.middleware.resolve_database_and_driver$resolve_database_and_driver$fn__49794.invoke(resolve_database_and_driver.clj:25)"
"query_processor.middleware.fetch_source_query$resolve_card_id_source_tables$fn__45848.invoke(fetch_source_query.clj:274)"
"query_processor.middleware.store$initialize_store$fn__46036$fn__46037.invoke(store.clj:11)"
"query_processor.store$do_with_store.invokeStatic(store.clj:44)"
"query_processor.store$do_with_store.invoke(store.clj:38)"
"query_processor.middleware.store$initialize_store$fn__46036.invoke(store.clj:10)"
"query_processor.middleware.validate$validate_query$fn__50083.invoke(validate.clj:10)"
"query_processor.middleware.normalize_query$normalize$fn__50090.invoke(normalize_query.clj:22)"
"query_processor.middleware.add_rows_truncated$add_rows_truncated$fn__47761.invoke(add_rows_truncated.clj:35)"
"query_processor.middleware.results_metadata$record_and_return_metadata_BANG_$fn__49059.invoke(results_metadata.clj:147)"
"query_processor.middleware.constraints$add_default_userland_constraints$fn__47779.invoke(constraints.clj:42)"
"query_processor.middleware.process_userland_query$process_userland_query$fn__50069.invoke(process_userland_query.clj:146)"
"query_processor.middleware.catch_exceptions$catch_exceptions$fn__50380.invoke(catch_exceptions.clj:169)"
"query_processor.reducible$async_qp$qp_STAR___42483$thunk__42484.invoke(reducible.clj:103)"
"query_processor.reducible$async_qp$qp_STAR___42483$fn__42486.invoke(reducible.clj:108)"],
:error_type :qp,
:ex-data {:type :qp}}],
:error_type :qp,
:json_query
{:constraints {:max-results 10000, :max-results-bare-rows 2000},
:type :native,
:middleware {:js-int-to-string? true, :ignore-cached-results? false, :process-viz-settings? false},
:native
{:template-tags
"Execution_Start"
{:id "43785f01-6514-9011-eb17-4e4ce5187c5c",
:name "Execution_Start",
:display-name "Execution start",
:type :date,
:required true,
:default "2022-03-01"}},
:query
Mongo DB Query
:database 15,
:parameters [],
:async? true,
:cache-ttl nil},
:status :failed,
:class java.io.IOException,
:stacktrace
["java.base/sun.nio.ch.FileDispatcherImpl.writev0(Native Method)"
"java.base/sun.nio.ch.SocketDispatcher.writev(SocketDispatcher.java:51)"
"java.base/sun.nio.ch.IOUtil.write(IOUtil.java:182)"
"java.base/sun.nio.ch.IOUtil.write(IOUtil.java:130)"
"java.base/sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:493)"
"java.base/java.nio.channels.SocketChannel.write(SocketChannel.java:507)"
"org.eclipse.jetty.io.ChannelEndPoint.flush(ChannelEndPoint.java:273)"
"org.eclipse.jetty.io.WriteFlusher.flush(WriteFlusher.java:422)"
"org.eclipse.jetty.io.WriteFlusher.write(WriteFlusher.java:277)"
"org.eclipse.jetty.io.AbstractEndPoint.write(AbstractEndPoint.java:381)"
"org.eclipse.jetty.server.HttpConnection$SendCallback.process(HttpConnection.java:826)"
"org.eclipse.jetty.util.IteratingCallback.processing(IteratingCallback.java:241)"
"org.eclipse.jetty.util.IteratingCallback.iterate(IteratingCallback.java:223)"
"org.eclipse.jetty.server.HttpConnection.send(HttpConnection.java:550)"
"org.eclipse.jetty.server.HttpChannel.sendResponse(HttpChannel.java:915)"
"org.eclipse.jetty.server.HttpChannel.write(HttpChannel.java:987)"
"org.eclipse.jetty.server.HttpOutput.channelWrite(HttpOutput.java:285)"
"org.eclipse.jetty.server.HttpOutput.channelWrite(HttpOutput.java:269)"
"org.eclipse.jetty.server.HttpOutput.flush(HttpOutput.java:749)"
"java.base/java.util.zip.DeflaterOutputStream.flush(DeflaterOutputStream.java:282)"
"--> async.streaming_response$delay_output_stream$fn__25247.invoke(streaming_response.clj:119)"
"async.streaming_response.proxy$java.io.OutputStream$ff19274a.flush(Unknown Source)"
"query_processor.streaming.json$fn$reify__37231.write_row_BANG_(json.clj:71)"
"query_processor.streaming$streaming_rff$fn__37982$fn__37987.invoke(streaming.clj:122)"
"query_processor.middleware.process_userland_query$add_and_save_execution_info_xform_BANG_$execution_info_rf_STAR___50060.invoke(process_userland_query.clj:101)"
"query_processor.reducible$combine_additional_reducing_fns$fn__42506.invoke(reducible.clj:215)"
"query_processor.middleware.add_rows_truncated$add_rows_truncated_xform$fn__47756.invoke(add_rows_truncated.clj:27)"
"query_processor.middleware.format_rows$format_rows_xform$fn__50278.invoke(format_rows.clj:68)"
"query_processor.reducible$combine_additional_reducing_fns$fn__42506.invoke(reducible.clj:215)"
"query_processor.middleware.limit$limit_xform$fn__47443.invoke(limit.clj:24)"
"query_processor.reducible$reducible_rows$reify__42499.reduce(reducible.clj:159)"
"query_processor.context.default$default_reducef$fn__42395.invoke(default.clj:58)"
"query_processor.context.default$default_reducef.invokeStatic(default.clj:57)"
"query_processor.context.default$default_reducef.invoke(default.clj:48)"
"query_processor.context$reducef.invokeStatic(context.clj:69)"
"query_processor.context$reducef.invoke(context.clj:62)"
"query_processor.context.default$default_runf$respond_STAR___42399.invoke(default.clj:69)"
"driver.oracle$remove_rownum_column.invokeStatic(oracle.clj:323)"
"driver.oracle$remove_rownum_column.invoke(oracle.clj:319)"
"driver.sql_jdbc.execute$execute_reducible_query.invokeStatic(execute.clj:485)"
"driver.sql_jdbc.execute$execute_reducible_query.invoke(execute.clj:463)"
"driver.sql_jdbc.execute$execute_reducible_query.invokeStatic(execute.clj:472)"
"driver.sql_jdbc.execute$execute_reducible_query.invoke(execute.clj:463)"
"driver.sql_jdbc$fn__85045.invokeStatic(sql_jdbc.clj:54)"
"driver.sql_jdbc$fn__85045.invoke(sql_jdbc.clj:52)"
"driver.oracle$fn__88027.invokeStatic(oracle.clj:336)"
"driver.oracle$fn__88027.invoke(oracle.clj:334)"
"query_processor.context$executef.invokeStatic(context.clj:59)"
"query_processor.context$executef.invoke(context.clj:48)"
"query_processor.context.default$default_runf.invokeStatic(default.clj:68)"
"query_processor.context.default$default_runf.invoke(default.clj:66)"
"query_processor.context$runf.invokeStatic(context.clj:45)"
"query_processor.context$runf.invoke(context.clj:39)"
"query_processor.reducible$pivot.invokeStatic(reducible.clj:34)"
"query_processor.reducible$pivot.invoke(reducible.clj:31)"
"query_processor.middleware.mbql_to_native$mbql__GT_native$fn__49073.invoke(mbql_to_native.clj:25)"
"query_processor.middleware.check_features$check_features$fn__49560.invoke(check_features.clj:39)"
"query_processor.middleware.limit$limit$fn__47446.invoke(limit.clj:37)"
"query_processor.middleware.cache$maybe_return_cached_results$fn__49934.invoke(cache.clj:204)"
"query_processor.middleware.optimize_temporal_filters$optimize_temporal_filters$fn__50927.invoke(optimize_temporal_filters.clj:204)"
"query_processor.middleware.validate_temporal_bucketing$validate_temporal_bucketing$fn__50971.invoke(validate_temporal_bucketing.clj:50)"
"query_processor.middleware.auto_parse_filter_values$auto_parse_filter_values$fn__49130.invoke(auto_parse_filter_values.clj:43)"
"query_processor.middleware.wrap_value_literals$wrap_value_literals$fn__39232.invoke(wrap_value_literals.clj:161)"
"query_processor.middleware.annotate$add_column_info$fn__43663.invoke(annotate.clj:615)"
"query_processor.middleware.permissions$check_query_permissions$fn__45601.invoke(permissions.clj:108)"
"query_processor.middleware.pre_alias_aggregations$pre_alias_aggregations$fn__50111.invoke(pre_alias_aggregations.clj:40)"
"query_processor.middleware.cumulative_aggregations$handle_cumulative_aggregations$fn__45999.invoke(cumulative_aggregations.clj:60)"
"query_processor.middleware.visualization_settings$update_viz_settings$fn__45937.invoke(visualization_settings.clj:63)"
"query_processor.middleware.resolve_joined_fields$resolve_joined_fields$fn__47044.invoke(resolve_joined_fields.clj:102)"
"query_processor.middleware.resolve_joins$resolve_joins$fn__50697.invoke(resolve_joins.clj:171)"
"query_processor.middleware.add_implicit_joins$add_implicit_joins$fn__50233.invoke(add_implicit_joins.clj:190)"
"query_processor.middleware.large_int_id$convert_id_to_string$fn__47063.invoke(large_int_id.clj:59)"
"query_processor.middleware.format_rows$format_rows$fn__50285.invoke(format_rows.clj:74)"
"query_processor.middleware.add_default_temporal_unit$add_default_temporal_unit$fn__46435.invoke(add_default_temporal_unit.clj:23)"
"query_processor.middleware.desugar$desugar$fn__45910.invoke(desugar.clj:21)"
"query_processor.middleware.binning$update_binning_strategy$fn__39132.invoke(binning.clj:229)"
"query_processor.middleware.resolve_fields$resolve_fields$fn__45244.invoke(resolve_fields.clj:34)"
"query_processor.middleware.add_dimension_projections$add_remapping$fn__49485.invoke(add_dimension_projections.clj:312)"
"query_processor.middleware.add_implicit_clauses$add_implicit_clauses$fn__49783.invoke(add_implicit_clauses.clj:147)"
"query_processor.middleware.upgrade_field_literals$upgrade_field_literals$fn__47431.invoke(upgrade_field_literals.clj:40)"
"query_processor.middleware.add_source_metadata$add_source_metadata_for_source_queries$fn__46812.invoke(add_source_metadata.clj:123)"
"query_processor.middleware.reconcile_breakout_and_order_by_bucketing$reconcile_breakout_and_order_by_bucketing$fn__50033.invoke(reconcile_breakout_and_order_by_bucketing.clj:100)"
"query_processor.middleware.auto_bucket_datetimes$auto_bucket_datetimes$fn__48382.invoke(auto_bucket_datetimes.clj:147)"
"query_processor.middleware.resolve_source_table$resolve_source_tables$fn__45225.invoke(resolve_source_table.clj:45)"
"query_processor.middleware.parameters$substitute_parameters$fn__48036.invoke(parameters.clj:111)"
"query_processor.middleware.resolve_referenced$resolve_referenced_card_resources$fn__45298.invoke(resolve_referenced.clj:79)"
"query_processor.middleware.expand_macros$expand_macros$fn__51355.invoke(expand_macros.clj:184)"
"query_processor.middleware.add_timezone_info$add_timezone_info$fn__47815.invoke(add_timezone_info.clj:15)"
"query_processor.middleware.splice_params_in_response$splice_params_in_response$fn__50300.invoke(splice_params_in_response.clj:32)"
"query_processor.middleware.resolve_database_and_driver$resolve_database_and_driver$fn__49794$fn__49798.invoke(resolve_database_and_driver.clj:31)"
"driver$do_with_driver.invokeStatic(driver.clj:60)"
"driver$do_with_driver.invoke(driver.clj:56)"
"query_processor.middleware.resolve_database_and_driver$resolve_database_and_driver$fn__49794.invoke(resolve_database_and_driver.clj:25)"
"query_processor.middleware.fetch_source_query$resolve_card_id_source_tables$fn__45848.invoke(fetch_source_query.clj:274)"
"query_processor.middleware.store$initialize_store$fn__46036$fn__46037.invoke(store.clj:11)"
"query_processor.store$do_with_store.invokeStatic(store.clj:44)"
"query_processor.store$do_with_store.invoke(store.clj:38)"
"query_processor.middleware.store$initialize_store$fn__46036.invoke(store.clj:10)"
"query_processor.middleware.validate$validate_query$fn__50083.invoke(validate.clj:10)"
"query_processor.middleware.normalize_query$normalize$fn__50090.invoke(normalize_query.clj:22)"
"query_processor.middleware.add_rows_truncated$add_rows_truncated$fn__47761.invoke(add_rows_truncated.clj:35)"
"query_processor.middleware.results_metadata$record_and_return_metadata_BANG_$fn__49059.invoke(results_metadata.clj:147)"
"query_processor.middleware.constraints$add_default_userland_constraints$fn__47779.invoke(constraints.clj:42)"
"query_processor.middleware.process_userland_query$process_userland_query$fn__50069.invoke(process_userland_query.clj:146)"
"query_processor.middleware.catch_exceptions$catch_exceptions$fn__50380.invoke(catch_exceptions.clj:169)"
"query_processor.reducible$async_qp$qp_STAR___42483$thunk__42484.invoke(reducible.clj:103)"
"query_processor.reducible$async_qp$qp_STAR___42483$fn__42486.invoke(reducible.clj:108)"],
:card_id 5880,
:context :question,
:error "Connection reset by peer",
:row_count 0,
:running_time 0,
:data {:rows [], :cols []}}
04-14 10:17:45 WARN jdbcjobstore.JobStoreTX :: This scheduler instance (eba-metabase-b-1-g5sm81649097521641) is still active but was recovered by another instance in the cluster. This may cause inconsistent behavior."
@asain
So you are having problems with the Metabase application database, which is MySQL 5.7.23-log?
MySQL has problems with how it's handling its table locking and temporary files. Newer versions of MySQL has gotten a lot better.
Otherwise try Postgres instead.
May I know which latest version of MySQL is compatible with Metabase v0.41.0
@asain You should upgrade immediately if you are using 0.41.0 - latest release is 0.42.4
https://www.metabase.com/docs/latest/operations-guide/configuring-application-database.html#mysql-or-mariadb
Recently we have upgraded to Metabase v0.41.0, Is there any reason we need to upgrade it immediately.
As we have upgraded the Metabase recently to v0.41 and as per the corporate structure we are not in a position to upgrade the Metabase immediately .
"MySQL has problems with how it's handling its table locking and temporary files"-
Since we are using MySQL 5.7.23-log, could you please suggest the latest compatible MySQL version with Metabase v0.41. to fix the above mentioned issue?
@asain Have you heard about Log4j? If no, then try asking your boss.
The problem with MySQL leaving temporary files has nothing to do with Metabase. That's up to MySQL to manage that. So try searching some MySQL forums for help on this.
Metabase is compatible with MySQL 5.7.7 and newer.