Metabase Failed due to Hard Disk being Full (Huge Tracefile) v.33

I just got this message and metabse wont work:

{"message":"The database has been closed [90098-197]","type":"class org.h2.jdbc.JdbcSQLException","stacktrace":["org.h2.message.DbException.getJdbcSQLException(DbException.java:357)","org.h2.message.DbException.get(DbException.java:179)","org.h2.message.DbException.get(DbException.java:155)","org.h2.message.DbException.get(DbException.java:144)","org.h2.engine.Database.checkPowerOff(Database.java:536)","org.h2.command.Command.executeQuery(Command.java:228)","org.h2.jdbc.JdbcPreparedStatement.executeQuery(JdbcPreparedStatement.java:114)","com.mchange.v2.c3p0.impl.NewProxyPreparedStatement.executeQuery(NewProxyPreparedStatement.java:431)","clojure.java.jdbc$execute_query_with_params.invokeStatic(jdbc.clj:1072)","clojure.java.jdbc$execute_query_with_params.invoke(jdbc.clj:1066)","clojure.java.jdbc$db_query_with_resultset_STAR_.invokeStatic(jdbc.clj:1095)","clojure.java.jdbc$db_query_with_resultset_STAR_.invoke(jdbc.clj:1075)","clojure.java.jdbc$query.invokeStatic(jdbc.clj:1164)","clojure.java.jdbc$query.invoke(jdbc.clj:1126)","toucan.db$query.invokeStatic(db.clj:274)","toucan.db$query.doInvoke(db.clj:270)","clojure.lang.RestFn.invoke(RestFn.java:410)","toucan.db$simple_select.invokeStatic(db.clj:382)","toucan.db$simple_select.invoke(db.clj:371)","toucan.db$simple_select_one.invokeStatic(db.clj:408)","toucan.db$simple_select_one.invoke(db.clj:397)","toucan.db$select_one.invokeStatic(db.clj:615)","toucan.db$select_one.doInvoke(db.clj:608)","clojure.lang.RestFn.applyTo(RestFn.java:139)","clojure.core$apply.invokeStatic(core.clj:667)","clojure.core$apply.invoke(core.clj:660)","toucan.db$select_one_field.invokeStatic(db.clj:624)","toucan.db$select_one_field.doInvoke(db.clj:617)","clojure.lang.RestFn.applyTo(RestFn.java:142)","clojure.core$apply.invokeStatic(core.clj:669)","clojure.core$apply.invoke(core.clj:660)","toucan.db$select_one_id.invokeStatic(db.clj:633)","toucan.db$select_one_id.doInvoke(db.clj:626)","clojure.lang.RestFn.invoke(RestFn.java:423)","toucan.db$exists_QMARK_.invokeStatic(db.clj:722)","toucan.db$exists_QMARK_.doInvoke(db.clj:715)","clojure.lang.RestFn.invoke(RestFn.java:439)","--> public_settings$public_settings.invokeStatic(public_settings.clj:214)","public_settings$public_settings.invoke(public_settings.clj:197)","routes.index$load_entrypoint_template.invokeStatic(index.clj:72)","routes.index$load_entrypoint_template.invoke(index.clj:69)","routes.index$entrypoint.invokeStatic(index.clj:94)","routes.index$entrypoint.invoke(index.clj:89)","middleware.exceptions$catch_uncaught_exceptions$fn__64081.invoke(exceptions.clj:104)","middleware.exceptions$catch_api_exceptions$fn__64078.invoke(exceptions.clj:92)","middleware.log$log_api_call$fn__65506.invoke(log.clj:162)","middleware.security$add_security_headers$fn__64044.invoke(security.clj:128)","middleware.json$wrap_json_body$fn__65211.invoke(json.clj:63)","middleware.json$wrap_streamed_json_response$fn__65229.invoke(json.clj:97)","middleware.session$bind_current_user$fn__61966$fn__61967.invoke(session.clj:193)","middleware.session$do_with_current_user.invokeStatic(session.clj:176)","middleware.session$do_with_current_user.invoke(session.clj:170)","middleware.session$bind_current_user$fn__61966.invoke(session.clj:192)","middleware.session$wrap_current_user_id$fn__61955.invoke(session.clj:161)","middleware.session$wrap_session_id$fn__61940.invoke(session.clj:123)","middleware.auth$wrap_api_key$fn__63990.invoke(auth.clj:27)","middleware.misc$maybe_set_site_url$fn__65533.invoke(misc.clj:56)","middleware.misc$bind_user_locale$fn__65536.invoke(misc.clj:72)","middleware.misc$add_content_type$fn__65521.invoke(misc.clj:28)","middleware.misc$disable_streaming_buffering$fn__65544.invoke(misc.clj:87)"],"sql-exception-chain":["JdbcSQLException:","Message: The database has been closed [90098-197]","SQLState: 90098","Error Code: 90098"]}

Is this a memory issue?

Hard disk is full:

/var/metabase.db.trace.db is about 46GB any ideas why?

Okay, I deleted this file. Restarted the server and it worked. Why would such a huge file be created?

Hi @rviteri
I only have one recommendation - migrate away from H2:
https://metabase.com/docs/latest/operations-guide/migrating-from-h2.html

Has the trace file suddenly become that size or have it just slowly been growing?
The trace file is a debug log for the H2 database. It should never get to that size unless something might be wrong with the H2, like corruption.

1 Like