Hello All,
I am at latest version of Metabase ,
Currently i am geeting this error and not able to access any atbles .
":cause {:class java.sql.SQLException, :error “(conn=65) Invalid utf8mb4 character string: ‘9DA210’”, :cause {:class java.sql.SQLException, :error “Invalid utf8mb4 character string: ‘9DA210’”}}}
"
This is what i am getting
:class java.sql.BatchUpdateException,
:error “(conn=72) Invalid utf8mb4 character string: ‘C86107’”,
:stacktrace
(“org.mariadb.jdbc.MariaDbStatement.executeBatchExceptionEpilogue(MariaDbStatement.java:309)”
“org.mariadb.jdbc.ClientSidePreparedStatement.executeBatch(ClientSidePreparedStatement.java:293)”
“com.mchange.v2.c3p0.impl.NewProxyPreparedStatement.executeBatch(NewProxyPreparedStatement.java:2544)”
“clojure.java.jdbc$execute_batch.invokeStatic(jdbc.clj:591)”
“clojure.java.jdbc$execute_batch.invoke(jdbc.clj:584)”
“clojure.java.jdbc$db_do_execute_prepared_statement$fn__18683.invoke(jdbc.clj:1039)”
“clojure.java.jdbc$db_transaction_STAR_.invokeStatic(jdbc.clj:799)”
“clojure.java.jdbc$db_transaction_STAR_.invoke(jdbc.clj:769)”
“clojure.java.jdbc$db_transaction_STAR_.invokeStatic(jdbc.clj:782)”
“clojure.java.jdbc$db_transaction_STAR_.invoke(jdbc.clj:769)”
“clojure.java.jdbc$db_do_execute_prepared_statement.invokeStatic(jdbc.clj:1038)”
“clojure.java.jdbc$db_do_execute_prepared_statement.invoke(jdbc.clj:1024)”
“clojure.java.jdbc$db_do_prepared.invokeStatic(jdbc.clj:1062)”
“clojure.java.jdbc$db_do_prepared.invoke(jdbc.clj:1042)”
“clojure.java.jdbc$execute_BANG_$execute_helper__18751.invoke(jdbc.clj:1446)”
“clojure.java.jdbc$execute_BANG_.invokeStatic(jdbc.clj:1450)”
“clojure.java.jdbc$execute_BANG_.invoke(jdbc.clj:1417)”
“toucan.db$execute_BANG_.invokeStatic(db.clj:424)”
“toucan.db$execute_BANG_.doInvoke(db.clj:419)”
“clojure.lang.RestFn.invoke(RestFn.java:410)”
“toucan.db$update_BANG_.invokeStatic(db.clj:479)”
“toucan.db$update_BANG_.invoke(db.clj:468)”
“toucan.db$update_where_BANG_.invokeStatic(db.clj:508)”
“toucan.db$update_where_BANG_.doInvoke(db.clj:498)”
“clojure.lang.RestFn.invoke(RestFn.java:521)”
“–> models.query$update_rolling_average_execution_time_BANG_.invokeStatic(query.clj:49)”
“models.query$update_rolling_average_execution_time_BANG_.invoke(query.clj:38)”
“models.query$save_query_and_update_average_execution_time_BANG_.invokeStatic(query.clj:72)”
“models.query$save_query_and_update_average_execution_time_BANG_.invoke(query.clj:66)”
“query_processor.middleware.process_userland_query$save_query_execution_BANG_.invokeStatic(process_userland_query.clj:30)”
“query_processor.middleware.process_userland_query$save_query_execution_BANG_.invoke(process_userland_query.clj:26)”
“query_processor.middleware.process_userland_query$save_successful_query_execution_BANG_.invokeStatic(process_userland_query.clj:37)”
“query_processor.middleware.process_userland_query$save_successful_query_execution_BANG_.invoke(process_userland_query.clj:33)”
“query_processor.middleware.process_userland_query$succeed.invokeStatic(process_userland_query.clj:78)”
“query_processor.middleware.process_userland_query$succeed.invoke(process_userland_query.clj:77)”
“query_processor.middleware.process_userland_query$format_userland_query_result.invokeStatic(process_userland_query.clj:119)”
“query_processor.middleware.process_userland_query$format_userland_query_result.invoke(process_userland_query.clj:86)”
“query_processor.middleware.async$async__GT_sync$fn__37366.invoke(async.clj:23)”
“query_processor.middleware.async_wait$runnable$fn__40619.invoke(async_wait.clj:89)”),
:query
{:query {:source-table 3334},
:type “query”,
:parameters [],
:async? true,
:middleware {:add-default-userland-constraints? true, :userland-query? true},
:info
{:executed-by 1,
:context :ad-hoc,
:card-id nil,
:nested? false,
:query-hash [87, 70, -56, 97, 7, 83, 39, 64, -21, 83, -66, -92, 38, 28, -13, 127, -20, -79, 34, -9, 31, 32, -97, 92, 9, -70, 71, 26, 75, 114, -84, -101]},
:constraints {:max-results 10000, :max-results-bare-rows 2000}},
:preprocessed
{:constraints {:max-results 10000, :max-results-bare-rows 2000},
:type :query,
:middleware {:add-default-userland-constraints? true, :userland-query? true},
:info
{:executed-by 1,
:context :ad-hoc,
:nested? false,
:query-hash [87, 70, -56, 97, 7, 83, 39, 64, -21, 83, -66, -92, 38, 28, -13, 127, -20, -79, 34, -9, 31, 32, -97, 92, 9, -70, 71, 26, 75, 114, -84, -101]},
:preprocessing-level 1,
:database 74,
:query
{:source-table 3334,
:fields
[[:field-id 40071]
[:datetime-field [:field-id 40050] :default]
[:field-id 40075]
[:field-id 40069]
[:field-id 40068]
[:datetime-field [:field-id 40051] :default]
[:field-id 40055]
[:field-id 40047]
[:field-id 40066]
[:field-id 40052]
[:field-id 40062]
[:field-id 40057]
[:field-id 40045]
[:field-id 40067]
[:field-id 40044]
[:field-id 40048]
[:datetime-field [:field-id 40063] :default]
[:field-id 40056]
[:field-id 40053]
[:field-id 40058]
[:field-id 40054]
[:field-id 40076]
[:field-id 40070]
[:field-id 40061]
[:field-id 40046]
[:field-id 40078]
[:field-id 40073]
[:field-id 40077]
[:field-id 40065]
[:field-id 40072]
[:field-id 40064]
[:field-id 40060]
[:field-id 40059]
[:field-id 40074]
[:field-id 40049]],
:limit 2000}},
{
“browser-info”: {
“language”: “en-US”,
“platform”: “Win32”,
“userAgent”: “Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:74.0) Gecko/20100101 Firefox/74.0”,
“vendor”: “”
},
“system-info”: {
“java.runtime.name”: “OpenJDK Runtime Environment”,
“java.runtime.version”: “1.8.0_191-b12”,
“java.vendor”: “Oracle Corporation”,
“java.vendor.url”: “http://java.oracle.com/”,
“java.version”: “1.8.0_191”,
“java.vm.name”: “OpenJDK 64-Bit Server VM”,
“java.vm.version”: “25.191-b12”,
“os.name”: “Linux”,
“os.version”: “3.10.0-862.3.2.el7.x86_64”,
“user.language”: “en”,
“user.timezone”: “Asia/Calcutta”
},
“metabase-info”: {
“databases”: [
“h2”,
“mysql”
],
“hosting-env”: “unknown”,
“application-database”: “mysql”,
“application-database-details”: {
“database”: {
“name”: “MariaDB”,
“version”: “10.3.11-MariaDB”
},
“jdbc-driver”: {
“name”: “MariaDB Connector/J”,
“version”: “2.5.1”
}
},
“run-mode”: “prod”,
“version”: {
“tag”: “v0.34.3”,
“date”: “2020-02-25”,
“branch”: “release-0.34.x”,
“hash”: “1a83edb”
},
“settings”: {
“report-timezone”: null
}
}
}
@sushant.naik
Latest release is 0.35.1
Are you sure that the application database (MariaDB 10.3.11) is using utf8mb4 as charset for all database+tables+columns?
https://github.com/metabase/metabase/issues/10691
When i ran this in my Application Database i got below result s
SHOW VARIABLES WHERE Variable_name LIKE ‘character_set_%’ OR Variable_name LIKE ‘collation%’;
| Variable_name | Value |
|---|---|
| character_set_client | utf8 |
| character_set_connection | utf8 |
| character_set_database | utf8mb4 |
| character_set_filesystem | binary |
| character_set_results | utf8 |
| character_set_server | latin1 |
| character_set_system | utf8 |
| character_sets_dir | /usr/share/mysql/charsets/ |
| collation_connection | utf8_general_ci |
| collation_database | utf8mb4_unicode_ci |
| collation_server | latin1_swedish_ci |
@sushant.naik We went over this before in Question Saving Failed
utf8 is not the same as utf8mb4 - and latin1 is going to get you into a lot of problems unless you’re only storing old European texts.
And you’re not posting if you have actually converted the database+tables+columns.
Let me make it very clear: If you use MySQL/MariaDB, then you are required to use utf8mb4.
If you don’t know how to set that correctly, then I would suggest that you migrate to Postgres instead.