Query With Date Filter

rubenssoto · November 12, 2021, 9:47pm

Hello,

Probably Im doing something wrong...

Im trying to create a question with variable date filter.

select
count(1)
from
table
where
created_date_brt = {{created_date_brt}}

Presto show the following message:

com.facebook.presto.spi.PrestoException: Formatted query does not parse: Query{queryBody=QuerySpecification{select=Select{distinct=false, selectItems=["count"(1)]}, from=Optional[Table{raw_courier_api.order}], where=(created_date_brt = ?), groupBy=Optional.empty, having=null, orderBy=Optional.empty, offset=null, limit=null}, orderBy=Optional.empty}
at com.facebook.presto.sql.SqlFormatterUtil.getFormattedSql(SqlFormatterUtil.java:44)
at com.facebook.presto.execution.PrepareTask.execute(PrepareTask.java:71)
at com.facebook.presto.execution.PrepareTask.execute(PrepareTask.java:39)
at com.facebook.presto.execution.DataDefinitionExecution.start(DataDefinitionExecution.java:213)
at com.facebook.presto.$gen.Presto_0_263_SNAPSHOT_8478c37____20211112_190525_1.run(Unknown Source)
at com.facebook.presto.execution.SqlQueryManager.createQuery(SqlQueryManager.java:266)
at com.facebook.presto.dispatcher.LocalDispatchQuery.lambda$startExecution$7(LocalDispatchQuery.java:192)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)

The query executed on Presto was:

PREPARE statement7 FROM -- Metabase:: userID: 2 queryType: native queryHash: 796b7243019213fd9c38481d0200180a2c0c81f5563fb589d724c970e4dfee96
select
   count(1)
from
    table
where
    created_date_brt = ?

flamber · November 12, 2021, 9:51pm

Hi @rubenssoto

Post "Diagnostic Info" from Admin > Troubleshooting.
Post the full stacktrace from Admin > Troubleshooting > Logs.

rubenssoto · November 12, 2021, 10:49pm

{
"browser-info": {
"language": "pt-BR",
"platform": "MacIntel",
"userAgent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36",
"vendor": "Google Inc."
},
"system-info": {
"file.encoding": "UTF-8",
"java.runtime.name": "OpenJDK Runtime Environment",
"java.runtime.version": "11.0.12+7",
"java.vendor": "Eclipse Foundation",
"java.vendor.url": "https://adoptium.net/",
"java.version": "11.0.12",
"java.vm.name": "OpenJDK 64-Bit Server VM",
"java.vm.version": "11.0.12+7",
"os.name": "Linux",
"os.version": "5.4.141-67.229.amzn2.x86_64",
"user.language": "en",
"user.timezone": "GMT"
},
"metabase-info": {
"databases": [
"presto-jdbc",
"redshift"
],
"hosting-env": "unknown",
"application-database": "postgres",
"application-database-details": {
"database": {
"name": "PostgreSQL",
"version": "13.3"
},
"jdbc-driver": {
"name": "PostgreSQL JDBC Driver",
"version": "42.2.23"
}
},
"run-mode": "prod",
"version": {
"date": "2021-10-21",
"tag": "v0.41.1",
"branch": "release-x.41.x",
"hash": "76aa4a5"
},
"settings": {
"report-timezone": null
}
}
}

[614262dc-d852-4eb6-8fb4-86c799e952ff] 2021-11-12T19:45:06-03:00 ERROR metabase.query-processor.middleware.catch-exceptions Erro ao processar a query: null
{:database_id 4,
:started_at #t "2021-11-12T22:45:05.100404Z[GMT]",
:via
[{:status :failed,
:class java.sql.SQLException,
:error
"Query failed (#20211112_224506_00043_dqvht): Formatted query does not parse: Query{queryBody=QuerySpecification{select=Select{distinct=false, selectItems=["count"(1)]}, from=Optional[Table{raw_courier_api.order}], where=(created_date_brt = ?), groupBy=Optional.empty, having=null, orderBy=Optional.empty, offset=null, limit=null}, orderBy=Optional.empty}",
:stacktrace
["com.facebook.presto.jdbc.PrestoResultSet.resultsException(PrestoResultSet.java:1841)"
"com.facebook.presto.jdbc.PrestoResultSet.getColumns(PrestoResultSet.java:1751)"
"com.facebook.presto.jdbc.PrestoResultSet.(PrestoResultSet.java:121)"
"com.facebook.presto.jdbc.PrestoStatement.internalExecute(PrestoStatement.java:272)"
"com.facebook.presto.jdbc.PrestoStatement.execute(PrestoStatement.java:230)"
"com.facebook.presto.jdbc.PrestoPreparedStatement.(PrestoPreparedStatement.java:84)"
"com.facebook.presto.jdbc.PrestoConnection.prepareStatement(PrestoConnection.java:142)"
"com.facebook.presto.jdbc.PrestoConnection.prepareStatement(PrestoConnection.java:329)"
"com.mchange.v2.c3p0.impl.NewProxyConnection.prepareStatement(NewProxyConnection.java:329)"
"--> driver.presto_jdbc$fn__88914.invokeStatic(presto_jdbc.clj:361)"
"driver.presto_jdbc$fn__88914.invoke(presto_jdbc.clj:357)"
"driver.sql_jdbc.execute$prepared_statement_STAR_.invokeStatic(execute.clj:336)"
"driver.sql_jdbc.execute$prepared_statement_STAR_.invoke(execute.clj:333)"
"driver.sql_jdbc.execute$statement_or_prepared_statement.invokeStatic(execute.clj:360)"
"driver.sql_jdbc.execute$statement_or_prepared_statement.invoke(execute.clj:357)"
"driver.sql_jdbc.execute$execute_reducible_query.invokeStatic(execute.clj:500)"
"driver.sql_jdbc.execute$execute_reducible_query.invoke(execute.clj:487)"
"driver.sql_jdbc.execute$execute_reducible_query.invokeStatic(execute.clj:496)"
"driver.sql_jdbc.execute$execute_reducible_query.invoke(execute.clj:487)"
"driver.sql_jdbc$fn__85057.invokeStatic(sql_jdbc.clj:54)"
"driver.sql_jdbc$fn__85057.invoke(sql_jdbc.clj:52)"
"query_processor.context$executef.invokeStatic(context.clj:59)"
"query_processor.context$executef.invoke(context.clj:48)"
"query_processor.context.default$default_runf.invokeStatic(default.clj:68)"
"query_processor.context.default$default_runf.invoke(default.clj:66)"
"query_processor.context$runf.invokeStatic(context.clj:45)"
"query_processor.context$runf.invoke(context.clj:39)"
"query_processor.reducible$pivot.invokeStatic(reducible.clj:34)"
"query_processor.reducible$pivot.invoke(reducible.clj:31)"
"query_processor.middleware.mbql_to_native$mbql__GT_native$fn__49067.invoke(mbql_to_native.clj:25)"
"query_processor.middleware.check_features$check_features$fn__49554.invoke(check_features.clj:39)"
"query_processor.middleware.limit$limit$fn__47440.invoke(limit.clj:37)"
"query_processor.middleware.cache$maybe_return_cached_results$fn__49928.invoke(cache.clj:204)"
"query_processor.middleware.optimize_temporal_filters$optimize_temporal_filters$fn__50921.invoke(optimize_temporal_filters.clj:204)"
"query_processor.middleware.validate_temporal_bucketing$validate_temporal_bucketing$fn__50965.invoke(validate_temporal_bucketing.clj:50)"
"query_processor.middleware.auto_parse_filter_values$auto_parse_filter_values$fn__49124.invoke(auto_parse_filter_values.clj:43)"
"query_processor.middleware.wrap_value_literals$wrap_value_literals$fn__39226.invoke(wrap_value_literals.clj:161)"
"query_processor.middleware.annotate$add_column_info$fn__43657.invoke(annotate.clj:615)"
"query_processor.middleware.permissions$check_query_permissions$fn__45595.invoke(permissions.clj:108)"
"query_processor.middleware.pre_alias_aggregations$pre_alias_aggregations$fn__50105.invoke(pre_alias_aggregations.clj:40)"
"query_processor.middleware.cumulative_aggregations$handle_cumulative_aggregations$fn__45993.invoke(cumulative_aggregations.clj:60)"
"query_processor.middleware.visualization_settings$update_viz_settings$fn__45931.invoke(visualization_settings.clj:63)"
"query_processor.middleware.resolve_joined_fields$resolve_joined_fields$fn__47038.invoke(resolve_joined_fields.clj:102)"
"query_processor.middleware.resolve_joins$resolve_joins$fn__50691.invoke(resolve_joins.clj:171)"
"query_processor.middleware.add_implicit_joins$add_implicit_joins$fn__50227.invoke(add_implicit_joins.clj:190)"
"query_processor.middleware.large_int_id$convert_id_to_string$fn__47057.invoke(large_int_id.clj:59)"
"query_processor.middleware.format_rows$format_rows$fn__50279.invoke(format_rows.clj:74)"
"query_processor.middleware.add_default_temporal_unit$add_default_temporal_unit$fn__46429.invoke(add_default_temporal_unit.clj:23)"
"query_processor.middleware.desugar$desugar$fn__45904.invoke(desugar.clj:21)"
"query_processor.middleware.binning$update_binning_strategy$fn__39126.invoke(binning.clj:229)"
"query_processor.middleware.resolve_fields$resolve_fields$fn__45238.invoke(resolve_fields.clj:34)"
"query_processor.middleware.add_dimension_projections$add_remapping$fn__49479.invoke(add_dimension_projections.clj:312)"
"query_processor.middleware.add_implicit_clauses$add_implicit_clauses$fn__49777.invoke(add_implicit_clauses.clj:147)"
"query_processor.middleware.upgrade_field_literals$upgrade_field_literals$fn__47425.invoke(upgrade_field_literals.clj:40)"
"query_processor.middleware.add_source_metadata$add_source_metadata_for_source_queries$fn__46806.invoke(add_source_metadata.clj:123)"
"query_processor.middleware.reconcile_breakout_and_order_by_bucketing$reconcile_breakout_and_order_by_bucketing$fn__50027.invoke(reconcile_breakout_and_order_by_bucketing.clj:100)"
"query_processor.middleware.auto_bucket_datetimes$auto_bucket_datetimes$fn__48376.invoke(auto_bucket_datetimes.clj:147)"
"query_processor.middleware.resolve_source_table$resolve_source_tables$fn__45219.invoke(resolve_source_table.clj:45)"
"query_processor.middleware.parameters$substitute_parameters$fn__48030.invoke(parameters.clj:111)"
"query_processor.middleware.resolve_referenced$resolve_referenced_card_resources$fn__45292.invoke(resolve_referenced.clj:79)"
"query_processor.middleware.expand_macros$expand_macros$fn__51349.invoke(expand_macros.clj:184)"
"query_processor.middleware.add_timezone_info$add_timezone_info$fn__47809.invoke(add_timezone_info.clj:15)"
"query_processor.middleware.splice_params_in_response$splice_params_in_response$fn__50294.invoke(splice_params_in_response.clj:32)"
"query_processor.middleware.resolve_database_and_driver$resolve_database_and_driver$fn__49788$fn__49792.invoke(resolve_database_and_driver.clj:31)"
"driver$do_with_driver.invokeStatic(driver.clj:60)"
"driver$do_with_driver.invoke(driver.clj:56)"
"query_processor.middleware.resolve_database_and_driver$resolve_database_and_driver$fn__49788.invoke(resolve_database_and_driver.clj:25)"
"query_processor.middleware.fetch_source_query$resolve_card_id_source_tables$fn__45842.invoke(fetch_source_query.clj:274)"
"query_processor.middleware.store$initialize_store$fn__46030$fn__46031.invoke(store.clj:11)"
"query_processor.store$do_with_store.invokeStatic(store.clj:44)"
"query_processor.store$do_with_store.invoke(store.clj:38)"
"query_processor.middleware.store$initialize_store$fn__46030.invoke(store.clj:10)"
"query_processor.middleware.validate$validate_query$fn__50077.invoke(validate.clj:10)"
"query_processor.middleware.normalize_query$normalize$fn__50084.invoke(normalize_query.clj:22)"
"query_processor.middleware.add_rows_truncated$add_rows_truncated$fn__47755.invoke(add_rows_truncated.clj:35)"
"query_processor.middleware.results_metadata$record_and_return_metadata_BANG_$fn__49053.invoke(results_metadata.clj:147)"
"query_processor.middleware.constraints$add_default_userland_constraints$fn__47773.invoke(constraints.clj:42)"
"query_processor.middleware.process_userland_query$process_userland_query$fn__50063.invoke(process_userland_query.clj:146)"
"query_processor.middleware.catch_exceptions$catch_exceptions$fn__50374.invoke(catch_exceptions.clj:169)"
"query_processor.reducible$async_qp$qp_STAR___42477$thunk__42478.invoke(reducible.clj:103)"
"query_processor.reducible$async_qp$qp_STAR___42477.invoke(reducible.clj:109)"
"query_processor.reducible$sync_qp$qp_STAR___42486$fn__42489.invoke(reducible.clj:135)"
"query_processor.reducible$sync_qp$qp_STAR___42486.invoke(reducible.clj:134)"
"query_processor$process_userland_query.invokeStatic(query_processor.clj:241)"
"query_processor$process_userland_query.doInvoke(query_processor.clj:237)"
"query_processor$fn__51397$process_query_and_save_execution_BANG___51406$fn__51409.invoke(query_processor.clj:253)"
"query_processor$fn__51397$process_query_and_save_execution_BANG___51406.invoke(query_processor.clj:245)"
"query_processor$fn__51441$process_query_and_save_with_max_results_constraints_BANG___51450$fn__51453.invoke(query_processor.clj:265)"
"query_processor$fn__51441$process_query_and_save_with_max_results_constraints_BANG___51450.invoke(query_processor.clj:258)"
"api.dataset$run_query_async$fn__57784.invoke(dataset.clj:64)"
"query_processor.streaming$streaming_response_STAR_$fn__38035$fn__38036.invoke(streaming.clj:148)"
"query_processor.streaming$streaming_response_STAR_$fn__38035.invoke(streaming.clj:147)"
"async.streaming_response$do_f_STAR_.invokeStatic(streaming_response.clj:65)"
"async.streaming_response$do_f_STAR_.invoke(streaming_response.clj:63)"
"async.streaming_response$do_f_async$fn__25228.invoke(streaming_response.clj:84)"],
:state nil}],
:json_query
{:database 4,
:native
{:template-tags
{:Data
{:id "01521a1d-df0d-5973-3871-c6e7b4e890ae", :name "Data", :display-name "Data", :type "date", :default nil}},
:query "select\n count(1)\nfrom\n raw_courier_api."order"\nwhere\n created_date_brt = {{ Data }}"},
:type "native",
:parameters [{:type "date/single", :value "2021-11-09", :target ["variable" ["template-tag" "Data"]]}],
:middleware {:js-int-to-string? true, :add-default-userland-constraints? true}},
:status :failed,
:class com.facebook.presto.jdbc.internal.client.FailureInfo$FailureException,
:stacktrace
["com.facebook.presto.sql.SqlFormatterUtil.getFormattedSql(SqlFormatterUtil.java:44)"
"com.facebook.presto.execution.PrepareTask.execute(PrepareTask.java:71)"
"com.facebook.presto.execution.PrepareTask.execute(PrepareTask.java:39)"
"com.facebook.presto.execution.DataDefinitionExecution.start(DataDefinitionExecution.java:213)"
"com.facebook.presto.$gen.Presto_0_263_SNAPSHOT_8478c37____20211112_190525_1.run(Unknown Source)"
"com.facebook.presto.execution.SqlQueryManager.createQuery(SqlQueryManager.java:266)"
"com.facebook.presto.dispatcher.LocalDispatchQuery.lambda$startExecution$7(LocalDispatchQuery.java:192)"
"java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)"
"java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)"
"java.lang.Thread.run(Thread.java:748)"
nil],
:card_id nil,
:context :ad-hoc,
:error
"Query failed (#20211112_224506_00043_dqvht): Formatted query does not parse: Query{queryBody=QuerySpecification{select=Select{distinct=false, selectItems=["count"(1)]}, from=Optional[Table{raw_courier_api.order}], where=(created_date_brt = ?), groupBy=Optional.empty, having=null, orderBy=Optional.empty, offset=null, limit=null}, orderBy=Optional.empty}",
:row_count 0,
:running_time 0,
:data {:rows [], :cols []}}

flamber · November 13, 2021, 9:36am

@rubenssoto So that looks like a bug in Presto itself, like you have already created an issue for:
https://github.com/prestodb/presto/issues/16987

rubenssoto · November 13, 2021, 4:06pm

@flamber yeah, after some tests I realize that is a Presto issue.

Thank you

Presto folks will fix the problem