How to increase query timeout - Your question took too long

Hello,

Getting the following when query is taking more than 2 min to return results. How can increase the query timeout? Our load balancer is already set up to 20 min, but getting the same result.

Your question took too long

We didnโ€™t get an answer back from your database in time, so we had to stop. You can try again in a minute, or if the problem persists, you can email an admin to let them know.

Please let me know if need more details.

Thank you in advance!
Omar

1 Like

Hi @omar
Check the headers of the request to see which reverse-proxy might be blocking the request - or check the logs of all reverse-proxies.
Search the forum and read this for more details:
https://github.com/metabase/metabase/issues/12423

Hi, i have this same problem.
I have Metabase behind a reverse proxy using nginx. I have set this in my Nginx config and restarted the service but still gets the message of "Question took too long" and times out.

http{
   proxy_read_timeout 3600;
   proxy_connect_timeout 3600;
   proxy_send_timeout 3600;
}

My report takes 10 minutes to timeout and below is my response from the network tab (chrome browser)

Access-Control-Allow-Methods: GET, PUT, POST, DELETE, HEAD, OPTIONS, COPY
Access-Control-Allow-Origin: http://abc.xxx.com
Cache-Control: must-revalidate,no-cache,no-store
Connection: keep-alive
Content-Length: 81
Content-Security-Policy: default-src 'none'; script-src 'self' 'unsafe-eval' https://maps.google.com https://apis.google.com https://www.google-analytics.com https://*.googleapis.com *.gstatic.com   'sha256-lMAh4yjVuDkQ9NqkK4H+YHUga+anpFs5JAuj/uZh0Rs=' 'sha256-sMNbXyc1lLzhHbH/CKs11HIQMnMkZAN2eA99WhJeEC0=' 'sha256-JJa56hyDfUbgNfq+0nq6Qs866JKgZ/+qCq2pkDJED8k='; child-src 'self' https://accounts.google.com; style-src 'self' 'unsafe-inline'; font-src 'self' ; img-src * 'self' data:; connect-src 'self' metabase.us10.list-manage.com ; manifest-src 'self';  frame-ancestors 'none';
Content-Type: application/json
Date: Fri, 30 Jul 2021 19:57:21 GMT
Server: nginx/1.10.3 (Ubuntu)
Strict-Transport-Security: max-age=31536000
X-Content-Type-Options: nosniff
X-Frame-Options: DENY
X-Permitted-Cross-Domain-Policies: none
X-XSS-Protection: 1; mode=block

Diagnostic info below

{
  "browser-info": {
    "language": "en-GB",
    "platform": "Win32",
    "userAgent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.107 Safari/537.36",
    "vendor": "Google Inc."
  },
  "system-info": {
    "file.encoding": "UTF-8",
    "java.runtime.name": "OpenJDK Runtime Environment",
    "java.runtime.version": "11.0.11+9",
    "java.vendor": "AdoptOpenJDK",
    "java.vendor.url": "https://adoptopenjdk.net/",
    "java.version": "11.0.11",
    "java.vm.name": "OpenJDK 64-Bit Server VM",
    "java.vm.version": "11.0.11+9",
    "os.name": "Linux",
    "os.version": "4.4.0-87-generic",
    "user.language": "en",
    "user.timezone": "GMT"
  },
  "metabase-info": {
    "databases": [
      "postgres",
      "mongo",
      "googleanalytics"
    ],
    "hosting-env": "unknown",
    "application-database": "postgres",
    "application-database-details": {
      "database": {
        "name": "PostgreSQL",
        "version": "11.8 (Ubuntu 11.8-1.pgdg16.04+1)"
      },
      "jdbc-driver": {
        "name": "PostgreSQL JDBC Driver",
        "version": "42.2.18"
      }
    },
    "run-mode": "prod",
    "version": {
      "date": "2021-07-14",
      "tag": "v0.40.1",
      "branch": "release-x.40.x",
      "hash": "ed8f9c8"
    },
    "settings": {
      "report-timezone": null
    }
  }
}

Hi @anonymous

Post the output of nginx -v - if you are really using Nginx 1.10.3, then you should really upgrade.

You are setting the timeouts for the http context. It does not show if you have other configurations at lower contexts like server or location, which might overrule that.

See all your configuration with nginx -T

But why are you using a reverse-proxy? It looks like you're using http based on the ACAO header.

Output of nginx -v

nginx version: nginx/1.10.3 (Ubuntu)

im setting the timeout at the http context and i don't have any timeout configurations set at lower contexts.

# configuration file /etc/nginx/nginx.conf:
user www-data;
worker_processes 1;
pid /run/nginx.pid;

events {
        worker_connections 1024;
        # multi_accept on;
}

http {

        ##
        # Basic Settings
        ##

        sendfile on;
        tcp_nopush on;
        tcp_nodelay on;
        keepalive_timeout 3600;
        types_hash_max_size 3600;

        proxy_read_timeout 3600;
        proxy_connect_timeout 3600;
        proxy_send_timeout 3600;

        # server_tokens off;

        # server_names_hash_bucket_size 64;
        # server_name_in_redirect off;

        include /etc/nginx/mime.types;
        default_type application/octet-stream;

        ##
        # SSL Settings
        ##

        ssl_protocols TLSv1 TLSv1.1 TLSv1.2; # Dropping SSLv3, ref: POODLE
        ssl_prefer_server_ciphers on;

        ##
        # Logging Settings
        ##

        access_log /var/log/nginx/access.log;
        error_log /var/log/nginx/error.log;

        ##
        # Gzip Settings
        ##

        gzip on;
        gzip_disable "msie6";

        # gzip_vary on;
        # gzip_proxied any;
        # gzip_comp_level 6;
        # gzip_buffers 16 8k;
        # gzip_http_version 1.1;
        # gzip_types text/plain text/css application/json application/javascript text/xml application/xml application/xml+rss text/javascript;

        ##
        # Virtual Host Configs
        ##

        include /etc/nginx/conf.d/*.conf;
        include /etc/nginx/sites-enabled/*;
}


#mail {
#       # See sample authentication script at:
#       # http://wiki.nginx.org/ImapAuthenticateWithApachePhpScript
#
#       # auth_http localhost/auth.php;
#       # pop3_capabilities "TOP" "USER";
#       # imap_capabilities "IMAP4rev1" "UIDPLUS";
#
#       server {
#               listen     localhost:110;
#               protocol   pop3;
#               proxy      on;
#       }
#
#       server {
#               listen     localhost:143;
#               protocol   imap;
#               proxy      on;
#       }
#}

# configuration file /etc/nginx/mime.types:

types {
    text/html                             html htm shtml;
    text/css                              css;
    text/xml                              xml;
    image/gif                             gif;
    image/jpeg                            jpeg jpg;
    application/javascript                js;
    application/atom+xml                  atom;
    application/rss+xml                   rss;

    text/mathml                           mml;
    text/plain                            txt;
    text/vnd.sun.j2me.app-descriptor      jad;
    text/vnd.wap.wml                      wml;
    text/x-component                      htc;

    image/png                             png;
    image/tiff                            tif tiff;
    image/vnd.wap.wbmp                    wbmp;
    image/x-icon                          ico;
    image/x-jng                           jng;
    image/x-ms-bmp                        bmp;
    image/svg+xml                         svg svgz;
    image/webp                            webp;

    application/font-woff                 woff;
    application/java-archive              jar war ear;
    application/json                      json;
    application/mac-binhex40              hqx;
    application/msword                    doc;
    application/pdf                       pdf;
    application/postscript                ps eps ai;
    application/rtf                       rtf;
    application/vnd.apple.mpegurl         m3u8;
    application/vnd.ms-excel              xls;
    application/vnd.ms-fontobject         eot;
    application/vnd.ms-powerpoint         ppt;
    application/vnd.wap.wmlc              wmlc;
    application/vnd.google-earth.kml+xml  kml;
    application/vnd.google-earth.kmz      kmz;
    application/x-7z-compressed           7z;
    application/x-cocoa                   cco;
    application/x-java-archive-diff       jardiff;
    application/x-java-jnlp-file          jnlp;
    application/x-makeself                run;
    application/x-perl                    pl pm;
    application/x-pilot                   prc pdb;
    application/x-rar-compressed          rar;
    application/x-redhat-package-manager  rpm;
    application/x-sea                     sea;
    application/x-shockwave-flash         swf;
    application/x-stuffit                 sit;
    application/x-tcl                     tcl tk;
    application/x-x509-ca-cert            der pem crt;
    application/x-xpinstall               xpi;
    application/xhtml+xml                 xhtml;
    application/xspf+xml                  xspf;
    application/zip                       zip;

    application/octet-stream              bin exe dll;
    application/octet-stream              deb;
    application/octet-stream              dmg;
    application/octet-stream              iso img;
    application/octet-stream              msi msp msm;

    application/vnd.openxmlformats-officedocument.wordprocessingml.document    docx;
    application/vnd.openxmlformats-officedocument.spreadsheetml.sheet          xlsx;
    application/vnd.openxmlformats-officedocument.presentationml.presentation  pptx;

    audio/midi                            mid midi kar;
    audio/mpeg                            mp3;
    audio/ogg                             ogg;
    audio/x-m4a                           m4a;
    audio/x-realaudio                     ra;

    video/3gpp                            3gpp 3gp;
    video/mp2t                            ts;
    video/mp4                             mp4;
    video/mpeg                            mpeg mpg;
    video/quicktime                       mov;
    video/webm                            webm;
    video/x-flv                           flv;
    video/x-m4v                           m4v;
    video/x-mng                           mng;
    video/x-ms-asf                        asx asf;
    video/x-ms-wmv                        wmv;
    video/x-msvideo                       avi;
}

# configuration file /etc/nginx/sites-enabled/metabase.conf:
server {
     listen [::]:80;
     listen 80;

     server_name abc.xxx.com;


    root /var/www/html;

        add_header 'Access-Control-Allow-Origin' '*';
        add_header 'Access-Control-Allow-Credentials' 'true';
        add_header 'Access-Control-Allow-Headers' 'Authorization,Accept,Origin,DNT,X-CustomHeader,Keep-Alive,User-Agent,X-Requested-With,If-Modified-Since,Cache-Control,Content-Type,Content-Range,Range';
    add_header 'Access-Control-Allow-Methods' 'GET,POST,OPTIONS,PUT,DELETE,PATCH';

     location / {
         proxy_set_header X-Forwarded-Host $host;
         proxy_set_header X-Forwarded-Server $host;
         proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
         proxy_pass http://localhost:3000;
         proxy_http_version 1.1;
         client_max_body_size 3000M;
     }
 }

@anonymous

  1. Are you 100% sure that there isn't another proxy somewhere? Post the full stacktrace from Admin > Troubleshooting > Logs, when you see the error in Metabase.
  2. Upgrade Nginx - it's 4 years old and there has been several security fixes since
  3. I don't even understand why you're using a reverse-proxy. Can you explain why?
  4. What are the Access-Control-Allow-* headers supposed to do?
  5. Try setting the proxy_* configurations inside of location context

I have upgraded nginx to nginx/1.16.1 and have set the proxy_* configurations inside of the location context.

Im running metabase with docker, so thats where the idea of reverse proxy comes in.
Also i have Access-Control-Allow-* as part of the headers because of the tutorials i used in setting it up. Basically to allow them if they are not enabled.

full stacktrace from Admin > Troubleshooting > Logs,


[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:21:10+00:00 DEBUG metabase.server.middleware.log POST /api/dataset 202 [ASYNC: canceled] 10.0 mins (8 DB calls) App DB connections: 0/15 Jetty threads: 3/50 (3 idle, 0 queued) (121 total active threads) Queries in flight: 1 (0 queued); postgres DB 2 connections: 0/1 (0 threads blocked)
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:22:42+00:00 DEBUG metabase.server.middleware.log POST /api/card/421/query 202 [ASYNC: canceled] 10.0 mins (10 DB calls) App DB connections: 1/15 Jetty threads: 3/50 (3 idle, 0 queued) (121 total active threads) Queries in flight: 0 (0 queued); postgres DB 2 connections: 1/1 (0 threads blocked)
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:22:43+00:00 ERROR metabase.query-processor.middleware.catch-exceptions Error processing query: null
{:database_id 2,
 :started_at #t "2021-08-03T13:12:42.060993Z[GMT]",
 :via
 [{:status :failed,
   :class clojure.lang.ExceptionInfo,
   :error "Error executing query",
   :stacktrace
   ["--> driver.sql_jdbc.execute$execute_reducible_query$fn__80802.invoke(execute.clj:480)"
    "driver.sql_jdbc.execute$execute_reducible_query.invokeStatic(execute.clj:477)"
    "driver.sql_jdbc.execute$execute_reducible_query.invoke(execute.clj:463)"
    "driver.sql_jdbc.execute$execute_reducible_query.invokeStatic(execute.clj:472)"
    "driver.sql_jdbc.execute$execute_reducible_query.invoke(execute.clj:463)"
    "driver.sql_jdbc$fn__82291.invokeStatic(sql_jdbc.clj:54)"
    "driver.sql_jdbc$fn__82291.invoke(sql_jdbc.clj:52)"
    "query_processor.context$executef.invokeStatic(context.clj:59)"
    "query_processor.context$executef.invoke(context.clj:48)"
    "query_processor.context.default$default_runf.invokeStatic(default.clj:68)"
    "query_processor.context.default$default_runf.invoke(default.clj:66)"
    "query_processor.context$runf.invokeStatic(context.clj:45)"
    "query_processor.context$runf.invoke(context.clj:39)"
    "query_processor.reducible$pivot.invokeStatic(reducible.clj:34)"
    "query_processor.reducible$pivot.invoke(reducible.clj:31)"
    "query_processor.middleware.mbql_to_native$mbql__GT_native$fn__47888.invoke(mbql_to_native.clj:25)"
    "query_processor.middleware.check_features$check_features$fn__47002.invoke(check_features.clj:39)"
    "query_processor.middleware.limit$limit$fn__47874.invoke(limit.clj:37)"
    "query_processor.middleware.cache$run_query_with_cache.invokeStatic(cache.clj:177)"
    "query_processor.middleware.cache$run_query_with_cache.invoke(cache.clj:168)"
    "query_processor.middleware.cache$maybe_return_cached_results$fn__46454.invoke(cache.clj:203)"
    "query_processor.middleware.optimize_temporal_filters$optimize_temporal_filters$fn__48134.invoke(optimize_temporal_filters.clj:204)"
    "query_processor.middleware.validate_temporal_bucketing$validate_temporal_bucketing$fn__50066.invoke(validate_temporal_bucketing.clj:50)"
    "query_processor.middleware.auto_parse_filter_values$auto_parse_filter_values$fn__45573.invoke(auto_parse_filter_values.clj:43)"
    "query_processor.middleware.wrap_value_literals$wrap_value_literals$fn__41707.invoke(wrap_value_literals.clj:161)"
    "query_processor.middleware.annotate$add_column_info$fn__41582.invoke(annotate.clj:608)"
    "query_processor.middleware.permissions$check_query_permissions$fn__46874.invoke(permissions.clj:81)"
    "query_processor.middleware.pre_alias_aggregations$pre_alias_aggregations$fn__48995.invoke(pre_alias_aggregations.clj:40)"
    "query_processor.middleware.cumulative_aggregations$handle_cumulative_aggregations$fn__47075.invoke(cumulative_aggregations.clj:60)"
    "query_processor.middleware.resolve_joined_fields$resolve_joined_fields$fn__49292.invoke(resolve_joined_fields.clj:102)"
    "query_processor.middleware.resolve_joins$resolve_joins$fn__49605.invoke(resolve_joins.clj:171)"
    "query_processor.middleware.add_implicit_joins$add_implicit_joins$fn__45149.invoke(add_implicit_joins.clj:190)"
    "query_processor.middleware.large_int_id$convert_id_to_string$fn__47838.invoke(large_int_id.clj:59)"
    "query_processor.middleware.format_rows$format_rows$fn__47819.invoke(format_rows.clj:74)"
    "query_processor.middleware.add_default_temporal_unit$add_default_temporal_unit$fn__44443.invoke(add_default_temporal_unit.clj:23)"
    "query_processor.middleware.desugar$desugar$fn__47141.invoke(desugar.clj:21)"
    "query_processor.middleware.binning$update_binning_strategy$fn__45960.invoke(binning.clj:229)"
    "query_processor.middleware.resolve_fields$resolve_fields$fn__46677.invoke(resolve_fields.clj:34)"
    "query_processor.middleware.add_dimension_projections$add_remapping$fn__44798.invoke(add_dimension_projections.clj:312)"
    "query_processor.middleware.add_implicit_clauses$add_implicit_clauses$fn__45027.invoke(add_implicit_clauses.clj:147)"
    "query_processor.middleware.upgrade_field_literals$upgrade_field_literals$fn__50015.invoke(upgrade_field_literals.clj:40)"
    "query_processor.middleware.add_source_metadata$add_source_metadata_for_source_queries$fn__45312.invoke(add_source_metadata.clj:123)"
    "query_processor.middleware.reconcile_breakout_and_order_by_bucketing$reconcile_breakout_and_order_by_bucketing$fn__49167.invoke(reconcile_breakout_and_order_by_bucketing.clj:100)"
    "query_processor.middleware.auto_bucket_datetimes$auto_bucket_datetimes$fn__45520.invoke(auto_bucket_datetimes.clj:147)"
    "query_processor.middleware.resolve_source_table$resolve_source_tables$fn__46724.invoke(resolve_source_table.clj:45)"
    "query_processor.middleware.parameters$substitute_parameters$fn__48977.invoke(parameters.clj:111)"
    "query_processor.middleware.resolve_referenced$resolve_referenced_card_resources$fn__46776.invoke(resolve_referenced.clj:79)"
    "query_processor.middleware.expand_macros$expand_macros$fn__47525.invoke(expand_macros.clj:184)"
    "query_processor.middleware.add_timezone_info$add_timezone_info$fn__45321.invoke(add_timezone_info.clj:15)"
    "query_processor.middleware.splice_params_in_response$splice_params_in_response$fn__49968.invoke(splice_params_in_response.clj:32)"
    "query_processor.middleware.resolve_database_and_driver$resolve_database_and_driver$fn__49178$fn__49182.invoke(resolve_database_and_driver.clj:31)"
    "driver$do_with_driver.invokeStatic(driver.clj:60)"
    "driver$do_with_driver.invoke(driver.clj:56)"
    "query_processor.middleware.resolve_database_and_driver$resolve_database_and_driver$fn__49178.invoke(resolve_database_and_driver.clj:25)"
    "query_processor.middleware.fetch_source_query$resolve_card_id_source_tables$fn__47765.invoke(fetch_source_query.clj:274)"
    "query_processor.middleware.store$initialize_store$fn__49977$fn__49978.invoke(store.clj:11)"
    "query_processor.store$do_with_store.invokeStatic(store.clj:44)"
    "query_processor.store$do_with_store.invoke(store.clj:38)"
    "query_processor.middleware.store$initialize_store$fn__49977.invoke(store.clj:10)"
    "query_processor.middleware.validate$validate_query$fn__50022.invoke(validate.clj:10)"
    "query_processor.middleware.normalize_query$normalize$fn__47901.invoke(normalize_query.clj:22)"
    "query_processor.middleware.add_rows_truncated$add_rows_truncated$fn__45167.invoke(add_rows_truncated.clj:35)"
    "query_processor.middleware.results_metadata$record_and_return_metadata_BANG_$fn__49953.invoke(results_metadata.clj:147)"
    "query_processor.middleware.constraints$add_default_userland_constraints$fn__47018.invoke(constraints.clj:42)"
    "query_processor.middleware.process_userland_query$process_userland_query$fn__49064.invoke(process_userland_query.clj:134)"
    "query_processor.middleware.catch_exceptions$catch_exceptions$fn__46958.invoke(catch_exceptions.clj:173)"
    "query_processor.reducible$async_qp$qp_STAR___38246$thunk__38247.invoke(reducible.clj:103)"
    "query_processor.reducible$async_qp$qp_STAR___38246$fn__38249.invoke(reducible.clj:108)"],
   :error_type :invalid-query,
   :ex-data
   {:sql
    "-- Metabase:: userID: 50 queryType: native queryHash: b2eca596241b55da5c7685d1082e95675b1f835329a6df84e0b5dff67c2d4591\nwith code as (\r\n    select fund_code from scheme_share_class where \"public\".\"scheme_share_class\".\"name\" IN (?)\r\n)\r\n\r\nSELECT \tdistinct\r\n    deal.client_petraid \"Client PetraID\",\r\n    deal.customer_petraid \"Customer PetraID\",\r\n    public.petra_crm_customer.fullname  \"Customer Name\",\r\n    -- deal.created_at \"Deal Created At\",\r\n    public.scheme_share_class.name \"Scheme\",\r\n    -- payment.created_at \"Payment Date\",\r\n    -- schedule.match_processed_at \"Match Processed Date\",\r\n    deal.price_date \"Deal PriceDate\",\r\n    deal.deal_description \"Deal Description\",\r\n    dc.deal_contribution_type \"Deal Contribution Type\",\r\n    deal.status \"Status\",\r\n    sum((CASE \r\n        WHEN (deal.deal_type != 'issue') \r\n        THEN -1 ELSE 1 END\r\n    ) * coalesce(dc.amount, 0) ) \"Amount (GHS)\",\r\n    sum(dc.units) \"Units\",\r\n    \r\n    -- (select fund_code from code),\r\n    \r\n    round((sum(dc.units) over ( PARTITION BY deal.customer_petraid order by deal.price_date asc rows between unbounded preceding and current row)),6) \"Cummulative Units\"\r\n    \r\n    -- ,( select price \r\n    --         from petra_crm_price pr \r\n    --         JOIN petra_crm_product p on pr.product = p.id  \r\n    --         where p.entity_key = 'FD00000181' and pr.pricedate = deal.price_date limit 1\r\n    -- )\r\n    ,(date_trunc('MONTH', deal.price_date::date) + INTERVAL '1 MONTH - 1 day')::date \"AUM PriceDate\"\r\n    ,round((sum(dc.units) over ( PARTITION BY deal.customer_petraid order by deal.price_date asc rows between unbounded preceding and current row)),6) * \r\n    (\r\n        ( select price \r\n                from petra_crm_price pr \r\n                JOIN petra_crm_product p on pr.product = p.id  \r\n                where p.entity_key = (select fund_code from code) and pr.pricedate <= (select (date_trunc('MONTH', deal.price_date::date) + INTERVAL '1 MONTH - 1 day')::date)\r\n                order by pricedate desc limit 1\r\n        )\r\n    ) \"AUM [End of PriceDate Month]\"\r\n\r\nFROM\r\n-- DEALS\r\npublic.deal_contribution dc\r\nright JOIN public.deal deal on deal.id = dc.deal_id\r\nleft JOIN public.scheme_share_class  on public.scheme_share_class.id = deal.share_class_id\r\n\r\nleft JOIN public.payment payment on payment.id = deal.related_payment_id\r\nleft join public.petra_crm_customer  on petra_crm_customer.petraid = deal.customer_petraid\r\nleft join public.petra_crm_client clients on clients.petraid = deal.client_petraid\r\n-- left join public.schedule schedule on schedule.id = deal.related_schedule_id\r\n\r\nwhere deal.customer_petraid != 'HI00000000'\r\nand deal.price_date::date >= ? and deal.price_date::date < ? + interval '1' day\r\nand deal.status = 'visible' \r\n  and deal.client_petraid = ? \r\n\r\n    and \"public\".\"scheme_share_class\".\"name\" IN (?) \r\ngroup by deal.id, dc.id, public.petra_crm_customer.id, clients.id, scheme_share_class.name ,payment.created_at--,schedule.match_processed_at\r\norder by deal.price_date, deal.customer_petraid desc",
    :params
    ["Ghana Grid Company Limited Tier 3 Pension Scheme Internal Fund"
     #t "2012-01-11"
     #t "2021-08-03"
     "CO00000254"
     "Ghana Grid Company Limited Tier 3 Pension Scheme Internal Fund"],
    :type :invalid-query}}],
 :state "57014",
 :error_type :invalid-query,
 :json_query
 {:constraints {:max-results 10000, :max-results-bare-rows 2000},
  :type :native,
  :middleware {:js-int-to-string? true, :ignore-cached-results? true},
  :native
  {:query
   "with code as (\r\n    select fund_code from scheme_share_class where {{scheme}}\r\n)\r\n\r\nSELECT \tdistinct\r\n    deal.client_petraid \"Client PetraID\",\r\n    deal.customer_petraid \"Customer PetraID\",\r\n    public.petra_crm_customer.fullname  \"Customer Name\",\r\n    -- deal.created_at \"Deal Created At\",\r\n    public.scheme_share_class.name \"Scheme\",\r\n    -- payment.created_at \"Payment Date\",\r\n    -- schedule.match_processed_at \"Match Processed Date\",\r\n    deal.price_date \"Deal PriceDate\",\r\n    deal.deal_description \"Deal Description\",\r\n    dc.deal_contribution_type \"Deal Contribution Type\",\r\n    deal.status \"Status\",\r\n    sum((CASE \r\n        WHEN (deal.deal_type != 'issue') \r\n        THEN -1 ELSE 1 END\r\n    ) * coalesce(dc.amount, 0) ) \"Amount (GHS)\",\r\n    sum(dc.units) \"Units\",\r\n    \r\n    -- (select fund_code from code),\r\n    \r\n    round((sum(dc.units) over ( PARTITION BY deal.customer_petraid order by deal.price_date asc rows between unbounded preceding and current row)),6) \"Cummulative Units\"\r\n    \r\n    -- ,( select price \r\n    --         from petra_crm_price pr \r\n    --         JOIN petra_crm_product p on pr.product = p.id  \r\n    --         where p.entity_key = 'FD00000181' and pr.pricedate = deal.price_date limit 1\r\n    -- )\r\n    ,(date_trunc('MONTH', deal.price_date::date) + INTERVAL '1 MONTH - 1 day')::date \"AUM PriceDate\"\r\n    ,round((sum(dc.units) over ( PARTITION BY deal.customer_petraid order by deal.price_date asc rows between unbounded preceding and current row)),6) * \r\n    (\r\n        ( select price \r\n                from petra_crm_price pr \r\n                JOIN petra_crm_product p on pr.product = p.id  \r\n                where p.entity_key = (select fund_code from code) and pr.pricedate <= (select (date_trunc('MONTH', deal.price_date::date) + INTERVAL '1 MONTH - 1 day')::date)\r\n                order by pricedate desc limit 1\r\n        )\r\n    ) \"AUM [End of PriceDate Month]\"\r\n\r\nFROM\r\n-- DEALS\r\npublic.deal_contribution dc\r\nright JOIN public.deal deal on deal.id = dc.deal_id\r\nleft JOIN public.scheme_share_class  on public.scheme_share_class.id = deal.share_class_id\r\n\r\nleft JOIN public.payment payment on payment.id = deal.related_payment_id\r\nleft join public.petra_crm_customer  on petra_crm_customer.petraid = deal.customer_petraid\r\nleft join public.petra_crm_client clients on clients.petraid = deal.client_petraid\r\n-- left join public.schedule schedule on schedule.id = deal.related_schedule_id\r\n\r\nwhere deal.customer_petraid != 'HI00000000'\r\nand deal.price_date::date >= {{start_date}} and deal.price_date::date < {{end_date}} + interval '1' day\r\nand deal.status = 'visible' \r\n[[  and deal.client_petraid = {{client}} ]]\r\n[[  and {{customers}} ]]\r\n    and {{scheme}} \r\ngroup by deal.id, dc.id, public.petra_crm_customer.id, clients.id, scheme_share_class.name ,payment.created_at--,schedule.match_processed_at\r\norder by deal.price_date, deal.customer_petraid desc\r\n\r\n\r\n",
   :template-tags
   {"start_date"
    {:id "f2333caf-3813-9f8c-450e-07ac0a42b998",
     :name "start_date",
     :display-name "Start Date",
     :type :date,
     :required true},
    "end_date"
    {:id "7cbc2e81-99eb-6e4b-6bef-259d7d0a1c54",
     :name "end_date",
     :display-name "End Date",
     :type :date,
     :required true},
    "client"
    {:id "c3cab7db-91c2-26e1-6b95-5d43a96325fd",
     :name "client",
     :display-name "Client ID",
     :type :text,
     :required true,
     :default "CO00000254"},
    "scheme"
    {:id "2750bea1-0e78-19bc-ed80-ad66cd23c7f2",
     :name "scheme",
     :display-name "Scheme",
     :type :dimension,
     :dimension [:field 66 nil],
     :widget-type :category,
     :required true,
     :default ["Ghana Grid Company Limited Tier 2"]},
    "customers"
    {:id "2009402d-ed6a-eb9f-01aa-fbc1745843cb",
     :name "customers",
     :display-name "Customers",
     :type :dimension,
     :dimension [:field 2649 nil],
     :widget-type :category}}},
  :database 2,
  :parameters
  [{:type "date/single", :value "2012-01-11", :target ["variable" ["template-tag" "start_date"]]}
   {:type "date/single", :value "2021-08-03", :target ["variable" ["template-tag" "end_date"]]}
   {:type "category", :value "CO00000254", :target ["variable" ["template-tag" "client"]]}
   {:type "category",
    :value ["Ghana Grid Company Limited Tier 3 Pension Scheme Internal Fund"],
    :target ["dimension" ["template-tag" "scheme"]]}],
  :async? true,
  :cache-ttl 33123120},
 :status :failed,
 :class org.postgresql.util.PSQLException,
 :stacktrace
 ["org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2553)"
  "org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2285)"
  "org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:323)"
  "org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:473)"
  "org.postgresql.jdbc.PgStatement.execute(PgStatement.java:393)"
  "org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:164)"
  "org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:114)"
  "com.mchange.v2.c3p0.impl.NewProxyPreparedStatement.executeQuery(NewProxyPreparedStatement.java:431)"
  "--> driver.sql_jdbc.execute$fn__80720.invokeStatic(execute.clj:340)"
  "driver.sql_jdbc.execute$fn__80720.invoke(execute.clj:338)"
  "driver.sql_jdbc.execute$execute_statement_or_prepared_statement_BANG_.invokeStatic(execute.clj:353)"
  "driver.sql_jdbc.execute$execute_statement_or_prepared_statement_BANG_.invoke(execute.clj:349)"
  "driver.sql_jdbc.execute$execute_reducible_query$fn__80802.invoke(execute.clj:478)"
  "driver.sql_jdbc.execute$execute_reducible_query.invokeStatic(execute.clj:477)"
  "driver.sql_jdbc.execute$execute_reducible_query.invoke(execute.clj:463)"
  "driver.sql_jdbc.execute$execute_reducible_query.invokeStatic(execute.clj:472)"
  "driver.sql_jdbc.execute$execute_reducible_query.invoke(execute.clj:463)"
  "driver.sql_jdbc$fn__82291.invokeStatic(sql_jdbc.clj:54)"
  "driver.sql_jdbc$fn__82291.invoke(sql_jdbc.clj:52)"
  "query_processor.context$executef.invokeStatic(context.clj:59)"
  "query_processor.context$executef.invoke(context.clj:48)"
  "query_processor.context.default$default_runf.invokeStatic(default.clj:68)"
  "query_processor.context.default$default_runf.invoke(default.clj:66)"
  "query_processor.context$runf.invokeStatic(context.clj:45)"
  "query_processor.context$runf.invoke(context.clj:39)"
  "query_processor.reducible$pivot.invokeStatic(reducible.clj:34)"
  "query_processor.reducible$pivot.invoke(reducible.clj:31)"
  "query_processor.middleware.mbql_to_native$mbql__GT_native$fn__47888.invoke(mbql_to_native.clj:25)"
  "query_processor.middleware.check_features$check_features$fn__47002.invoke(check_features.clj:39)"
  "query_processor.middleware.limit$limit$fn__47874.invoke(limit.clj:37)"
  "query_processor.middleware.cache$run_query_with_cache.invokeStatic(cache.clj:177)"
  "query_processor.middleware.cache$run_query_with_cache.invoke(cache.clj:168)"
  "query_processor.middleware.cache$maybe_return_cached_results$fn__46454.invoke(cache.clj:203)"
  "query_processor.middleware.optimize_temporal_filters$optimize_temporal_filters$fn__48134.invoke(optimize_temporal_filters.clj:204)"
  "query_processor.middleware.validate_temporal_bucketing$validate_temporal_bucketing$fn__50066.invoke(validate_temporal_bucketing.clj:50)"
  "query_processor.middleware.auto_parse_filter_values$auto_parse_filter_values$fn__45573.invoke(auto_parse_filter_values.clj:43)"
  "query_processor.middleware.wrap_value_literals$wrap_value_literals$fn__41707.invoke(wrap_value_literals.clj:161)"
  "query_processor.middleware.annotate$add_column_info$fn__41582.invoke(annotate.clj:608)"
  "query_processor.middleware.permissions$check_query_permissions$fn__46874.invoke(permissions.clj:81)"
  "query_processor.middleware.pre_alias_aggregations$pre_alias_aggregations$fn__48995.invoke(pre_alias_aggregations.clj:40)"
  "query_processor.middleware.cumulative_aggregations$handle_cumulative_aggregations$fn__47075.invoke(cumulative_aggregations.clj:60)"
  "query_processor.middleware.resolve_joined_fields$resolve_joined_fields$fn__49292.invoke(resolve_joined_fields.clj:102)"
  "query_processor.middleware.resolve_joins$resolve_joins$fn__49605.invoke(resolve_joins.clj:171)"
  "query_processor.middleware.add_implicit_joins$add_implicit_joins$fn__45149.invoke(add_implicit_joins.clj:190)"
  "query_processor.middleware.large_int_id$convert_id_to_string$fn__47838.invoke(large_int_id.clj:59)"
  "query_processor.middleware.format_rows$format_rows$fn__47819.invoke(format_rows.clj:74)"
  "query_processor.middleware.add_default_temporal_unit$add_default_temporal_unit$fn__44443.invoke(add_default_temporal_unit.clj:23)"
  "query_processor.middleware.desugar$desugar$fn__47141.invoke(desugar.clj:21)"
  "query_processor.middleware.binning$update_binning_strategy$fn__45960.invoke(binning.clj:229)"
  "query_processor.middleware.resolve_fields$resolve_fields$fn__46677.invoke(resolve_fields.clj:34)"
  "query_processor.middleware.add_dimension_projections$add_remapping$fn__44798.invoke(add_dimension_projections.clj:312)"
  "query_processor.middleware.add_implicit_clauses$add_implicit_clauses$fn__45027.invoke(add_implicit_clauses.clj:147)"
  "query_processor.middleware.upgrade_field_literals$upgrade_field_literals$fn__50015.invoke(upgrade_field_literals.clj:40)"
  "query_processor.middleware.add_source_metadata$add_source_metadata_for_source_queries$fn__45312.invoke(add_source_metadata.clj:123)"
  "query_processor.middleware.reconcile_breakout_and_order_by_bucketing$reconcile_breakout_and_order_by_bucketing$fn__49167.invoke(reconcile_breakout_and_order_by_bucketing.clj:100)"
  "query_processor.middleware.auto_bucket_datetimes$auto_bucket_datetimes$fn__45520.invoke(auto_bucket_datetimes.clj:147)"
  "query_processor.middleware.resolve_source_table$resolve_source_tables$fn__46724.invoke(resolve_source_table.clj:45)"
  "query_processor.middleware.parameters$substitute_parameters$fn__48977.invoke(parameters.clj:111)"
  "query_processor.middleware.resolve_referenced$resolve_referenced_card_resources$fn__46776.invoke(resolve_referenced.clj:79)"
  "query_processor.middleware.expand_macros$expand_macros$fn__47525.invoke(expand_macros.clj:184)"
  "query_processor.middleware.add_timezone_info$add_timezone_info$fn__45321.invoke(add_timezone_info.clj:15)"
  "query_processor.middleware.splice_params_in_response$splice_params_in_response$fn__49968.invoke(splice_params_in_response.clj:32)"
  "query_processor.middleware.resolve_database_and_driver$resolve_database_and_driver$fn__49178$fn__49182.invoke(resolve_database_and_driver.clj:31)"
  "driver$do_with_driver.invokeStatic(driver.clj:60)"
  "driver$do_with_driver.invoke(driver.clj:56)"
  "query_processor.middleware.resolve_database_and_driver$resolve_database_and_driver$fn__49178.invoke(resolve_database_and_driver.clj:25)"
  "query_processor.middleware.fetch_source_query$resolve_card_id_source_tables$fn__47765.invoke(fetch_source_query.clj:274)"
  "query_processor.middleware.store$initialize_store$fn__49977$fn__49978.invoke(store.clj:11)"
  "query_processor.store$do_with_store.invokeStatic(store.clj:44)"
  "query_processor.store$do_with_store.invoke(store.clj:38)"
  "query_processor.middleware.store$initialize_store$fn__49977.invoke(store.clj:10)"
  "query_processor.middleware.validate$validate_query$fn__50022.invoke(validate.clj:10)"
  "query_processor.middleware.normalize_query$normalize$fn__47901.invoke(normalize_query.clj:22)"
  "query_processor.middleware.add_rows_truncated$add_rows_truncated$fn__45167.invoke(add_rows_truncated.clj:35)"
  "query_processor.middleware.results_metadata$record_and_return_metadata_BANG_$fn__49953.invoke(results_metadata.clj:147)"
  "query_processor.middleware.constraints$add_default_userland_constraints$fn__47018.invoke(constraints.clj:42)"
  "query_processor.middleware.process_userland_query$process_userland_query$fn__49064.invoke(process_userland_query.clj:134)"
  "query_processor.middleware.catch_exceptions$catch_exceptions$fn__46958.invoke(catch_exceptions.clj:173)"
  "query_processor.reducible$async_qp$qp_STAR___38246$thunk__38247.invoke(reducible.clj:103)"
  "query_processor.reducible$async_qp$qp_STAR___38246$fn__38249.invoke(reducible.clj:108)"],
 :context :question,
 :error "ERROR: canceling statement due to user request",
 :row_count 0,
 :running_time 0,
 :data {:rows [], :cols []}}

[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:27:00+00:00 INFO metabase.task.sync-databases Starting sync task for Database 8.
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:27:00+00:00 INFO metabase.sync.util STARTING: Sync metadata for mongo Database 8 'ANALISA'
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:27:00+00:00 INFO metabase.sync.util STARTING: step 'sync-timezone' for mongo Database 8 'ANALISA'
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:27:00+00:00 INFO metabase.sync.util FINISHED: step 'sync-timezone' for mongo Database 8 'ANALISA' (556.3 ยตs)
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:27:00+00:00 INFO metabase.sync.util STARTING: step 'sync-tables' for mongo Database 8 'ANALISA'
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:27:00+00:00 INFO metabase.sync.sync-metadata.tables Updating description for tables: (Table  'email_with_schedule_unprocessed' Table  'email_with_unprocessed_schedule' Table  'contact_person' Table  'email_with_schedule_attachment' Table  'daily_stats_of_emails' Table  'client')
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:27:00+00:00 INFO metabase.sync.util FINISHED: step 'sync-tables' for mongo Database 8 'ANALISA' (41.2 ms)
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:27:00+00:00 INFO metabase.sync.util STARTING: step 'sync-fields' for mongo Database 8 'ANALISA'
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:27:00+00:00 INFO metabase.sync.util FINISHED: step 'sync-fields' for mongo Database 8 'ANALISA' (730.2 ms)
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:27:00+00:00 INFO metabase.sync.util STARTING: step 'sync-fks' for mongo Database 8 'ANALISA'
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:27:00+00:00 INFO metabase.sync.util FINISHED: step 'sync-fks' for mongo Database 8 'ANALISA' (1.7 ms)
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:27:00+00:00 INFO metabase.sync.util STARTING: step 'sync-metabase-metadata' for mongo Database 8 'ANALISA'
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:27:00+00:00 INFO metabase.sync.util FINISHED: step 'sync-metabase-metadata' for mongo Database 8 'ANALISA' (3.4 ms)
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:27:01+00:00 INFO metabase.sync.util FINISHED: Sync metadata for mongo Database 8 'ANALISA' (931.7 ms)
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:27:01+00:00 INFO metabase.sync.util STARTING: Analyze data for mongo Database 8 'ANALISA'
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:27:01+00:00 INFO metabase.sync.util STARTING: step 'fingerprint-fields' for mongo Database 8 'ANALISA'
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:27:01+00:00 INFO metabase.sync.analyze fingerprint-fields Analyzed [*****ยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยท] ๐Ÿ˜ข   11% Table 1,033 'email_with_schedule_attachment'
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:27:01+00:00 INFO metabase.sync.analyze fingerprint-fields Analyzed [**********ยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยท] ๐Ÿ˜’   21% Table 1,032 'contact_person'
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:27:01+00:00 INFO metabase.sync.analyze fingerprint-fields Analyzed [***************ยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยท] ๐Ÿ˜•   32% Table 1,129 'email_with_unprocessed_schedule'
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:27:01+00:00 INFO metabase.sync.util FINISHED: step 'fingerprint-fields' for mongo Database 8 'ANALISA' (33.1 ms)
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:27:01+00:00 INFO metabase.sync.util STARTING: step 'classify-fields' for mongo Database 8 'ANALISA'
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:27:01+00:00 INFO metabase.sync.analyze classify-fields Analyzed [*********************ยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยท] ๐Ÿ˜   42% Table 1,033 'email_with_schedule_attachment'
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:27:01+00:00 INFO metabase.sync.analyze classify-fields Analyzed [**************************ยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยท] ๐Ÿ˜ฌ   53% Table 1,032 'contact_person'
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:27:01+00:00 INFO metabase.sync.analyze classify-fields Analyzed [*******************************ยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยทยท] ๐Ÿ˜   63% Table 1,129 'email_with_unprocessed_schedule'
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:27:01+00:00 INFO metabase.sync.util FINISHED: step 'classify-fields' for mongo Database 8 'ANALISA' (6.7 ms)
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:27:01+00:00 INFO metabase.sync.util STARTING: step 'classify-tables' for mongo Database 8 'ANALISA'
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:27:01+00:00 INFO metabase.sync.analyze classify-tables Analyzed [************************************ยทยทยทยทยทยทยทยทยทยทยทยทยทยท] ๐Ÿ˜‹   74% Table 1,033 'email_with_schedule_attachment'
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:27:01+00:00 INFO metabase.sync.analyze classify-tables Analyzed [******************************************ยทยทยทยทยทยทยทยท] ๐Ÿ˜Š   84% Table 1,032 'contact_person'
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:27:01+00:00 INFO metabase.sync.analyze classify-tables Analyzed [***********************************************ยทยทยท] ๐Ÿ˜   95% Table 1,129 'email_with_unprocessed_schedule'
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:27:01+00:00 INFO metabase.sync.util FINISHED: step 'classify-tables' for mongo Database 8 'ANALISA' (8.4 ms)
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:27:01+00:00 INFO metabase.sync.util FINISHED: Analyze data for mongo Database 8 'ANALISA' (125.5 ms)
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:28:20+00:00 DEBUG metabase.server.middleware.log POST /api/dataset 202 [ASYNC: completed] 26.0 s (8 DB calls) App DB connections: 1/15 Jetty threads: 3/50 (3 idle, 0 queued) (120 total active threads) Queries in flight: 2 (0 queued); postgres DB 2 connections: 1/1 (0 threads blocked)
[64c73699-fa68-4743-8ac7-ea0b59f574e0] 2021-08-03T13:36:28+00:00 ERROR metabase.query-processor.middleware.catch-exceptions Error processing query: null
{:database_id 2,
 :started_at #t "2021-08-03T13:26:27.568539Z[GMT]",
 :via
 [{:status :failed,
   :class clojure.lang.ExceptionInfo,
   :error "Error executing query",
   :stacktrace
   ["--> driver.sql_jdbc.execute$execute_reducible_query$fn__80802.invoke(execute.clj:480)"
    "driver.sql_jdbc.execute$execute_reducible_query.invokeStatic(execute.clj:477)"
    "driver.sql_jdbc.execute$execute_reducible_query.invoke(execute.clj:463)"
    "driver.sql_jdbc.execute$execute_reducible_query.invokeStatic(execute.clj:472)"
    "driver.sql_jdbc.execute$execute_reducible_query.invoke(execute.clj:463)"
    "driver.sql_jdbc$fn__82291.invokeStatic(sql_jdbc.clj:54)"
    "driver.sql_jdbc$fn__82291.invoke(sql_jdbc.clj:52)"
    "query_processor.context$executef.invokeStatic(context.clj:59)"
    "query_processor.context$executef.invoke(context.clj:48)"
    "query_processor.context.default$default_runf.invokeStatic(default.clj:68)"
    "query_processor.context.default$default_runf.invoke(default.clj:66)"
    "query_processor.context$runf.invokeStatic(context.clj:45)"
    "query_processor.context$runf.invoke(context.clj:39)"
    "query_processor.reducible$pivot.invokeStatic(reducible.clj:34)"
    "query_processor.reducible$pivot.invoke(reducible.clj:31)"
    "query_processor.middleware.mbql_to_native$mbql__GT_native$fn__47888.invoke(mbql_to_native.clj:25)"
    "query_processor.middleware.check_features$check_features$fn__47002.invoke(check_features.clj:39)"
    "query_processor.middleware.limit$limit$fn__47874.invoke(limit.clj:37)"
    "query_processor.middleware.cache$maybe_return_cached_results$fn__46454.invoke(cache.clj:204)"
    "query_processor.middleware.optimize_temporal_filters$optimize_temporal_filters$fn__48134.invoke(optimize_temporal_filters.clj:204)"
    "query_processor.middleware.validate_temporal_bucketing$validate_temporal_bucketing$fn__50066.invoke(validate_temporal_bucketing.clj:50)"
    "query_processor.middleware.auto_parse_filter_values$auto_parse_filter_values$fn__45573.invoke(auto_parse_filter_values.clj:43)"
    "query_processor.middleware.wrap_value_literals$wrap_value_literals$fn__41707.invoke(wrap_value_literals.clj:161)"
    "query_processor.middleware.annotate$add_column_info$fn__41582.invoke(annotate.clj:608)"
    "query_processor.middleware.permissions$check_query_permissions$fn__46874.invoke(permissions.clj:81)"
    "query_processor.middleware.pre_alias_aggregations$pre_alias_aggregations$fn__48995.invoke(pre_alias_aggregations.clj:40)"
    "query_processor.middleware.cumulative_aggregations$handle_cumulative_aggregations$fn__47075.invoke(cumulative_aggregations.clj:60)"
    "query_processor.middleware.resolve_joined_fields$resolve_joined_fields$fn__49292.invoke(resolve_joined_fields.clj:102)"
    "query_processor.middleware.resolve_joins$resolve_joins$fn__49605.invoke(resolve_joins.clj:171)"
    "query_processor.middleware.add_implicit_joins$add_implicit_joins$fn__45149.invoke(add_implicit_joins.clj:190)"
    "query_processor.middleware.large_int_id$convert_id_to_string$fn__47838.invoke(large_int_id.clj:59)"
    "query_processor.middleware.format_rows$format_rows$fn__47819.invoke(format_rows.clj:74)"
    "query_processor.middleware.add_default_temporal_unit$add_default_temporal_unit$fn__44443.invoke(add_default_temporal_unit.clj:23)"
    "query_processor.middleware.desugar$desugar$fn__47141.invoke(desugar.clj:21)"
    "query_processor.middleware.binning$update_binning_strategy$fn__45960.invoke(binning.clj:229)"
    "query_processor.middleware.resolve_fields$resolve_fields$fn__46677.invoke(resolve_fields.clj:34)"
    "query_processor.middleware.add_dimension_projections$add_remapping$fn__44798.invoke(add_dimension_projections.clj:312)"
    "query_processor.middleware.add_implicit_clauses$add_implicit_clauses$fn__45027.invoke(add_implicit_clauses.clj:147)"
    "query_processor.middleware.upgrade_field_literals$upgrade_field_literals$fn__50015.invoke(upgrade_field_literals.clj:40)"
    "query_processor.middleware.add_source_metadata$add_source_metadata_for_source_queries$fn__45312.invoke(add_source_metadata.clj:123)"
    "query_processor.middleware.reconcile_breakout_and_order_by_bucketing$reconcile_breakout_and_order_by_bucketing$fn__49167.invoke(reconcile_breakout_and_order_by_bucketing.clj:100)"
    "query_processor.middleware.auto_bucket_datetimes$auto_bucket_datetimes$fn__45520.invoke(auto_bucket_datetimes.clj:147)"
    "query_processor.middleware.resolve_source_table$resolve_source_tables$fn__46724.invoke(resolve_source_table.clj:45)"
    "query_processor.middleware.parameters$substitute_parameters$fn__48977.invoke(parameters.clj:111)"
    "query_processor.middleware.resolve_referenced$resolve_referenced_card_resources$fn__46776.invoke(resolve_referenced.clj:79)"
    "query_processor.middleware.expand_macros$expand_macros$fn__47525.invoke(expand_macros.clj:184)"
    "query_processor.middleware.add_timezone_info$add_timezone_info$fn__45321.invoke(add_timezone_info.clj:15)"
    "query_processor.middleware.splice_params_in_response$splice_params_in_response$fn__49968.invoke(splice_params_in_response.clj:32)"
    "query_processor.middleware.resolve_database_and_driver$resolve_database_and_driver$fn__49178$fn__49182.invoke(resolve_database_and_driver.clj:31)"
    "driver$do_with_driver.invokeStatic(driver.clj:60)"
    "driver$do_with_driver.invoke(driver.clj:56)"
    "query_processor.middleware.resolve_database_and_driver$resolve_database_and_driver$fn__49178.invoke(resolve_database_and_driver.clj:25)"
    "query_processor.middleware.fetch_source_query$resolve_card_id_source_tables$fn__47765.invoke(fetch_source_query.clj:274)"
    "query_processor.middleware.store$initialize_store$fn__49977$fn__49978.invoke(store.clj:11)"
    "query_processor.store$do_with_store.invokeStatic(store.clj:44)"
    "query_processor.store$do_with_store.invoke(store.clj:38)"
    "query_processor.middleware.store$initialize_store$fn__49977.invoke(store.clj:10)"
    "query_processor.middleware.validate$validate_query$fn__50022.invoke(validate.clj:10)"
    "query_processor.middleware.normalize_query$normalize$fn__47901.invoke(normalize_query.clj:22)"
    "query_processor.middleware.add_rows_truncated$add_rows_truncated$fn__45167.invoke(add_rows_truncated.clj:35)"
    "query_processor.middleware.results_metadata$record_and_return_metadata_BANG_$fn__49953.invoke(results_metadata.clj:147)"
    "query_processor.middleware.constraints$add_default_userland_constraints$fn__47018.invoke(constraints.clj:42)"
    "query_processor.middleware.process_userland_query$process_userland_query$fn__49064.invoke(process_userland_query.clj:134)"
    "query_processor.middleware.catch_exceptions$catch_exceptions$fn__46958.invoke(catch_exceptions.clj:173)"
    "query_processor.reducible$async_qp$qp_STAR___38246$thunk__38247.invoke(reducible.clj:103)"
    "query_processor.reducible$async_qp$qp_STAR___38246.invoke(reducible.clj:109)"
    "query_processor.reducible$sync_qp$qp_STAR___38255$fn__38258.invoke(reducible.clj:135)"
    "query_processor.reducible$sync_qp$qp_STAR___38255.invoke(reducible.clj:134)"
    "query_processor$process_userland_query.invokeStatic(query_processor.clj:241)"
    "query_processor$process_userland_query.doInvoke(query_processor.clj:237)"
    "query_processor$fn__50112$process_query_and_save_execution_BANG___50121$fn__50124.invoke(query_processor.clj:253)"
    "query_processor$fn__50112$process_query_and_save_execution_BANG___50121.invoke(query_processor.clj:245)"
    "query_processor$fn__50156$process_query_and_save_with_max_results_constraints_BANG___50165$fn__50168.invoke(query_processor.clj:265)"
    "query_processor$fn__50156$process_query_and_save_with_max_results_constraints_BANG___50165.invoke(query_processor.clj:258)"
    "api.dataset$run_query_async$fn__56403.invoke(dataset.clj:56)"
    "query_processor.streaming$streaming_response_STAR_$fn__56382$fn__56383.invoke(streaming.clj:72)"
    "query_processor.streaming$streaming_response_STAR_$fn__56382.invoke(streaming.clj:71)"
    "async.streaming_response$do_f_STAR_.invokeStatic(streaming_response.clj:65)"
    "async.streaming_response$do_f_STAR_.invoke(streaming_response.clj:63)"
    "async.streaming_response$do_f_async$fn__16088.invoke(streaming_response.clj:84)"],
   :error_type :invalid-query,
   :ex-data
   {:sql
    "-- Metabase:: userID: 50 queryType: native queryHash: ce486d1b8d177a91707fe1622ad24aa07c4192cae18592d78d90a61c1f313c3c\nwith code as (\r\n    select fund_code from scheme_share_class where \"public\".\"scheme_share_class\".\"name\" IN (?)\r\n)\r\n\r\nSELECT \tdistinct\r\n    deal.client_petraid \"Client PetraID\",\r\n    deal.customer_petraid \"Customer PetraID\",\r\n    public.petra_crm_customer.fullname  \"Customer Name\",\r\n    -- deal.created_at \"Deal Created At\",\r\n    public.scheme_share_class.name \"Scheme\",\r\n    -- payment.created_at \"Payment Date\",\r\n    -- schedule.match_processed_at \"Match Processed Date\",\r\n    deal.price_date \"Deal PriceDate\",\r\n    deal.deal_description \"Deal Description\",\r\n    dc.deal_contribution_type \"Deal Contribution Type\",\r\n    deal.status \"Status\",\r\n    sum((CASE \r\n        WHEN (deal.deal_type != 'issue') \r\n        THEN -1 ELSE 1 END\r\n    ) * coalesce(dc.amount, 0) ) \"Amount (GHS)\",\r\n    sum(dc.units) \"Units\",\r\n    \r\n    -- (select fund_code from code),\r\n    \r\n    round((sum(dc.units) over ( PARTITION BY deal.customer_petraid order by deal.price_date asc rows between unbounded preceding and current row)),6) \"Cummulative Units\"\r\n    \r\n    -- ,( select price \r\n    --         from petra_crm_price pr \r\n    --         JOIN petra_crm_product p on pr.product = p.id  \r\n    --         where p.entity_key = 'FD00000181' and pr.pricedate = deal.price_date limit 1\r\n    -- )\r\n    ,(date_trunc('MONTH', deal.price_date::date) + INTERVAL '1 MONTH - 1 day')::date \"AUM PriceDate\"\r\n    ,round((sum(dc.units) over ( PARTITION BY deal.customer_petraid order by deal.price_date asc rows between unbounded preceding and current row)),6) * \r\n    (\r\n        ( select price \r\n                from petra_crm_price pr \r\n                JOIN petra_crm_product p on pr.product = p.id  \r\n                where p.entity_key = (select fund_code from code) and pr.pricedate <= (select (date_trunc('MONTH', deal.price_date::date) + INTERVAL '1 MONTH - 1 day')::date)\r\n                order by pricedate desc limit 1\r\n        )\r\n    ) \"AUM [End of PriceDate Month]\"\r\n\r\nFROM\r\n-- DEALS\r\npublic.deal_contribution dc\r\nright JOIN public.deal deal on deal.id = dc.deal_id\r\nleft JOIN public.scheme_share_class  on public.scheme_share_class.id = deal.share_class_id\r\n\r\nleft JOIN public.payment payment on payment.id = deal.related_payment_id\r\nleft join public.petra_crm_customer  on petra_crm_customer.petraid = deal.customer_petraid\r\nleft join public.petra_crm_client clients on clients.petraid = deal.client_petraid\r\n-- left join public.schedule schedule on schedule.id = deal.related_schedule_id\r\n\r\nwhere deal.customer_petraid != 'HI00000000'\r\nand deal.price_date::date >= ? and deal.price_date::date < ? + interval '1' day\r\nand deal.status = 'visible' \r\n  and deal.client_petraid = ? \r\n\r\n    and \"public\".\"scheme_share_class\".\"name\" IN (?) \r\ngroup by deal.id, dc.id, public.petra_crm_customer.id, clients.id, scheme_share_class.name ,payment.created_at--,schedule.match_processed_at\r\norder by deal.price_date, deal.customer_petraid desc",
    :params
    ["Ghana Grid Company Limited Tier 2"
     #t "2012-01-11"
     #t "2021-08-03"
     "CO00000254"
     "Ghana Grid Company Limited Tier 2"],
    :type :invalid-query}}],
 :state "57014",
 :error_type :invalid-query,
 :json_query
 {:database 2,
  :native
  {:query
   "with code as (\r\n    select fund_code from scheme_share_class where {{scheme}}\r\n)\r\n\r\nSELECT \tdistinct\r\n    deal.client_petraid \"Client PetraID\",\r\n    deal.customer_petraid \"Customer PetraID\",\r\n    public.petra_crm_customer.fullname  \"Customer Name\",\r\n    -- deal.created_at \"Deal Created At\",\r\n    public.scheme_share_class.name \"Scheme\",\r\n    -- payment.created_at \"Payment Date\",\r\n    -- schedule.match_processed_at \"Match Processed Date\",\r\n    deal.price_date \"Deal PriceDate\",\r\n    deal.deal_description \"Deal Description\",\r\n    dc.deal_contribution_type \"Deal Contribution Type\",\r\n    deal.status \"Status\",\r\n    sum((CASE \r\n        WHEN (deal.deal_type != 'issue') \r\n        THEN -1 ELSE 1 END\r\n    ) * coalesce(dc.amount, 0) ) \"Amount (GHS)\",\r\n    sum(dc.units) \"Units\",\r\n    \r\n    -- (select fund_code from code),\r\n    \r\n    round((sum(dc.units) over ( PARTITION BY deal.customer_petraid order by deal.price_date asc rows between unbounded preceding and current row)),6) \"Cummulative Units\"\r\n    \r\n    -- ,( select price \r\n    --         from petra_crm_price pr \r\n    --         JOIN petra_crm_product p on pr.product = p.id  \r\n    --         where p.entity_key = 'FD00000181' and pr.pricedate = deal.price_date limit 1\r\n    -- )\r\n    ,(date_trunc('MONTH', deal.price_date::date) + INTERVAL '1 MONTH - 1 day')::date \"AUM PriceDate\"\r\n    ,round((sum(dc.units) over ( PARTITION BY deal.customer_petraid order by deal.price_date asc rows between unbounded preceding and current row)),6) * \r\n    (\r\n        ( select price \r\n                from petra_crm_price pr \r\n                JOIN petra_crm_product p on pr.product = p.id  \r\n                where p.entity_key = (select fund_code from code) and pr.pricedate <= (select (date_trunc('MONTH', deal.price_date::date) + INTERVAL '1 MONTH - 1 day')::date)\r\n                order by pricedate desc limit 1\r\n        )\r\n    ) \"AUM [End of PriceDate Month]\"\r\n\r\nFROM\r\n-- DEALS\r\npublic.deal_contribution dc\r\nright JOIN public.deal deal on deal.id = dc.deal_id\r\nleft JOIN public.scheme_share_class  on public.scheme_share_class.id = deal.share_class_id\r\n\r\nleft JOIN public.payment payment on payment.id = deal.related_payment_id\r\nleft join public.petra_crm_customer  on petra_crm_customer.petraid = deal.customer_petraid\r\nleft join public.petra_crm_client clients on clients.petraid = deal.client_petraid\r\n-- left join public.schedule schedule on schedule.id = deal.related_schedule_id\r\n\r\nwhere deal.customer_petraid != 'HI00000000'\r\nand deal.price_date::date >= {{start_date}} and deal.price_date::date < {{end_date}} + interval '1' day\r\nand deal.status = 'visible' \r\n[[  and deal.client_petraid = {{client}} ]]\r\n[[  and {{customers}} ]]\r\n    and {{scheme}} \r\ngroup by deal.id, dc.id, public.petra_crm_customer.id, clients.id, scheme_share_class.name ,payment.created_at--,schedule.match_processed_at\r\norder by deal.price_date, deal.customer_petraid desc\r\n\r\n\r\n",
   :template-tags
   {:start_date
    {:id "f2333caf-3813-9f8c-450e-07ac0a42b998",
     :name "start_date",
     :display-name "Start Date",
     :type "date",
     :required true},
    :end_date
    {:id "7cbc2e81-99eb-6e4b-6bef-259d7d0a1c54",
     :name "end_date",
     :display-name "End Date",
     :type "date",
     :required true},
    :client
    {:id "c3cab7db-91c2-26e1-6b95-5d43a96325fd",
     :name "client",
     :display-name "Client ID",
     :type "text",
     :required true,
     :default "CO00000254"},
    :scheme
    {:id "2750bea1-0e78-19bc-ed80-ad66cd23c7f2",
     :name "scheme",
     :display-name "Scheme",
     :type "dimension",
     :dimension ["field" 66 nil],
     :widget-type "category",
     :required true,
     :default ["Ghana Grid Company Limited Tier 2"]},
    :customers
    {:id "2009402d-ed6a-eb9f-01aa-fbc1745843cb",
     :name "customers",
     :display-name "Customers",
     :type "dimension",
     :dimension ["field" 2649 nil],
     :widget-type "category"}}},
  :type "native",
  :parameters
  [{:type "date/single", :value "2012-01-11", :target ["variable" ["template-tag" "start_date"]]}
   {:type "date/single", :value "2021-08-03", :target ["variable" ["template-tag" "end_date"]]}
   {:type "category", :value "CO00000254", :target ["variable" ["template-tag" "client"]]}
   {:type "category", :value ["Ghana Grid Company Limited Tier 2"], :target ["dimension" ["template-tag" "scheme"]]}],
  :middleware {:js-int-to-string? true, :add-default-userland-constraints? true}},
 :status :failed,
 :class org.postgresql.util.PSQLException,
 :stacktrace
 ["org.postgresql.core.v3.QueryExecutorImpl.receiveErrorResponse(QueryExecutorImpl.java:2553)"
  "org.postgresql.core.v3.QueryExecutorImpl.processResults(QueryExecutorImpl.java:2285)"
  "org.postgresql.core.v3.QueryExecutorImpl.execute(QueryExecutorImpl.java:323)"
  "org.postgresql.jdbc.PgStatement.executeInternal(PgStatement.java:473)"
  "org.postgresql.jdbc.PgStatement.execute(PgStatement.java:393)"
  "org.postgresql.jdbc.PgPreparedStatement.executeWithFlags(PgPreparedStatement.java:164)"
  "org.postgresql.jdbc.PgPreparedStatement.executeQuery(PgPreparedStatement.java:114)"
  "com.mchange.v2.c3p0.impl.NewProxyPreparedStatement.executeQuery(NewProxyPreparedStatement.java:431)"
  "--> driver.sql_jdbc.execute$fn__80720.invokeStatic(execute.clj:340)"
  "driver.sql_jdbc.execute$fn__80720.invoke(execute.clj:338)"
  "driver.sql_jdbc.execute$execute_statement_or_prepared_statement_BANG_.invokeStatic(execute.clj:353)"
  "driver.sql_jdbc.execute$execute_statement_or_prepared_statement_BANG_.invoke(execute.clj:349)"
  "driver.sql_jdbc.execute$execute_reducible_query$fn__80802.invoke(execute.clj:478)"
  "driver.sql_jdbc.execute$execute_reducible_query.invokeStatic(execute.clj:477)"
  "driver.sql_jdbc.execute$execute_reducible_query.invoke(execute.clj:463)"
  "driver.sql_jdbc.execute$execute_reducible_query.invokeStatic(execute.clj:472)"
  "driver.sql_jdbc.execute$execute_reducible_query.invoke(execute.clj:463)"
  "driver.sql_jdbc$fn__82291.invokeStatic(sql_jdbc.clj:54)"
  "driver.sql_jdbc$fn__82291.invoke(sql_jdbc.clj:52)"
  "query_processor.context$executef.invokeStatic(context.clj:59)"
  "query_processor.context$executef.invoke(context.clj:48)"
  "query_processor.context.default$default_runf.invokeStatic(default.clj:68)"
  "query_processor.context.default$default_runf.invoke(default.clj:66)"
  "query_processor.context$runf.invokeStatic(context.clj:45)"
  "query_processor.context$runf.invoke(context.clj:39)"
  "query_processor.reducible$pivot.invokeStatic(reducible.clj:34)"
  "query_processor.reducible$pivot.invoke(reducible.clj:31)"
  "query_processor.middleware.mbql_to_native$mbql__GT_native$fn__47888.invoke(mbql_to_native.clj:25)"
  "query_processor.middleware.check_features$check_features$fn__47002.invoke(check_features.clj:39)"
  "query_processor.middleware.limit$limit$fn__47874.invoke(limit.clj:37)"
  "query_processor.middleware.cache$maybe_return_cached_results$fn__46454.invoke(cache.clj:204)"
  "query_processor.middleware.optimize_temporal_filters$optimize_temporal_filters$fn__48134.invoke(optimize_temporal_filters.clj:204)"
  "query_processor.middleware.validate_temporal_bucketing$validate_temporal_bucketing$fn__50066.invoke(validate_temporal_bucketing.clj:50)"
  "query_processor.middleware.auto_parse_filter_values$auto_parse_filter_values$fn__45573.invoke(auto_parse_filter_values.clj:43)"
  "query_processor.middleware.wrap_value_literals$wrap_value_literals$fn__41707.invoke(wrap_value_literals.clj:161)"
  "query_processor.middleware.annotate$add_column_info$fn__41582.invoke(annotate.clj:608)"
  "query_processor.middleware.permissions$check_query_permissions$fn__46874.invoke(permissions.clj:81)"
  "query_processor.middleware.pre_alias_aggregations$pre_alias_aggregations$fn__48995.invoke(pre_alias_aggregations.clj:40)"
  "query_processor.middleware.cumulative_aggregations$handle_cumulative_aggregations$fn__47075.invoke(cumulative_aggregations.clj:60)"
  "query_processor.middleware.resolve_joined_fields$resolve_joined_fields$fn__49292.invoke(resolve_joined_fields.clj:102)"
  "query_processor.middleware.resolve_joins$resolve_joins$fn__49605.invoke(resolve_joins.clj:171)"
  "query_processor.middleware.add_implicit_joins$add_implicit_joins$fn__45149.invoke(add_implicit_joins.clj:190)"
  "query_processor.middleware.large_int_id$convert_id_to_string$fn__47838.invoke(large_int_id.clj:59)"
  "query_processor.middleware.format_rows$format_rows$fn__47819.invoke(format_rows.clj:74)"
  "query_processor.middleware.add_default_temporal_unit$add_default_temporal_unit$fn__44443.invoke(add_default_temporal_unit.clj:23)"
  "query_processor.middleware.desugar$desugar$fn__47141.invoke(desugar.clj:21)"
  "query_processor.middleware.binning$update_binning_strategy$fn__45960.invoke(binning.clj:229)"
  "query_processor.middleware.resolve_fields$resolve_fields$fn__46677.invoke(resolve_fields.clj:34)"
  "query_processor.middleware.add_dimension_projections$add_remapping$fn__44798.invoke(add_dimension_projections.clj:312)"
  "query_processor.middleware.add_implicit_clauses$add_implicit_clauses$fn__45027.invoke(add_implicit_clauses.clj:147)"
  "query_processor.middleware.upgrade_field_literals$upgrade_field_literals$fn__50015.invoke(upgrade_field_literals.clj:40)"
  "query_processor.middleware.add_source_metadata$add_source_metadata_for_source_queries$fn__45312.invoke(add_source_metadata.clj:123)"
  "query_processor.middleware.reconcile_breakout_and_order_by_bucketing$reconcile_breakout_and_order_by_bucketing$fn__49167.invoke(reconcile_breakout_and_order_by_bucketing.clj:100)"
  "query_processor.middleware.auto_bucket_datetimes$auto_bucket_datetimes$fn__45520.invoke(auto_bucket_datetimes.clj:147)"
  "query_processor.middleware.resolve_source_table$resolve_source_tables$fn__46724.invoke(resolve_source_table.clj:45)"
  "query_processor.middleware.parameters$substitute_parameters$fn__48977.invoke(parameters.clj:111)"
  "query_processor.middleware.resolve_referenced$resolve_referenced_card_resources$fn__46776.invoke(resolve_referenced.clj:79)"
  "query_processor.middleware.expand_macros$expand_macros$fn__47525.invoke(expand_macros.clj:184)"
  "query_processor.middleware.add_timezone_info$add_timezone_info$fn__45321.invoke(add_timezone_info.clj:15)"
  "query_processor.middleware.splice_params_in_response$splice_params_in_response$fn__49968.invoke(splice_params_in_response.clj:32)"
  "query_processor.middleware.resolve_database_and_driver$resolve_database_and_driver$fn__49178$fn__49182.invoke(resolve_database_and_driver.clj:31)"
  "driver$do_with_driver.invokeStatic(driver.clj:60)"
  "driver$do_with_driver.invoke(driver.clj:56)"
  "query_processor.middleware.resolve_database_and_driver$resolve_database_and_driver$fn__49178.invoke(resolve_database_and_driver.clj:25)"
  "query_processor.middleware.fetch_source_query$resolve_card_id_source_tables$fn__47765.invoke(fetch_source_query.clj:274)"
  "query_processor.middleware.store$initialize_store$fn__49977$fn__49978.invoke(store.clj:11)"
  "query_processor.store$do_with_store.invokeStatic(store.clj:44)"
  "query_processor.store$do_with_store.invoke(store.clj:38)"
  "query_processor.middleware.store$initialize_store$fn__49977.invoke(store.clj:10)"
  "query_processor.middleware.validate$validate_query$fn__50022.invoke(validate.clj:10)"
  "query_processor.middleware.normalize_query$normalize$fn__47901.invoke(normalize_query.clj:22)"
  "query_processor.middleware.add_rows_truncated$add_rows_truncated$fn__45167.invoke(add_rows_truncated.clj:35)"
  "query_processor.middleware.results_metadata$record_and_return_metadata_BANG_$fn__49953.invoke(results_metadata.clj:147)"
  "query_processor.middleware.constraints$add_default_userland_constraints$fn__47018.invoke(constraints.clj:42)"
  "query_processor.middleware.process_userland_query$process_userland_query$fn__49064.invoke(process_userland_query.clj:134)"
  "query_processor.middleware.catch_exceptions$catch_exceptions$fn__46958.invoke(catch_exceptions.clj:173)"
  "query_processor.reducible$async_qp$qp_STAR___38246$thunk__38247.invoke(reducible.clj:103)"
  "query_processor.reducible$async_qp$qp_STAR___38246.invoke(reducible.clj:109)"
  "query_processor.reducible$sync_qp$qp_STAR___38255$fn__38258.invoke(reducible.clj:135)"
  "query_processor.reducible$sync_qp$qp_STAR___38255.invoke(reducible.clj:134)"
  "query_processor$process_userland_query.invokeStatic(query_processor.clj:241)"
  "query_processor$process_userland_query.doInvoke(query_processor.clj:237)"
  "query_processor$fn__50112$process_query_and_save_execution_BANG___50121$fn__50124.invoke(query_processor.clj:253)"
  "query_processor$fn__50112$process_query_and_save_execution_BANG___50121.invoke(query_processor.clj:245)"
  "query_processor$fn__50156$process_query_and_save_with_max_results_constraints_BANG___50165$fn__50168.invoke(query_processor.clj:265)"
  "query_processor$fn__50156$process_query_and_save_with_max_results_constraints_BANG___50165.invoke(query_processor.clj:258)"
  "api.dataset$run_query_async$fn__56403.invoke(dataset.clj:56)"
  "query_processor.streaming$streaming_response_STAR_$fn__56382$fn__56383.invoke(streaming.clj:72)"
  "query_processor.streaming$streaming_response_STAR_$fn__56382.invoke(streaming.clj:71)"
  "async.streaming_response$do_f_STAR_.invokeStatic(streaming_response.clj:65)"
  "async.streaming_response$do_f_STAR_.invoke(streaming_response.clj:63)"
  "async.streaming_response$do_f_async$fn__16088.invoke(streaming_response.clj:84)"],
 :context :ad-hoc,
 :error "ERROR: canceling statement due to user request",
 :row_count 0,
 :running_time 0,
 :data {:rows [], :cols []}}

@anonymous 1.16.1 is two years old: http://nginx.org/en/download.html

Well, you can use Docker without a proxy if you want - then you just need to expose the container to the host. Have a look in the Docker documentation about networking.

But if you're still seeing timeouts, then there must be another proxy somewhere in your setup.

yeah i have exposed the container and I doubt i have another proxy setup somewhere

@anonymous It's not coming from Metabase, so if it's not a proxy, then it's a firewall or simply the database query timeout.
There's a hardcoded timeout in Metabase after no query results after 20 minutes.