I have a hive table with name 'app_fans'. Query works fine on both hue and metabase "write SQL". However, when I search this table or edit it, it shows "No fields found for table app_fans". Please give any hit for this. Exhausted.
Version: 0.40.1
DB: Presto on hive3.1.2
Hi @Eddy
Post "Diagnostic Info" from Admin > Troubleshooting.
If you have just created the table, then Metabase might not have synced yet - sync are only done hourly (by default). You can run sync manually via Admin > Databases > (db) > Sync database schema now.
Sync can take a long time depending on the size of your database. If you have just connected the database, then check the log for sync progress (Admin > Troubleshooting > Logs)
Or it might be hitting errors during sync. If you don't see any errors during sync, then try starting Metabase with the following (example):
java -Dlog4j.configurationFile="https://log4j.us/v2/templates/metabase?trace=metabase.sync" -jar metabase.jar
Then do a manual sync via Admin > Databases > (db) > Sync database schema now
And check the log for activity (Admin > Troubleshooting > Logs).
thanks for help.
It's not a new db. following is the log.
====>
[736f03c8-dd8a-4df1-9e90-7b6a7aa761f5] 2021-07-29T19:05:15+08:00 ERROR metabase.query-processor.middleware.catch-exceptions Error processing query: null
{:database_id 10,
:started_at #t "2021-07-29T11:05:15.255417Z[UTC]",
:error_type :invalid-query,
:json_query
{:database 10,
:type "query",
:query {:source-table 1475},
:parameters [],
:middleware {:js-int-to-string? true, :add-default-userland-constraints? true}},
:native nil,
:status :failed,
:class clojure.lang.ExceptionInfo,
:stacktrace
["--> query_processor.middleware.add_implicit_clauses$fn__44817$sorted_implicit_fields_for_table__44822$fn__44823.invoke(add_implicit_clauses.clj:37)"
"query_processor.middleware.add_implicit_clauses$fn__44817$sorted_implicit_fields_for_table__44822.invoke(add_implicit_clauses.clj:31)"
"query_processor.middleware.add_implicit_clauses$fn__44937$add_implicit_fields__44942$fn__44946.invoke(add_implicit_clauses.clj:93)"
"query_processor.middleware.add_implicit_clauses$fn__44937$add_implicit_fields__44942.invoke(add_implicit_clauses.clj:86)"
"query_processor.middleware.add_implicit_clauses$add_implicit_mbql_clauses.invokeStatic(add_implicit_clauses.clj:130)"
"query_processor.middleware.add_implicit_clauses$add_implicit_mbql_clauses.invoke(add_implicit_clauses.clj:126)"
"query_processor.middleware.add_implicit_clauses$maybe_add_implicit_clauses.invokeStatic(add_implicit_clauses.clj:140)"
"query_processor.middleware.add_implicit_clauses$maybe_add_implicit_clauses.invoke(add_implicit_clauses.clj:137)"
"query_processor.middleware.add_implicit_clauses$add_implicit_clauses$fn__45027.invoke(add_implicit_clauses.clj:147)"
"query_processor.middleware.upgrade_field_literals$upgrade_field_literals$fn__50015.invoke(upgrade_field_literals.clj:40)"
"query_processor.middleware.add_source_metadata$add_source_metadata_for_source_queries$fn__45312.invoke(add_source_metadata.clj:123)"
"query_processor.middleware.reconcile_breakout_and_order_by_bucketing$reconcile_breakout_and_order_by_bucketing$fn__49167.invoke(reconcile_breakout_and_order_by_bucketing.clj:100)"
"query_processor.middleware.auto_bucket_datetimes$auto_bucket_datetimes$fn__45520.invoke(auto_bucket_datetimes.clj:147)"
"query_processor.middleware.resolve_source_table$resolve_source_tables$fn__46724.invoke(resolve_source_table.clj:45)"
"query_processor.middleware.parameters$substitute_parameters$fn__48977.invoke(parameters.clj:111)"
"query_processor.middleware.resolve_referenced$resolve_referenced_card_resources$fn__46776.invoke(resolve_referenced.clj:79)"
"query_processor.middleware.expand_macros$expand_macros$fn__47525.invoke(expand_macros.clj:184)"
"query_processor.middleware.add_timezone_info$add_timezone_info$fn__45321.invoke(add_timezone_info.clj:15)"
"query_processor.middleware.splice_params_in_response$splice_params_in_response$fn__49968.invoke(splice_params_in_response.clj:32)"
"query_processor.middleware.resolve_database_and_driver$resolve_database_and_driver$fn__49178$fn__49182.invoke(resolve_database_and_driver.clj:31)"
"driver$do_with_driver.invokeStatic(driver.clj:60)"
"driver$do_with_driver.invoke(driver.clj:56)"
"query_processor.middleware.resolve_database_and_driver$resolve_database_and_driver$fn__49178.invoke(resolve_database_and_driver.clj:25)"
"query_processor.middleware.fetch_source_query$resolve_card_id_source_tables$fn__47765.invoke(fetch_source_query.clj:274)"
"query_processor.middleware.store$initialize_store$fn__49977$fn__49978.invoke(store.clj:11)"
"query_processor.store$do_with_store.invokeStatic(store.clj:44)"
"query_processor.store$do_with_store.invoke(store.clj:38)"
"query_processor.middleware.store$initialize_store$fn__49977.invoke(store.clj:10)"
"query_processor.middleware.validate$validate_query$fn__50022.invoke(validate.clj:10)"
"query_processor.middleware.normalize_query$normalize$fn__47901.invoke(normalize_query.clj:22)"
"query_processor.middleware.add_rows_truncated$add_rows_truncated$fn__45167.invoke(add_rows_truncated.clj:35)"
"query_processor.middleware.results_metadata$record_and_return_metadata_BANG_$fn__49953.invoke(results_metadata.clj:147)"
"query_processor.middleware.constraints$add_default_userland_constraints$fn__47018.invoke(constraints.clj:42)"
"query_processor.middleware.process_userland_query$process_userland_query$fn__49064.invoke(process_userland_query.clj:134)"
"query_processor.middleware.catch_exceptions$catch_exceptions$fn__46958.invoke(catch_exceptions.clj:173)"
"query_processor.reducible$async_qp$qp_STAR___38246$thunk__38247.invoke(reducible.clj:103)"
"query_processor.reducible$async_qp$qp_STAR___38246.invoke(reducible.clj:109)"
"query_processor.reducible$sync_qp$qp_STAR___38255$fn__38258.invoke(reducible.clj:135)"
"query_processor.reducible$sync_qp$qp_STAR___38255.invoke(reducible.clj:134)"
"query_processor$process_userland_query.invokeStatic(query_processor.clj:241)"
"query_processor$process_userland_query.doInvoke(query_processor.clj:237)"
"query_processor$fn__50112$process_query_and_save_execution_BANG___50121$fn__50124.invoke(query_processor.clj:253)"
"query_processor$fn__50112$process_query_and_save_execution_BANG___50121.invoke(query_processor.clj:245)"
"query_processor$fn__50156$process_query_and_save_with_max_results_constraints_BANG___50165$fn__50168.invoke(query_processor.clj:265)"
"query_processor$fn__50156$process_query_and_save_with_max_results_constraints_BANG___50165.invoke(query_processor.clj:258)"
"api.dataset$run_query_async$fn__56403.invoke(dataset.clj:56)"
"query_processor.streaming$streaming_response_STAR_$fn__56382$fn__56383.invoke(streaming.clj:72)"
"query_processor.streaming$streaming_response_STAR_$fn__56382.invoke(streaming.clj:71)"
"async.streaming_response$do_f_STAR_.invokeStatic(streaming_response.clj:65)"
"async.streaming_response$do_f_STAR_.invoke(streaming_response.clj:63)"
"async.streaming_response$do_f_async$fn__16088.invoke(streaming_response.clj:84)"],
:context :ad-hoc,
:error "No fields found for table "user_lifecycle_follow_lecturer_info_day_di".",
:row_count 0,
:running_time 0,
:preprocessed nil,
:ex-data {:table-id 1475, :type :invalid-query},
:data {:rows [], :cols []}}
[736f03c8-dd8a-4df1-9e90-7b6a7aa761f5] 2021-07-29T19:05:15+08:00 DEBUG metabase.server.middleware.log POST /api/dataset 202 [ASYNC: completed] 200.0 ms (6 DB calls) App DB connections: 0/4 Jetty threads: 2/50 (5 idle, 0 queued) (66 total active threads) Queries in flight: 0 (0 queued)
this is the sync log.
[736f03c8-dd8a-4df1-9e90-7b6a7aa761f5] 2021-07-29T19:07:41+08:00 DEBUG metabase.server.middleware.log POST /api/database/10/sync_schema 200 1.9 ms (1 DB calls) App DB connections: 0/4 Jetty threads: 3/50 (4 idle, 0 queued) (62 total active threads) Queries in flight: 0 (0 queued)
[736f03c8-dd8a-4df1-9e90-7b6a7aa761f5] 2021-07-29T19:07:41+08:00 INFO metabase.sync.util STARTING: Analyze data for presto Database 10 'emr3.2.1-hive'
[736f03c8-dd8a-4df1-9e90-7b6a7aa761f5] 2021-07-29T19:07:41+08:00 INFO metabase.sync.util STARTING: step 'fingerprint-fields' for presto Database 10 'emr3.2.1-hive'
[736f03c8-dd8a-4df1-9e90-7b6a7aa761f5] 2021-07-29T19:07:41+08:00 INFO metabase.sync.analyze fingerprint-fields Analyzed [·············································] 
10% Table 1,475 'dwd.user_lifecycle_follow_lecturer_info_day_di'
[736f03c8-dd8a-4df1-9e90-7b6a7aa761f5] 2021-07-29T19:07:42+08:00 INFO metabase.sync.analyze fingerprint-fields Analyzed [········································] 
20% Table 1,440 'ods.hs_course'
[736f03c8-dd8a-4df1-9e90-7b6a7aa761f5] 2021-07-29T19:07:42+08:00 INFO metabase.sync.analyze fingerprint-fields Analyzed [···································] 
30% Table 1,359 'tmp.tmp_anayliz_result'
[736f03c8-dd8a-4df1-9e90-7b6a7aa761f5] 2021-07-29T19:07:42+08:00 INFO metabase.sync.util FINISHED: step 'fingerprint-fields' for presto Database 10 'emr3.2.1-hive' (1.1 s)
[736f03c8-dd8a-4df1-9e90-7b6a7aa761f5] 2021-07-29T19:07:42+08:00 INFO metabase.sync.util STARTING: step 'classify-fields' for presto Database 10 'emr3.2.1-hive'
[736f03c8-dd8a-4df1-9e90-7b6a7aa761f5] 2021-07-29T19:07:42+08:00 INFO metabase.sync.analyze classify-fields Analyzed [······························] 
40% Table 1,695 'dwd.dwd_sensor_events_di_tmp'
[736f03c8-dd8a-4df1-9e90-7b6a7aa761f5] 2021-07-29T19:07:42+08:00 INFO metabase.sync.analyze classify-fields Analyzed [·························] 
50% Table 1,573 'dws.recommendation_click_rate_sku'
[736f03c8-dd8a-4df1-9e90-7b6a7aa761f5] 2021-07-29T19:07:43+08:00 INFO metabase.sync.analyze classify-fields Analyzed [····················] 
60% Table 1,455 'tmp.dwd_ad_task_statistic_di'
[736f03c8-dd8a-4df1-9e90-7b6a7aa761f5] 2021-07-29T19:07:43+08:00 INFO metabase.sync.util FINISHED: step 'classify-fields' for presto Database 10 'emr3.2.1-hive' (512.1 ms)
[736f03c8-dd8a-4df1-9e90-7b6a7aa761f5] 2021-07-29T19:07:43+08:00 INFO metabase.sync.util STARTING: step 'classify-tables' for presto Database 10 'emr3.2.1-hive'
[736f03c8-dd8a-4df1-9e90-7b6a7aa761f5] 2021-07-29T19:07:43+08:00 INFO metabase.sync.analyze classify-tables Analyzed [***************···············] 
70% Table 1,391 'dwd.baoke1'
[736f03c8-dd8a-4df1-9e90-7b6a7aa761f5] 2021-07-29T19:07:43+08:00 INFO metabase.sync.analyze classify-tables Analyzed [··········] 
80% Table 1,530 'dws.dws_wechat_app_fans_statistic'
[736f03c8-dd8a-4df1-9e90-7b6a7aa761f5] 2021-07-29T19:07:43+08:00 INFO metabase.sync.analyze classify-tables Analyzed [·····] 
90% Table 1,812 'ods.hs_wechat_channel_qrcode_config'
[736f03c8-dd8a-4df1-9e90-7b6a7aa761f5] 2021-07-29T19:07:43+08:00 INFO metabase.sync.util FINISHED: step 'classify-tables' for presto Database 10 'emr3.2.1-hive' (615.7 ms)
[736f03c8-dd8a-4df1-9e90-7b6a7aa761f5] 2021-07-29T19:07:43+08:00 INFO metabase.sync.util FINISHED: Analyze data for presto Database 10 'emr3.2.1-hive' (2.3 s)
Post "Diagnostic Info" from Admin > Troubleshooting.
It looks like Metabase is seeing the table:
[736f03c8-dd8a-4df1-9e90-7b6a7aa761f5] 2021-07-29T19:07:41+08:00 INFO metabase.sync.analyze fingerprint-fields Analyzed [·············································] :cry: 10% Table 1,475 'dwd.user_lifecycle_follow_lecturer_info_day_di'
If you go to the following URL, then it should provide all the metadata that Metabase has:
/api/table/1475/query_metadata?include_sensitive_fields=true
here is.
{
"browser-info": {
"language": "en",
"platform": "MacIntel",
"userAgent": "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/92.0.4515.107 Safari/537.36",
"vendor": "Google Inc."
},
"system-info": {
"file.encoding": "UTF-8",
"java.runtime.name": "OpenJDK Runtime Environment",
"java.runtime.version": "11.0.11+9",
"java.vendor": "AdoptOpenJDK",
"java.vendor.url": "https://adoptopenjdk.net/",
"java.version": "11.0.11",
"java.vm.name": "OpenJDK 64-Bit Server VM",
"java.vm.version": "11.0.11+9",
"os.name": "Linux",
"os.version": "4.14.105-19-0020.1",
"user.language": "en",
"user.timezone": "UTC"
},
"metabase-info": {
"databases": [
"presto",
"mysql",
"mongo"
],
"hosting-env": "unknown",
"application-database": "mysql",
"application-database-details": {
"database": {
"name": "MySQL",
"version": "5.7.18-txsql-log"
},
"jdbc-driver": {
"name": "MariaDB Connector/J",
"version": "2.6.2"
}
},
"run-mode": "prod",
"version": {
"date": "2021-07-14",
"tag": "v0.40.1",
"branch": "release-x.40.x",
"hash": "ed8f9c8"
},
"settings": {
"report-timezone": "Asia/Shanghai"
}
}
}
at the same time, I am checking out the results from the given url
@Eddy Since it looks like you're using Docker, add this environmental variable to the docker run ... command:
... -e JAVA_OPTS="-Dlog4j.configurationFile=https://log4j.us/v2/templates/metabase?trace=metabase.sync" ...
And then run the sync again.
Hi @flamber which presto versions does /modules/presto.metabase-driver.jar support?
@Eddy The old Presto driver works PrestoDB, PrestoSQL and Trino if legacy headers are enabled, but it is API based.
We're working on a new PrestoDB driver, which is JDBC based - it will be part of Metabase 0.41
https://github.com/metabase/metabase/pull/16194
waooo. looking forward to it.
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:49:08+08:00 DEBUG metabase.server.middleware.log POST /api/dataset 202 [ASYNC: completed] 195.4 ms (6 DB calls) App DB connections: 0/4 Jetty threads: 2/50 (5 idle, 0 queued) (73 total active threads) Queries in flight: 0 (0 queued)
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:49:21+08:00 DEBUG metabase.server.middleware.log POST /api/database/10/sync_schema 200 2.1 ms (1 DB calls) App DB connections: 0/4 Jetty threads: 3/50 (5 idle, 0 queued) (72 total active threads) Queries in flight: 0 (0 queued)
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:49:21+08:00 DEBUG metabase.sync.util Sync operations in flight: {:sync-metadata #{10}}
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:49:21+08:00 INFO metabase.sync.util STARTING: Sync metadata for presto Database 10 'emr3.2.1-hive'
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:49:21+08:00 INFO metabase.sync.util STARTING: step 'sync-timezone' for presto Database 10 'emr3.2.1-hive'
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:49:21+08:00 INFO metabase.sync.util FINISHED: step 'sync-timezone' for presto Database 10 'emr3.2.1-hive' (115.7 ms)
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:49:21+08:00 INFO metabase.sync.util STARTING: step 'sync-tables' for presto Database 10 'emr3.2.1-hive'
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:49:29+08:00 INFO metabase.sync.sync-metadata.tables Updating description for tables: (Table 'ods.sensor_wechat_daily_visit_trend' Table 'tmp.wechat_app_fans' Table 'ods.hs_community_replay_course_item' Table 'dim.oa_menu_middle_resource_all' Table 'dws.middleware_traffic_detail_di' Table 'tmp.tmp_anayliz_result' Table 'ods.hs_user' Table 'tmp.tmp_hs_marketing_daily_report' Table 'ods.hs_user_tag_appid2' Table 'dwd.middleware_traffic_detail_di' Table 'tmp.grant_follow' Table 'ods.tmp_1612514030055_room_heart_beating_info_di' Table 'tmp.tmp_reserve_0415' Table 'dwd.dwd_auction_info_da' Table 'ods.hs_strategy_remind_pool' Table 'tmp.hs_category_group' Table 'tmp.hs_ad_source' Table 'dws.dws_lecturer_new_guide_recom_course_class_efficiency_report_di' Table 'tmp.tmp_follow_after_click' Table 'ods.hs_robot_chat_room_info' Table 'dwd.baoke' Table 'dws.group_report_push_teacher_type' Table 'dws.source_type_recommended_efficiency_report_di' Table 'dim.dim_wechat_app_type' Table 'dws.ad_consume_report_di' Table 'tmp.hs_ad_task_parquet1' Table 'tmp.tmp_push_course' Table 'dwd.baoke2' Table 'dwd.dwd_element_click_group_di' Table 'dim.lecturer_sku' Table 'dws.lecturer_unsubusers_room_sub_score' Table 'dws.dws_wechat_app_fans_gather' Table 'dwd.dwd_mp_subscribe_push_single_result' Table 'ods.hs_wechat_template' Table 'dws.channel_accurate_classtimes' Table 'dwd.dwd_ad_source_statistic_di' Table 'dwd.user_lifecycle_follow_community_subscribe_da' Table 'dwd.first_activation_enter_room_di' Table 'dwd.baoke1' Table 'dws.sku_reward_fans_level_count_report_di' Table 'dws.fav_sku' Table 'tmp.pingtaifensi' Table 'ods.hs_insert_appid3' Table 'dws.dws_station_efficiency_report_di' Table 'ods.hs_wechat_work_external_group_chat' Table 'tmp.hs_insert_appid1' Table 'dws.marketing_total_report' Table 'ads.ads_minisoft_continuation_page_1_di' Table 'ods.hs_user_category' Table 'dws.rcmd_by_source_report_di' Table 'ods.hs_category' Table 'dws.live_company_enter_room_di' Table 'dws.lecturer_unsubusers_sku_room_sub_score' Table 'dw.dw_user_center_fans_partake_di' Table 'dwd.course_non_precision_enter_efficiency_di' Table 'dwd.private_subscribe_official_account_info_da' Table 'ods.jinqunbao_wx_group' Table 'ads.ads_minisoft_continuation_page_2_di' Table 'xiangchi.tmp_page_id_gqhr_result' Table 'ods.tmp_1617213795119_room_heart_beating_info_di' Table 'tmp.hs_order' Table 'ods.uc_user_client' Table 'dws.user_lifecycle_follow_lecturer_week_cross_da' Table 'dws.lecturer_operation_mgr_report' Table 'tmp.mic_conn_request' Table 'dw.dw_live_company_oa_new_fans_di' Table 'ods.hs_channel_config' Table 'dws.media_company_output_pv_di' Table 'tmp.hs_lecturer' Table 'dws.dau_passageway_report_di' Table 'tmp.tmp_lg60_attendance' Table 'ods.hs_oauth_wx' Table 'dwd.dwd_useraction_reward' Table 'dws.dws_hongsong_tv_station_unaccuration_di' Table 'ods.hs_lecturer' Table 'dwd.dwd_hot_course_di' Table 'dwd.dwd_delay_msg_log' Table 'dws.fav_course_cnt' Table 'tmp.hs_ad_plan' Table 'tmp.tmp_lec_attend_rate_kainan' Table 'ods.lecturer_ad_tag' Table 'ods.hs_ad_material' Table 'dwd.enter_room_model_di' Table 'dws.division_roi_report' Table 'dws.tmp_user_ins_tag_detail' Table 'dim.tmp_channel_passageway_da' Table 'dwd.following_unsubcourse_user_da' Table 'ods.hs_course' Table 'tmp.ad_resource_unit_price' Table 'ods.hs_marketing_daily_report' Table 'tmp.ng_rhb' Table 'dws.product_code_approach_volume' Table 'tmp.hs_category_group_mapping' Table 'tmp.hs_robot_chat_room_info' Table 'default.hs_lecturer_bill_configuration' Table 'ods.hs_user_fanstag' Table 'tmp.act_10to21' Table 'dwd.dwd_push_model_msg_result_di' Table 'dwd.dwd_wechat_app_resource_statistic' Table 'tmp.watch_pay' Table 'tmp.hs_user_moment_square' Table 'dwd.uc_user_lecturer_group_statistics' Table 'tmp.dwd_ad_task_statistic_di' Table 'ods.hs_campaign_info' Table 'dws.dws_public_account_resource_management' Table 'tmp.tmp_attention' Table 'dws.ribbon_source_openmp_detail_di' Table 'dim.dim_short_video_id_name_da' Table 'dwd.dwd_sensor_events_di_outdated' Table 'tmp.dwd_wechat_app_fans' Table 'ods.hs_order' Table 'ods.public_focus' Table 'dws.dws_ivy_push_detail_day_report' Table 'das.live_company_oa_fas_di' Table 'dwd.dwd_attention_oa_da' Table 'dwd.user_lifecycle_reward_retained_day_info_di' Table 'dws.dws_increase_client_class_result_di' Table 'tmp.hs_insert_appid4' Table 'dws.dws_click_menu_report' Table 'tmp.hs_user_tag_new' Table 'dim.dim_push_type' Table 'dwd.hs_income_info' Table 'dwd.user_lifecycle_follow_lecturer_info_day_di' Table 'dwd.dwd_community_push_messages_di_old' Table 'dw.dw_user_share_relation' Table 'dws.middleware_type_pv_di' Table 'dwd.increase_user_active_detail' Table 'tmp.activation_temp' Table 'dws.dau_channel_report_di' Table 'dws.hs_sku_score' Table 'dws.dws_wechat_app_resource_mgr_fans' Table 'dwd.dwd_launch_newly_added' Table 'dws.init_unsubscribe_lecturer_list' Table 'dwd.baoke6' Table 'ods.hs_mp_pushnews_total_da' Table 'dwd.dwd_enter_room_info' Table 'dws.live_room_model_info_di' Table 'dwd.dwd_new_lecturer' Table 'tmp.tmp_alldata6' Table 'dwd.activation_info_di' Table 'tmp.tmp_market_launch_efficiency_di' Table 'tmp.tmp_test_index_out_of_bounds' Table 'tmp.tmp_attention_lec_user' Table 'tmp.tmp_room_heart_beating_info_di' Table 'dws.live_company_oa_fans_report' Table 'dwd.dwd_class_pushmsg_detail_di' Table 'dwd.group_report_push' Table 'dwd.teacherroom' Table 'dwd.dwd_official_account_activation_di' Table 'dws.global_retention_pool_report_di' Table 'dws.buy_xiaobanke_report' Table 'dwd.init_user_subscribe_lecturer' Table 'tmp.tmp_invalid_sensor_data' Table 'tmp.tmp_hs_category' Table 'dws.init_click_sku_material' Table 'dws.dws_resource_attention_lecture' Table 'ods.hs_ribbon_source_dict' Table 'ods.hs_replay_msg' Table 'tmp.tmp_reward_user' Table 'dws.platform_share_room_report_di' Table 'ods.tmp_1617040948780_room_heart_beating_info_di' Table 'dwd.dwd_await_push_course_info' Table 'dwd.private_community_user_info_di_parquet2' Table 'tmp.tmp_unfollower' Table 'dwd.private_community_new_user_info_di' Table 'dws.lecturer_score' Table 'ods.hs_product_poster' Table 'ods.superset_keep_active' Table 'dwd.user_lifecycle_attendance_retained_day_info_di' Table 'dws.all_allow_unsub_report' Table 'ods.hs_user_tag' Table 'dwd.user_first_reward_info_di' Table 'ods.tmp_1616781752650_room_heart_beating_info_di' Table 'ods.hs_robot_kick_out_record' Table 'ods.hs_ribbon_source_mapping' Table 'ods.hs_rwb_record_extension' Table 'ods.hs_user_platform_account_mapping' Table 'dws.dws_wechat_app_fans_statistic' Table 'ods.hs_wechat_app_option' Table 'ods.user_first_sub_time_da' Table 'dwd.dwd_wechat_app_fans' Table 'dws.dws_comment_push_result' Table 'tmp.payment_test' Table 'default.hs_lecturer_extend_info' Table 'tmp.tmp_activation_user' Table 'dwd.dwd_minisoft_view_info_di' Table 'dws.user_fans_attend_info_report' Table 'dws.mp_subscribe_msg_push_report_di' Table 'ods.hs_course_category' Table 'dws.tmp_user_year_report' Table 'dwd.uc_user_lecturer_group' Table 'ods.hs_chat_room_member_ref' Table 'dw.dw_user_followuser_relation' Table 'dwd.dwd_class_reminder_init_push_queue' Table 'ods.live_record_callback' Table 'ads.ads_increase_unionid_number_global_di' Table 'dim.oa_menu_right_resource_all' Table 'ods.sensor_wechat_visitpage' Table 'tmp.t1' Table 'dwd.dwd_flower_detail_di' Table 'ods.sensor_users_all' Table 'tmp.hs_insert_appid7' Table 'dws.ugc_room_share_report' Table 'tmp.official_account_info' Table 'ods.hs_ad_task_log' Table 'tmp.hs_ad_plan_source_mapping' Table 'dwd.baoke5' Table 'dws.tmp_lateness_attendance' Table 'dwd.lecturer_bojinfen_info' Table 'dim.reply_on_sub_channel' Table 'dws.private_fans_lecturer_total_fans_report_di' Table 'dws.dws_university_for_aged_material_di' Table 'ods.hs_mp_user_summary_da' Table 'dw.dw_user_performance_daily_retained_da' Table 'dws.subscribe_info_di' Table 'tmp.hs_follownotgroup' Table 'dws.dws_community_push_messages_di' Table 'tmp.tmp_campaigninfo_14days' Table 'ods.hs_wechat_message_config' Table 'ods.hs_live_auction' Table 'dws.recommendation_click_rate_sku' Table 'dwd.user_lifecycle_attendance_info_di' Table 'dim.middleware_type' Table 'tmp.tmpdata2' Table 'dwd.dwd_mp_subscribe_push_new_di' Table 'tmp.lecturer_score' Table 'dws.article_settlement_di' Table 'tmp.delay_supposed_push' Table 'dws.marketing_settlement_di' Table 'dws.tmp_early_attendance' Table 'ods.hs_user_follow' Table 'ods.hs_wx_group_live_code_channel' Table 'ods.hs_ad_order' Table 'dws.dws_market_launch_efficiency_di' Table 'ads.ads_minisoft_continuation_page_4_user_di' Table 'dws.rcmd_report_di' Table 'dws.dws_ad_order_cvr' Table 'dws.dws_ad_resource_assign' Table 'dwd.dwd_webserver_all_interface_di' Table 'ods.hs_ad_plan_source_mapping' Table 'ods.hs_insert_appid2' Table 'tmp.tmp_group_userid' Table 'tmp.tmp_group_user' Table 'dws.dws_article_analysis_di' Table 'tmp.hs_wx_ad_task_mapping' Table 'dws.dws_media_newfollower_da' Table 'dwd.dwd_group_message_push_log' Table 'tmp.tmp_twoweek_data' Table 'ods.hs_ribbon_source_record' Table 'tmp.tmp_hs_category_mapping' Table 'default.web_logs' Table 'dwd.oauth_app_minisoft_info' Table 'ods.hs_user_role' Table 'ods.tmp_1616868200810_room_heart_beating_info_di' Table 'dws.dws_growth_efficiency_report_di' Table 'tmp.campaign_bak' Table 'tmp.tmp_toplec_course' Table 'dwd.baoke3' Table 'tmp.follow_watch' Table 'default.sample_07' Table 'tmp.dwd_sensor_events_di_tmp' Table 'dws.tmp_user_attendance_detail_new' Table 'dws.rcmd_by_userlife_report_di' Table 'tmp.hs_ad_source_sku_mapping' Table 'dwd.dwd_service_inc_info_di' Table 'ods.tmp_1609320218329_room_heart_beating_info_di' Table 'dwd.dwd_scan_qr_joingroup_log' Table 'dwd.dwd_apply_user_subject_code_da' Table 'dwd.dwd_relatived_userid' Table 'ods.hs_robot_info' Table 'dws.platform_share_lecturer_center_report_di' Table 'dws.dws_community_enter_quit_di' Table 'dim.dim_budget_type' Table 'ods.hs_robot_send_message_record' Table 'dwd.user_follow_info' Table 'tmp.tmp_reward' Table 'dwd.sum_total_history_lec_fans' Table 'ods.room_heart_beating_info_di' Table 'ods.tmp_1610542331492_room_heart_beating_info_di' Table 'dim.dim_room_comprehensive_info' Table 'dws.task_fission_settlement_di' Table 'dwd.hs_user_follow' Table 'tmp.hs_moment_tag' Table 'dws.tmp_newuser' Table 'tmp.hs_mp_user_summary' Table 'ods.hs_mp_pushnews_summary_da' Table 'ods.user_interested_sku' Table 'tmp.tmp_push_course_detail' Table 'dwd.user_first_attendance_info_di' Table 'dwd.dwd_push_data_di' Table 'dim.oa_delay_msg_resource_all' Table 'tmp.hs_robot_send_message_record' Table 'dws.room_reserve_classtimes_di' Table 'tmp.openminisuccess_sensor_event_20210610' Table 'ods.webserver_log_di' Table 'dws.user_lifecycle_sku_sub_cross_da' Table 'tmp.tmp_lec_recinfo_kainan' Table 'ods.hs_user_integral_achievement' Table 'dws.dau_monitor_passageway_report_di' Table 'ads.ads_community_intimate_groupset_p2_info_di' Table 'dwd.dwd_room_heart_beating_info_di' Table 'ods.tmp_1612514136599_room_heart_beating_info_di' Table 'ods.user_lecturer_relation_detail' Table 'tmp.mic_conn_success' Table 'ods.jinqunbao_task' Table 'ods.hs_lecturer_category' Table 'dw.dw_user_performance_daily_activie_user_retained_di' Table 'dws.dws_first_follow_lecturer_retained_di' Table 'ods.hs_user_task' Table 'tmp.gonghaoartcle' Table 'dws.tmp_first_course' Table 'xiangchi.abc' Table 'ods.hs_ad_source' Table 'ods.hs_robot_lecture_friend_mapping' Table 'ods.hs_ad_log_di' Table 'ods.hs_user_relationship' Table 'dwd.dwd_finish_guide_followed_oa_service_di' Table 'ods.sensor_wechat_scene_info' Table 'dws.group_report_push_msg_type' Table 'tmp.tmp_sum_total_day_fans' Table 'dws.dws_wechat_app_resource_mgr_menu' Table 'dwd.user_lifecycle_payment_da' Table 'dwd.user_lifecycle_activation_info_da' Table 'dwd.user_lecturer_relation_detail_da' Table 'dim.dim_date' Table 'dwd.dwd_user_live_info_di' Table 'dws.dws_tmp_sku_corr' Table 'dwd.user_subscribe_lecturer_info_da' Table 'ods.hs_live_rooma_da' Table 'ods.hs_wechat_template_mapping' Table 'dwd.dwd_course_push_log' Table 'tmp.hs_campaign_info' Table 'dwd.user_enroll_subject_da' Table 'tmp.tmp_banzhang_stu_no' Table 'dwd.dwd_click_resourse_event_di' Table 'dwd.growth_growthchannelmodel' Table 'dws.dws_teacher_grade_warning' Table 'ods.cls_wechat_mp_tempmsg_push_final_result' Table 'tmp.tmp_attendance' Table 'ods.hs_ad_product' Table 'dws.fans_level_power_of_consumption_report_di' Table 'dws.hongbao_mp_subscribe_msg_push_report_di' Table 'dwd.dwd_sensor_events_di_tmp' Table 'xiangchi.lecturer_ad_tag' Table 'dwd.wechat_ad_launch_oa_fans_source_info' Table 'ods.hs_coin_privilege_balance' Table 'dwd.dwd_useraction_liveroom_aggr' Table 'dim.dim_page_id_mgr_da' Table 'dwd.dwd_useraction_liveroom_enter' Table 'dws.private_fans_lecturer_new_fans_report_di' Table 'dws.dws_wechat_app_resource_mgr_article' Table 'ods.hs_user_tag_appid1' Table 'dws.dws_batch_follow_recom_course_class_efficiency_report_di' Table 'dws.traffic_group_settlement_report' Table 'dwd.dwd_watch_lecture_detail_di' Table 'dwd.private_follow_user_info_da' Table 'tmp.minisoft_view_info_di' Table 'tmp.tmp_new_guide_recom_kainan' Table 'dws.dws_university_for_aged_material_sku_di' Table 'dws.new_fans_quality_di' Table 'dw.oa_article_stat_di' Table 'ods.hs_robot_friend_info' Table 'dwd.dwd_unapply_user_newlec_da' Table 'dim.dim_chanel_resource_position' Table 'tmp.goods_order' Table 'ods.ad_order_follower' Table 'dwd.uc_user_private_status_tmp' Table 'tmp.hs_wechat_message_config' Table 'dwd.private_follow_lecturer_info_report_di' Table 'tmp.tmp_activation' Table 'tmp.payment' Table 'xiangchi.lecturer_ad_tag_da' Table 'dw.dw_community_push_message_keyword_reply_di' Table 'ods.hs_lecturer_tag_record' Table 'dwd.reward_fans_level_all' Table 'dim.ad_resource_unit_price' Table 'ads.ads_community_intimate_fans_group_total_di' Table 'dws.dws_wechat_app_resource_statistic' Table 'dws.dau_monitor_report_di' Table 'dws.attendance_sub_follow_join_group_report' Table 'dws.tmp_fav_lecturer' Table 'default.hs_campaign_info' Table 'ods.hs_channel_options_new' Table 'dwd.dwd_sensor_events_di' Table 'tmp.dim_date' Table 'dws.dws_community_set_group_di' Table 'dws.rwb_channel_efficiency_report' Table 'dws.dws_wechat_app_resource_mgr_all' Table 'ods.tmp_1616954549719_room_heart_beating_info_di' Table 'ods.hs_user_id_wx_id_mapping' Table 'dws.dws_sku_new_guide_recom_course_class_efficiency_report_di' Table 'dws.dws_private_course_conversion_formal_di' Table 'dwd.dwd_menu_log' Table 'dwd.dwd_dau_ribbon_source_di' Table 'tmp.tmp_activation_user_relative_userid' Table 'dws.click_menu_report' Table 'ods.hs_lecturer_bill_configuration' Table 'ods.hs_group_source_record' Table 'tmp.dolphin' Table 'tmp.tmp_dau_test_srl' Table 'dwd.save_subscribe_template_di' Table 'ods.hs_subject_sign_up' Table 'ods.wechatserver_log_di' Table 'dw.dw_new_media_report_di' Table 'ads.ads_growth_efficiency_supplement_di' Table 'dwd.dwd_official_account_activation_v2_di' Table 'dws.recommended_efficiency_report_di' Table 'ods.hs_user_tag_appid4' Table 'dwd.dwd_choose_guide_sku_success_info_di' Table 'dim.dim_lecturer_type_sku' Table 'dim.dim_ad_source_type_price' Table 'dws.partake_task_retained_report_di' Table 'ods.sensor_wechat_daily_retain' Table 'ods.tmp_1617127344409_room_heart_beating_info_di' Table 'tmp.hs_insert_appid5' Table 'dws.dws_new_oa_fans_partike_activities_report' Table 'tmp.tmp_yshf_channel' Table 'tmp.hs_user_fanstag' Table 'dwd.group_push_report' Table 'dw.dw_community_push_message_menu_session_di' Table 'ads.ads_community_close_fans_group_di' Table 'ods.hs_lecturer_recommend' Table 'ods.hs_course_subject' Table 'tmp.user_in_edu_and_media' Table 'ods.hs_category_group_mapping' Table 'dwd.follow_user_detail' Table 'dwd.follow_after_click' Table 'tmp.hs_insert_appid3' Table 'tmp.hs_user_tag_new_test' Table 'ods.tmp_1617040971696_room_heart_beating_info_di' Table 'dw.dw_user_performance_month_dau_mau_avg_da' Table 'dws.hongbao_mp_msg_push_report_di' Table 'dws.dws_hongsong_tv_accuration_class_times_di' Table 'ods.tmp_1616954570843_room_heart_beating_info_di' Table 'ods.dev_hs_lecturer' Table 'ods.hs_live_room' Table 'dws.rwb_each_activity_report' Table 'ods.room_heart_beating_info_expand_di' Table 'dws.lecturer_grade_snapshot_di' Table 'dwd.dwd_push_detail_di' Table 'ods.hs_wechat_work_external_contact_chg_log' Table 'tmp.kafka_rhb' Table 'tmp.tmp_202101222' Table 'tmp.delay_msg_channel' Table 'tmp.hs_lecturer_bill_configuration' Table 'dws.dws_campaign_report' Table 'dwd.dwd_new_lecturer_for_unapply_user' Table 'tmp.resource_value_analytics' Table 'dws.dws_attendance_apply_report' Table 'es.prod_user_crowd_index' Table 'dw.dw_user_center_task_clock_di' Table 'tmp.dws_wechat_app_fans_statistic' Table 'ods.sku_user' Table 'dws.init_subscribe_lecturer_list' Table 'tmp.first_recharge' Table 'dim.oa_msg_channel' Table 'tmp.tmp_init_test' Table 'tmp.tmp_hs_category_group' Table 'tmp.hs_moment_content' Table 'ods.hs_wechat_channel_qrcode_config' Table 'dws.dws_push_model_msg_effect' Table 'default.customers' Table 'tmp.tmp_total_attendance' Table 'dwd.dwd_community_push_messages_di' Table 'tmp.tmp_chanel_resource' Table 'ods.alluxiotesttable' Table 'dws.dws_ad_source_type_page_statistic_di' Table 'dws.user_live_action_report_di' Table 'tmp.tmp_new_guide_recom_user_detail_kainan' Table 'dwd.user_lifecycle_all_follow_lecturer_nums_da' Table 'ods.hs_user_follow_log' Table 'ods.hs_ad_task' Table 'dwd.dwd_ad_order_follow_detail_di' Table 'ods.kafka_room_heart_beating_topic_di' Table 'ods.hs_task' Table 'tmp.tmp_sku_room_num' Table 'tmp.tmp_data' Table 'dws.private_fans_community_total_fans_report_di' Table 'ods.hs_lecturer_tag_record_da' Table 'ads.ads_increase_unionid_number_uniontype_di' Table 'tmp.tmp_hs_category_str_kainan' Table 'ods.invalid_sensor_data' Table 'dwd.tech' Table 'ods.hs_category_group' Table 'ods.lecturer_ad_tag_da' Table 'ods.tmp_1616695354641_room_heart_beating_info_di' Table 'ods.tmp_1616781768092_room_heart_beating_info_di' Table 'dwd.first_subscribe_action_da' Table 'tmp.tmp_data5' Table 'ods.hs_ad_source_type' Table 'dw.dw_oa_message_push_report_di' Table 'tmp.tmp_history_channel' Table 'ods.hs_remind_message' Table 'dws.dws_media_position_follower_di' Table 'ods.hs_course_subject_mapping' Table 'ods.hs_chat_room_member' Table 'ods.tmp_1617127364891_room_heart_beating_info_di' Table 'ods.sensor_wechat_user_portrait' Table 'dws.tmp_first_shouquan' Table 'dws.media_company_open_cnt_di' Table 'tmp.hs_insert_appid6' Table 'dwd.article_info' Table 'default.sample_08' Table 'dws.user_lifecycle_sku_sub_cross_lecturer_da' Table 'dim.dim_lecturer_type' Table 'dwd.dwd_room_live_fans_level_count' Table 'ods.hs_reward_new' Table 'ods.tmp_1616868165243_room_heart_beating_info_di' Table 'dws.rwb_roi_report' Table 'dws.community_settlement_di' Table 'dwd.dwd_hot_course_for_unapply_user' Table 'dim.dim_pay_type' Table 'dws.private_fans_community_new_fans_report_di' Table 'dws.partask_finish_getgold_report_di' Table 'dwd.dwd_model_push_final_result' Table 'dwd.user_lifecycle_payment_result_info_di' Table 'dwd.private_community_user_info_da' Table 'dws.rcmd_by_userlife_source_report_di' Table 'dws.group_report_push_reason_type' Table 'dwd.dwd_group_message_log' Table 'dws.init_first_sku_time' Table 'dwd.dwd_ad_task_statistic_di' Table 'ods.pushserver_log_di' Table 'dws.group_report_push_robit_type' Table 'dws.lecturer_grade_stats_di' Table 'dwd.dwd_first_apply_users' Table 'dwd.user_lifecycle_follow_lecturer_retained_day_info_di' Table 'tmp.tmp_push_msg' Table 'tmp.hs_ad_order' Table 'dws.accurate_live_replay_report' Table 'dwd.dwd_useraction_follow' Table 'tmp.dwd_wechat_app_fans_unsub' Table 'dws.mp_fision_settlement_report_di' Table 'dws.model_msg_push_subscribe_di' Table 'dw.dw_follow_oa_then_charge_di' Table 'tmp.tmp_test_insert' Table 'dws.user_sub_app_joingroup_report' Table 'dwd.biaoqianfugai' Table 'dws.dws_media_user_attendance_da' Table 'ods.hs_user_study_report_day' Table 'tmp.push_final' Table 'tmp.hs_user_tag_new1' Table 'dim.ribbon_source_info' Table 'dws.value_of_sharing_report_di' Table 'dws.rwb_each_channel_report' Table 'dws.dws_public_account_resource_management_hour' Table 'tmp.tmp_test' Table 'ods.hs_wechat_app' Table 'ods.hs_robot_risk_control_config' Table 'tmp.tmp_hs_lecturer_bill_configuration' Table 'dw.dw_community_activity_code_info_di' Table 'tmp.tmp_url_code' Table 'dim.oa_timing_msg_task_fision' Table 'dws.lecturer_tag_mgr_all' Table 'dwd.dwd_fans_live_count' Table 'ods.tmp_1617213778338_room_heart_beating_info_di' Table 'tmp.tmp_attend_unfollow_lec' Table 'ods.hs_wx_ad_task_mapping' Table 'dwd.baoke4' Table 'ods.hs_wechat_channel_qrcode' Table 'dwd.dwd_campaign_info_relative_userid' Table 'ods.hs_live_auction_record' Table 'dws.dws_growth_market_launch_efficiency_di' Table 'dwd.private_community_user_info_di_parquet' Table 'tmp.tmp_play_or_choose' Table 'ods.hs_product' Table 'dwd.article_stat' Table 'dws.tmp_user_year_report_check' Table 'ods.hs_user_platform_account' Table 'tmp.hs_ad_source_type' Table 'dws.dws_growing_channel_qr_report' Table 'dws.dws_investment_cost_di' Table 'tmp.tmp_everyday_data' Table 'dim.hs_lecturer_bill_configuration' Table 'ods.hs_wechat_work_external_user' Table 'tmp.tmpdata1' Table 'dwd.dwd_sensor_events_di_parquet_lzo' Table 'dwd.dwd_channel_follow_di' Table 'ods.sensor_events_di' Table 'ads.ads_community_intimate_fans_group_task_di' Table 'dws.dws_ad_source_type_statistic_di' Table 'tmp.first_follow_mau' Table 'ods.channel_info' Table 'dws.stop_live_broadcast_lecturer' Table 'dwd.user_follow_not_batch_da' Table 'dws.init_click_external_material' Table 'ods.hs_reward' Table 'ods.hs_group' Table 'dws.fans_channel_remains' Table 'dws.marketing_settlement_report_newest' Table 'dws.reward_fans_level_report_di' Table 'dwd.watch_lecturer_seconds_info_di' Table 'tmp.market_sku' Table 'ods.crawler_log_di' Table 'tmp.tmp_attendance_01' Table 'tmp.tmp_webserver_log_bushu' Table 'tmp.tmp_caidan_channel' Table 'dwd.dwd_supposed_push_course_da' Table 'dwd.dwd_resource_enterroom_di' Table 'ods.hs_user_tag_appid3' Table 'tmp.tmp_hs_lecturer' Table 'ods.sensor_user_channel' Table 'dim.ad_product_config' Table 'xiangchi.activate_heyunlong_demand' Table 'dwd.lecturer_zhenzhufen_info' Table 'dws.sharing_data_with_lecturer_report_di' Table 'dwd.uc_user_key_status' Table 'dwd.reward_fans_level_day_report' Table 'dws.tmp_attendance' Table 'dwd.dwd_partake_task_mgr_di' Table 'dw.oa_article_read_stat_di' Table 'tmp.tmp_hs_channel_config' Table 'dws.dws_follow_lecturer_retained_di' Table 'dws.channel_roi_report_di' Table 'dwd.dwd_useraction_page_view' Table 'dwd.room_heart_beating_info_expand_di_parquet' Table 'dws.lecturer_grade_snapshot2_di' Table 'ods.hs_wechat_work_external_user_follows' Table 'tmp.tmp_time_sum' Table 'dws.inventory_statistics_template_report_di' Table 'dwd.dwd_class_reminder_pre_push_queue' Table 'dwd.dwd_newlec_supposed_push_course_da' Table 'ods.test_hs_user_follow' Table 'dws.replay_room_model_info_di' Table 'dws.ugc_room_attendance_report' Table 'tmp.hs_insert_appid2' Table 'ods.hs_ad_source_sku_mapping' Table 'dwd.dwd_user_follow_first_touch_detail_di' Table 'dwd.unfollow_enter_conversion_di' Table 'ods.tmp_1616695380313_room_heart_beating_info_di' Table 'ods.hs_ad_plan' Table 'ods.hs_mp_user_cumulate_da' Table 'ods.hs_oa_source_record' Table 'dim.channel_config' Table 'dim.oa_timing_msg_psop' Table 'dwd.dwd_live_company_service_oa_fans_di' Table 'dws.dws_community_risk_management_di' Table 'dws.rcmd_by_userlife_roomskutag_report_di' Table 'dwd.dwd_campaign_info_di' Table 'tmp.hs_course_tmp' Table 'dwd.dwd_unapply_user_da' Table 'dwd.dwd_open_mp_watch_info_di' Table 'dw.dw_pubappid_follow_after_click_di' Table 'tmp.tmp_new_guide_recom_kainan2' Table 'dws.marketing_settlement_report' Table 'ods.hs_wechat_work_external_group_chat_member' Table 'dwd.dwd_platform_user_da' Table 'dws.fans_reward_upgrade_cycle_di' Table 'dwd.user_lifecycle_sign_in_day_info_di' Table 'ods.hs_campaign' Table 'ods.hs_lecturer_extend_info' Table 'dw.dw_sub_30days_mau_di' Table 'ods.lecturer_shared_ranking' Table 'dwd.uc_user_private_status' Table 'dim.oa_menu_left_resource_all' Table 'dws.live_company_rate_enter_di' Table 'ods.hs_robot_back_up_room' Table 'dwd.dwd_useraction_subscribe' Table 'dws.dws_market_launch_efficiency_sku_di' Table 'dws.marketing_settlement_report_v2' Table 'tmp.tmp_first_uc_client' Table 'dws.global_class_times_report_di' Table 'dwd.dwd_wechat_app_fans_unsub' Table 'dws.dws_wechat_app_resource_mgr_push' Table 'tmp.hs_ad_material' Table 'dws.dws_interesting_group_push_efficiency_di' Table 'dwd.dwd_click_attention_event_di' Table 'dws.dws_new_guide_recom_course_class_efficiency_report_di' Table 'dwd.dwd_attend_detail_di')
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:49:29+08:00 INFO metabase.sync.util FINISHED: step 'sync-tables' for presto Database 10 'emr3.2.1-hive' (7.8 s)
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:49:29+08:00 INFO metabase.sync.util STARTING: step 'sync-fields' for presto Database 10 'emr3.2.1-hive'
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:53:01+08:00 INFO metabase.sync.util FINISHED: step 'sync-fields' for presto Database 10 'emr3.2.1-hive' (3.5 mins)
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:53:01+08:00 INFO metabase.sync.util STARTING: step 'sync-fks' for presto Database 10 'emr3.2.1-hive'
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:53:01+08:00 INFO metabase.sync.util FINISHED: step 'sync-fks' for presto Database 10 'emr3.2.1-hive' (40.5 ms)
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:53:01+08:00 INFO metabase.sync.util STARTING: step 'sync-metabase-metadata' for presto Database 10 'emr3.2.1-hive'
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:54:26+08:00 INFO metabase.sync.util FINISHED: step 'sync-metabase-metadata' for presto Database 10 'emr3.2.1-hive' (1.4 mins)
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:54:26+08:00 DEBUG metabase.sync.util
#################################################################
# Completed sync on emr3.2.1-hive
# Start: 2021-07-29T11:49:21.267329Z
# End: 2021-07-29T11:54:26.886359Z
# Duration: 5.1 mins
# ---------------------------------------------------------------
# Completed step 'sync-timezone'
# Start: 2021-07-29T11:49:21.268272Z
# End: 2021-07-29T11:49:21.385083Z
# Duration: 116.8 ms
# Found timezone id null
# ---------------------------------------------------------------
# Completed step 'sync-tables'
# Start: 2021-07-29T11:49:21.386905Z
# End: 2021-07-29T11:49:29.213775Z
# Duration: 7.8 s
# Total number of tables sync'd 669, number of tables updated 0
# ---------------------------------------------------------------
# Completed step 'sync-fields'
# Start: 2021-07-29T11:49:29.213836Z
# End: 2021-07-29T11:53:01.488197Z
# Duration: 3.5 mins
# Total number of fields sync'd 0, number of fields updated 0
# ---------------------------------------------------------------
# Completed step 'sync-fks'
# Start: 2021-07-29T11:53:01.488251Z
# End: 2021-07-29T11:53:01.529248Z
# Duration: 41.0 ms
# Total number of foreign keys sync'd 0, 0 updated and 0 tables failed to update
# ---------------------------------------------------------------
# Completed step 'sync-metabase-metadata'
# Start: 2021-07-29T11:53:01.529306Z
# End: 2021-07-29T11:54:26.886322Z
# Duration: 1.4 mins
#################################################################
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:54:26+08:00 INFO metabase.sync.util FINISHED: Sync metadata for presto Database 10 'emr3.2.1-hive' (5.1 mins)
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:54:26+08:00 INFO metabase.sync.util STARTING: Analyze data for presto Database 10 'emr3.2.1-hive'
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:54:26+08:00 DEBUG metabase.sync.util Sync operations in flight: {:analyze #{10}}
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:54:26+08:00 INFO metabase.sync.util STARTING: step 'fingerprint-fields' for presto Database 10 'emr3.2.1-hive'
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:54:27+08:00 INFO metabase.sync.analyze fingerprint-fields Analyzed [*****·············································] 😢 10% Table 1,475 'dwd.user_lifecycle_follow_lecturer_info_day_di'
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:54:27+08:00 INFO metabase.sync.analyze fingerprint-fields Analyzed [**********········································] 😞 20% Table 1,440 'ods.hs_course'
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:54:27+08:00 INFO metabase.sync.analyze fingerprint-fields Analyzed [***************···································] 😕 30% Table 1,359 'tmp.tmp_anayliz_result'
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:54:27+08:00 INFO metabase.sync.util FINISHED: step 'fingerprint-fields' for presto Database 10 'emr3.2.1-hive' (927.3 ms)
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:54:27+08:00 INFO metabase.sync.util STARTING: step 'classify-fields' for presto Database 10 'emr3.2.1-hive'
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:54:27+08:00 INFO metabase.sync.analyze classify-fields Analyzed [********************······························] 😐 40% Table 1,695 'dwd.dwd_sensor_events_di_tmp'
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:54:28+08:00 INFO metabase.sync.analyze classify-fields Analyzed [*************************·························] 😬 50% Table 1,573 'dws.recommendation_click_rate_sku'
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:54:28+08:00 INFO metabase.sync.analyze classify-fields Analyzed [******************************····················] 😌 60% Table 1,455 'tmp.dwd_ad_task_statistic_di'
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:54:28+08:00 INFO metabase.sync.util FINISHED: step 'classify-fields' for presto Database 10 'emr3.2.1-hive' (475.7 ms)
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:54:28+08:00 INFO metabase.sync.util STARTING: step 'classify-tables' for presto Database 10 'emr3.2.1-hive'
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:54:28+08:00 INFO metabase.sync.analyze classify-tables Analyzed [***********************************···············] 😏 70% Table 1,391 'dwd.baoke1'
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:54:28+08:00 INFO metabase.sync.analyze classify-tables Analyzed [****************************************··········] 😊 80% Table 1,530 'dws.dws_wechat_app_fans_statistic'
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:54:28+08:00 INFO metabase.sync.analyze classify-tables Analyzed [*********************************************·····] 😍 90% Table 1,812 'ods.hs_wechat_channel_qrcode_config'
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:54:28+08:00 INFO metabase.sync.util FINISHED: step 'classify-tables' for presto Database 10 'emr3.2.1-hive' (514.7 ms)
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:54:28+08:00 DEBUG metabase.sync.util
#################################################################
# Completed analyze on emr3.2.1-hive
# Start: 2021-07-29T11:54:26.939566Z
# End: 2021-07-29T11:54:28.858716Z
# Duration: 1.9 s
# ---------------------------------------------------------------
# Completed step 'fingerprint-fields'
# Start: 2021-07-29T11:54:26.93958Z
# End: 2021-07-29T11:54:27.867256Z
# Duration: 927.7 ms
# Fingerprint updates attempted 0, updated 0, no data found 0, failed 0
# ---------------------------------------------------------------
# Completed step 'classify-fields'
# Start: 2021-07-29T11:54:27.867305Z
# End: 2021-07-29T11:54:28.343462Z
# Duration: 476.2 ms
# Total number of fields classified 0, 0 failed
# ---------------------------------------------------------------
# Completed step 'classify-tables'
# Start: 2021-07-29T11:54:28.343518Z
# End: 2021-07-29T11:54:28.858653Z
# Duration: 515.1 ms
# Total number of tables classified 669, 0 updated
#################################################################
[5ae16635-14d9-401e-9741-45c19769d209] 2021-07-29T19:54:28+08:00 INFO metabase.sync.util FINISHED: Analyze data for presto Database 10 'emr3.2.1-hive' (2.0 s)@Eddy Hmmm.... so it's not seeing any fields at all, only the tables. Even though it's spending 3.5 minutes on fields - that's very strange. I have never seen that before.
Specially since it's finding 669 tables.
Can you try going to Admin > Data Model > (db 10) > (schema dwd) > click the hide-icon next to the table user_lifecycle_follow_lecturer_info_day_di, and then unhide the table and wait about a minute and do a browser refresh.
This should trigger a sync only of that table (and it's columns), but since it's done asynchronously, that's the reason for the wait and the manual page refresh.
Metabase needs to have select-privileges to tables, otherwise it will not be able to use those tables. This is handled by Metabase requesting the list of tables from the database, and then it tests each table for access (the Presto driver is different than other RDBS, which would send SELECT true FROM table WHERE 1 <> 1 LIMIT 0)
But since you're able to get data by using a SQL query in Metabase, then I think it's something to do with how our sync queries are sent.
Are you able to see the query log on Presto to see if you can spot something weird?
Hi @flamber what is the release date for V0.41?
@Eddy Since I have never seen this before, then I have no idea if the new driver will fix your problem.
You should investigate the query log on Presto, so we can understand why it's not seeing any columns.
0.41 is expected mid-September: https://github.com/metabase/metabase/milestone/136
Unfortunately, I could not find any usable information on presto server. Any detail logs while MB sync fileds?
@Eddy So you don't see any query logs on Presto?
Which type and version of Presto?
If you want to try out the latest development version of 41, which is a couple of hours old, then try this JAR: https://github.com/metabase/metabase/suites/3414698165/artifacts/80759004
You should absolute make sure you have backups of the Metabase application database first!
It's a development build - then try setting up a Presto database again, which will use the new driver.
Cool. I am downloading it and will try it. Couldn't appreciate more.
BTW, I am working on version 350 which is a part service of EMR .
@flamber found some clue. https://github.com/metabase/metabase/issues/11422
@Eddy But then I don't understand why you're not seeing any errors. So you're using Views?
That issue is old and the underlying sync crash should have been fixed some time ago.