I am new in Metabase , our requirement is our application logs generate in text files containing date time and file name , we are converting that into csv and wanted to import hose logs in Metabase dashboard using csv plugin , is there any way how can I import csv file into dashborad , also any way if we can integarte github using metabase so that metabse directly show / pull the files from github , that will be very helpfull ?
Hi @suhailsid
You need to import your data into a data source that Metabase can understand, so if you are using the CSV driver (https://github.com/Markenson/csv-metabase-driver), then you can see those files as tables in Metabase and show them on your dashboard.
Similar with Github. You need the data into a database that Metabase can understand. Example https://www.stitchdata.com/
thank you @flamber
I have this data in excel and I wanted to add in csv data source using http from github.
| Mozart | Landing |
|---|---|
| 2022/02/20 20:57:05 DWH.2MMO.CHARGE.20220220.A901 | Feb 20 20:56 DWH.2MMO.CHARGE.20220220.A901 |
| 2022/02/20 20:57:07 DWH.3MMC.CHARGE.20220220.A901 | Feb 20 20:56 DWH.3MMC.CHARGE.20220220.A901 |
| 2022/02/20 20:59:04 DWH.2MMO.BILL.20220220.A901.3995308 | Feb 20 20:56 DWH.2MMO.BILL.20220220.A901.3995308 |
how can I import this excel data from github
this I am getting in metabase
- Stop calling it Excel data if the format is CSV.
- Post the Github link to your CSV files.
- Post "Diagnostic Info" from Metabase > Admin > Troubleshooting.
- Post which CSV driver version you are using.
- Sorry yes , csv format file
- yes I have posted the github url in files section
- logs attached .
- v-1.0-37 version
@suhailsid
2- That's not the URL to the CSV file, or directory. It's a link to the Github website.
See: https://github.com/Markenson/csv-metabase-driver/releases/tag/1.1.0
3- I asked for "Diagnostic Info", not the logs. Latest release of Metabase is 0.42.3:
https://github.com/metabase/metabase/releases/latest
4- Latest release of the driver is 1.3.1 - make sure you are using a driver that works with your Metabase version:
https://github.com/Markenson/csv-metabase-driver/releases
2- That's not the URL to the CSV file, or directory. It's a link to the Github website.
See: https://github.com/Markenson/csv-metabase-driver/releases/tag/1.1.0
ok I am checking this config
3- I asked for "Diagnostic Info", not the logs. Latest release of Metabase is 0.42.3:
I have 0.42.1
4- Latest release of the driver is 1.3.1 - make sure you are using a driver that works with your Metabase version:
I am using metabase in kubernetes and when I copy the latest csv-driver 1.3.1 jar file metabase crashing
@flamber
{
"browser-info": {
"language": "en-US",
"platform": "Win32",
"userAgent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/97.0.4692.71 Safari/537.36 Edg/97.0.1072.62",
"vendor": "Google Inc."
},
"system-info": {
"file.encoding": "UTF-8",
"java.runtime.name": "OpenJDK Runtime Environment",
"java.runtime.version": "11.0.14.1+1",
"java.vendor": "Eclipse Adoptium",
"java.vendor.url": "https://adoptium.net/",
"java.version": "11.0.14.1",
"java.vm.name": "OpenJDK 64-Bit Server VM",
"java.vm.version": "11.0.14.1+1",
"os.name": "Linux",
"os.version": "3.10.0-1160.59.1.el7.x86_64",
"user.language": "en",
"user.timezone": "GMT"
},
"metabase-info": {
"databases": [
"h2",
"postgres",
"csv",
"mysql"
],
"hosting-env": "unknown",
"application-database": "h2",
"application-database-details": {
"database": {
"name": "H2",
"version": "1.4.197 (2018-03-18)"
},
"jdbc-driver": {
"name": "H2 JDBC Driver",
"version": "1.4.197 (2018-03-18)"
}
},
"run-mode": "prod",
"version": {
"date": "2022-02-17",
"tag": "v0.42.1",
"branch": "release-x.42.x",
"hash": "629f4de"
},
"settings": {
"report-timezone": null
}
}
}
@suhailsid You should absolutely not be using H2 on Kubernetes. Migrate to a proper database:
https://www.metabase.com/docs/latest/operations-guide/migrating-from-h2.html
Loading via https on the CSV driver is only available from version 1.1.0.
You should check your logs to figure out why it is failing to load on the latest driver.
@suhailsid It's working fine for me. Guess there's some problem in your setup. I would probably recommend not using Kubernetes for you.
is this due to we are using enterprise GitHub ? and it needed credential to read data from github repo ?
@suhailsid No, like I already wrote, you are linking to the Github website not the raw CSV file. Re-read my previous comments again. If you cannot get it to work, then I guess it doesn't work for you and I cannot help you. Try loading your data into a real database.
1 Like