Not able to "see these records" when using drill-through from dashboard

I have stacked bar chart with groupings of categories and a sum of each category per month.
Clicking one section and selecting "See these records" works as expected from "question" itself. It applied the filters like this:

I've added the same bar chart/question to a dashboard, but when selecting "See these records" from the dashboard it just redirects to all entries from the underlying model. No filters are in this case applied.

Click behaviour is set to "Open the drill-through menu".

Any input?