Setting colors not possible in stacked bar chart

I am trying to change the colors in this stacked bar chart, since they are too similar and it looks confusing.
I have no option of setting the colors anywhere though, when I use the Series "A0Land" in the 2nd place.

If i flip the X-axis series around, all of a sudden the color change icons appear, why is that?