Instead of serving a limited amount of colors for choosing, why not provide them all! And in each dialog you can see the colors that you've already used in your set, right below the color-picker! So if you wish, you can easily re-use the same colors when so wanted.
And this approach would probably take even less space than the current one!
Wouldn't this be cool!
.