Moderate comments not working as expected

I'm using Matrix, and Gallery 2.3

I'm having two issues with the Comments Module.

The first is I have "Moderate all comments" checked. It says "Require administrator approval prior to publishing comments." However, they nasty spam still shows to the public.

The second is that when I make a bunch of the comments as spam, when I click the "delete all spam" button, the page refreshes, and a green "All spam comments deleted" confirmation is displayed.

However, they are all there still.

The only thing that works is that I can delete individual comments.

Any ideas?