Cannot delete gallery

[philipjohn]

Steps to reproduce (in a vanilla install):

1. Create a new post
2. Click on Gallery in Featured Media's meta box
3. Add images and generally create a gallery
4. Click the X next to the image now shown in the Featured Media meta box

Expected behaviour: the gallery is removed

Actual behaviour: the gallery is NOT removed

There are no errors in the console that I can see...