Time for the PM to trash that ‘This is what a feminist looks like’ T-shirt given the Jo Swinson fiasco