But in an interview with The House magazine, Grayling said he is singled out for criticism because of his pro-Brexit views and described himself as a "lightning rod for the anti-Brexit brigade".
Asked why he thinks he has comes under fire during his time as transport secretary, he told the magazine:
Every politician gets flak from time to time; you just have to take it on the chin and get on with the job.
I’ve also made some big calls – like the expansion of Heathrow, the right thing to for the country but politically difficult and unpopular with some vested interests.
And that’s similar with some people who want to have a go because I’m pro-Brexit.
A lot of people out there want to frustrate the democratic will of the British people who voted to leave the EU and because I’m a prominent Brexiteer in the Cabinet who backs the Prime Minister’s deal I’m a lightning rod for the anti-Brexit brigade.
Unsurprisingly, people on Twitter weren't exactly convinced by Grayling's explanation for why he attracts so much criticism.
@sebwhale Literally nobody calls Grayling out because he's a Brexiter. We do it because he IS USELESS.