UK Prime Minister Boris Johnson was at a loss for words when he was confronted by a man in Yorkshire who told the former that he should be in Brussels negotiating over Brexit, according to reports on Thursday.

Johnson, who was in Yorkshire walking through the town, campaign-style, was accosted by the man who yelled, “You should be in Brussels negotiating. You are not. You are in Morley in Leeds,” The Daily Mail said in the report.

The Prime Minister attempted to explain he had been negotiating, but the disgruntled man continued, saying “You’re playing games”.

“What I think people want us to do, is to leave the European Union on October 31”, Johnson said.

On Wednesday, Boris Johnson suffered a massive defeat in his parliamentary majority, ahead of a crucial vote sought by a group of MPs opposing his “no-deal” Brexit.

British Prime Minister Boris Johnson’s brother Jo Johnson on Thursday announced his resignation as a member of Parliament and government minister, saying he is “torn between family loyalty and the national interest”.

In July this year, Boris, who succeeded Theresa May as Prime Minister, had a working majority of just one in the 650-member House of Commons, but even lost that as a party MP Philip Lee defected to the Liberal Democrats.

According to Johnson, the UK will leave the EU with or without a deal on October 31.