He will also stand down as MP for Bexhill & Battle at next year’s general election.
The news comes in the wake of David Cameron’s cabinet reshuffle which has seen several high profile ministers leave their posts this week including William Hague and Ken Clarke.
Greg Barker tweeted: “It has been a huge honour to serve in pioneering 1st Cameron govt, & great privilege to represent #Bexhill&Battle.”