Nitin Gadkari was told weeks ago he’d be axed from top panels