The assistant minister to the prime minister and cabinet wants the Australian Public Service to shift its culture by taking a stewardship approach to deregulation.