Post Office system not a scandal, insists ex-union boss