libibumad: match behavior of OFED libibumad wrt ca ports