[IPoIB] Synchronized port down event handling with SA queries.