[infiniband] Allow external QPN to differ from real QPN