Fixed the issue that 'rmmod ib_srpt' with ongoing SRP I/O could trigger