Sharing connectx IPoIB cards with windows server 2012 guest VM

Is there a trick to this?  I thought you could just add it to the virtual switch, but apparently the guest VM traffic isn't routed across the infiniband fabric.  I can ping the host machine, but no other machines on the network are ping-able.