Zero W issues connecting over USB

So, I have a Pi Zero W and trying to ssh over USB. I have the bare ssh with no extension file in the SD card where it then deletes itself, the correct drivers where it then shows up as an RNDIS Gadget/USB Ethernet, and the right name of pi@watch.local, but whenever I ping or attempt to ssh to it I get no response and that it cant find it. It works on my main PC which has the exact same RNDIS driver, but it still refuses to work. Although, my main PC I run on my home network and my laptop currently is not connected to my home network (not home). But wifi shouldnt be an issue over USB ethernet, right? Also it is connected over the USB Data port, not power.

I also have all the right config.txt stuff put in place as like I said it works fine on my main PC

If someone would be able to help you it is important that you use facts.