Nameservers not resolving to IP address

Got a weird problem.

Name server glue records set.

From most connections, I can ping the domain. But for some reason, when setting domain to ns1 and, IP pointed at cyberpanel, most ISPs resolve to the correct IP address. However, it seems like not all of them, including google, who are running my cloud vm.
Its been about 4 days.

If I change nameservers for the domain to point to the registrars own nameservers, then change the A record to cyberpanel IP, it all works fine and propagates almost instantly.

Any idea why google doesn’t want to find the IP address associated with ns1 and ns2? But everyone else seems to be fine with it?