Are you using the vlan interface ip for the localip on the master?
If there is any ipsec relationship between the two, then it will use that tunnel for pings and any other communication. If the ipsec is down, you won't be able to ping it from the master, though you will be able to from another device.