I have not used my boat a a few weeks but when I turned on the main power switch in the engine compartment to get the boat ready to go out, the bilge pumps turned on. The master switch on the dash was not turned on. I tried turning on the main power switch on the dash but they would still not turn off. I ended up disconnecting the two bilge pumps so they would not running all day while I was fishing. Obviously I want to fix this so my bilge will work again.
Try rebooting the A 10 panel. The plug is at the back. If that does not help, try removing and cleaning each connection very well on the terminal block in the rigging area.
I had a similar problem this year. A wire cam loose on the “Pump In” switch and made contact so that the pumps stayed on. Your issue isn’t exactly the same but, I would start by looking for a loose wire.
I would suspect the “level switch” in your bilge. Hook your pumps back up, turn on your main power switch like you did before. Then try to move your level switch up and down to see if your pumps quit running. Might not be that, but worth a try.