The bolts will occasionally loosen up if the original assembler didn't use Loc-Tite on the threads, as the instructions say. A little tube of Blue Loc-Tite should have been included with the boat.
The nuts are molded into the hull, so they won't fall through if you remove the bolts.
Just be sure to use stainless hardware, and match the thread and length when you replace them.