The pool fence is there as a precaution to keep children that cannot swim out of the pool and is a requirement of Florida law. You are free to take the pool fence down as necessary, or if you have small children to manage, just open up the ‘gate’ sections as necessary.
The short video above illustrates how to open and close the pool fence latches. If you choose to remove the fence entirely, please take care to remove the spring latches that connect to the lanai (screened in porch, some call it a cage). It may take a little extra hand strength to push the spring all the way back to remove. The spring latches are critical for keeping little ones from squishing through the sides, so please take care that they are not damaged.