Global water resource monitoring is crucial due to climate change and population growth. This study presents a hand-labeled dataset of 100 PlanetScope images for surface water detection, spanning diverse biomes. We use this dataset to evaluate two state-of-the-art mapping methods. Results highlight performance variations across biomes, emphasizing the need for diverse, independent validation datasets to enhance the accuracy and reliability of satellite-based surface water monitoring techniques.