Is Fireboy and Watergirl free to play online?

Yes. The official version of Fireboy and Watergirl by Oslo Albet is free to play in your browser at coolmathgames.com, with nothing to download. playable.sh links straight to it rather than hosting a copy.

Listed in Classic browser games, still free.