Thanks for the answers. Apparently, all of my other fluorescent lights make that too.
But now, I came across another interference thing. I recently installed some speakers to my room, and they run on AC power. Basically ALL of my fluorescent lights, INCLUDING the ceiling light, cause interference to the speakers and it can be heard as loud pops. Can that be reduced somehow? Also, once my fridge turns on, a small pop can be heard too.