Highly doubt it ! There's not enough mercury in these to be an issue . Back when my dad was still in school , the teacher would pour a quarter sized puddle of mercury in one students hand during science class and they'd pass it fropm one to the other. My dad is now 87 and has no issues .
You might have an issue if you were to eat the remains tho ! 
The issue lies with chronic exposure. Handling mercury barehanded 5 times each year in the classroom is fine. What is less ideal, is when a student drops the mercury, it flies over the floor in hundreds of little balls, and finds a bunch of cracks and gaps to nestle into. Now the teacher is exposed to low levels of mercury vapor for the rest of his career...
This is actually a thing that happened. Old school, wooden floors. On replacing of the floors they found a lot of little balls of mercury between the cracks and under the floor.
For lamps, this just means 'clean up the phosphor and glass dust with a wet piece of paper'. There's not a lot of mercury in there, the mercury that is there will be sticking to the phosphor and glass.