When we migrate a thread, remove its timers from the cpu-local timer list,
and move them back when we complete migration.