I have similar guilt, associated with almost anything other than the task in hand. It affects most things for me -- socialising, doing art, writing music, watching movies, reading, you name it really.

I don't feel like a workaholic -- I think its more an avoidance of non-work that is at the root of the problem.