Getting Things Done - A Health Warning

So I'm Getting Things Done, read the book, putting it all into practise.
It's had a remarkable effect on me.
Took my tax to the accountant after months (and months).
Things that should have been sorted out months (and years) ago, have mostly been sorted out.
Both my work and home email inboxes are empty.
My home office is almost completely tidy.
And my desk at work is empty.

Just one problem.  People see me at work as more relaxed and with an empty desk and think I'm doing nothing.  Plus, they think, Aha, give him more work to do, because he clearly can't be doing enough.
So be warned.  Getting Things Done is excellent for you in the short term and long term, but may seriously damage you short term work career!!