We could really do with a service within AS that automatically generates
local/remote thread dumps under certain circumstances:

• When a JBC TimeoutException is received or a sync cluster wide RPC
  sync call times out. request the node that didn't respond to dump a thread
  dump. It could happen that the node wouldn't respond to such request either.

• Maybe if a deadlock was detected locally? Not sure how a service could
  be notified of such deadlock, maybe it'd require to poll find deadlocks periodically.

Remote thread dumps would have to over JMX or similar but local thread
dumps could either be done via JMX or natively. Some work was done trying
to to automate generation of thread dumps if servers fail to stop during testsuite:
JBASM-3