Description of problem:

Doc URL: https://access.redhat.com/site/documentation/en-US/Red_Hat_JBoss_BPM_Suite/6.0/html/Installation_Guide/sect-Installing_the_generic_deployable_package.html

Chapter "2.3.2.1. Setting up transaction manager for Red Hat JBoss Web Server 2.0 (Tomcat 7)"

Point 9. Define the btm.root system property and location where bitronix config file is placed:

[
In $TOMCAT_DIR/bin/, create the setenv.sh or setenv.bat file with the following content:

CATALINA_OPTS="-Xmx512M -XX:MaxPermSize=512m -Dbtm.root=$CATALINA_HOME -Dbitronix.tm.configuration=$CATALINA_HOME/conf/btm-config.properties"

......

On Microsoft Windows systems, replace the $CATALINA_HOME value in the content of the file with the equivalent environment variable name or use the absolute path.
]

Actually, on Windows, I need to have a setenv.bat like this to get it working:

set "CATALINA_OPTS=-Xmx512M -XX:MaxPermSize=512m -Dbtm.root=$CATALINA_HOME -Dbitronix.tm.configuration=$CATALINA_HOME/conf/btm-config.properties"

Note 2 points: 1) use "set" in front of CATALINA_OPTS; 2) the position of double quote ""

This is verified on Windows 7