Can't snapshot-save for Jboss-Fuse app

xjia 2014-08-15 02:45:27 EDT

Description of problem:
Create a fuse app, and wait it starts. Make sure fuse management console can be visited. Then snapshot this app, will meet error and fuse app is "stopped"

Version-Release number of selected component (if applicable):
openshift-origin-cartridge-fuse-6.1.0.redhat.389-1.el6op.noarch.rpm

How reproducible:
always

Steps to Reproduce:
1.rhc app create fuse fuse -g xpaas
2.wait fuse's management console can be visited and login.
3.ssh <uuid>@<app-url> 'snapshot' > fuse.tar.gz

Actual results:
3.[root@ip-10-165-74-220 ~]# ssh 53eddcf8b096c4475700004e@fuse-test1.dev.rhcloud.com 'snapshot' > fuse.tar.gz
Creating and sending tar.gz
/bin/tar: ./53eddcf8b096c4475700004e/fuse/container/data/tmp/.paxweb6394013977168779394: File removed before we read it
/bin/tar: ./53eddcf8b096c4475700004e/fuse/container/data/tmp/fileinstall-8275555147917936441: File removed before we read it
/bin/tar: ./53eddcf8b096c4475700004e/fuse/container/data/tmp: file changed as we read it
/opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-node-1.29.3/lib/openshift-origin-node/utils/shell_exec.rb:133:in `block (2 levels) in oo_spawn': Shell command ' (OpenShift::Runtime::Utils::ShellExecutionException)
/bin/tar --ignore-failed-read -czf - --exclude=./$OPENSHIFT_GEAR_UUID/.tmp --exclude=./$OPENSHIFT_GEAR_UUID/.ssh --exclude=./$OPENSHIFT_GEAR_UUID/.sandbox --exclude=./$OPENSHIFT_GEAR_UUID//conf.d/openshift.conf --exclude=./$OPENSHIFT_GEAR_UUID//run/httpd.pid --exclude=./$OPENSHIFT_GEAR_UUID/haproxy*/run/stats --exclude=./$OPENSHIFT_GEAR_UUID/app-root/runtime/.state --exclude=./$OPENSHIFT_GEAR_UUID/app-root/runtime/.preupgrade_state --exclude=./$OPENSHIFT_GEAR_UUID/app-root/runtime/.upgrade_itinerary --exclude=./$OPENSHIFT_GEAR_UUID/app-root/runtime/.upgrade_complete* --exclude=./$OPENSHIFT_GEAR_UUID/app-root/runtime/repo --exclude=./$OPENSHIFT_GEAR_UUID/app-root/runtime/dependencies --exclude=./$OPENSHIFT_GEAR_UUID/app-root/runtime/build-dependencies --exclude=./$OPENSHIFT_DATA_DIR/.bash_history ./$OPENSHIFT_GEAR_UUID
' returned an error. rc=1
from /opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-node-1.29.3/lib/openshift-origin-node/utils/shell_exec.rb:96:in `pipe'
from /opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-node-1.29.3/lib/openshift-origin-node/utils/shell_exec.rb:96:in `block in oo_spawn'
from /opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-node-1.29.3/lib/openshift-origin-node/utils/shell_exec.rb:95:in `pipe'
from /opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-node-1.29.3/lib/openshift-origin-node/utils/shell_exec.rb:95:in `oo_spawn'
from /opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-container-selinux-0.10.1/lib/openshift/runtime/containerization/selinux_container.rb:368:in `run_in_container_context'
from /opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-node-1.29.3/lib/openshift-origin-node/model/application_container.rb:795:in `run_in_container_context'
from /opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-node-1.29.3/lib/openshift-origin-node/model/application_container_ext/snapshots.rb:31:in `write_snapshot_archive'
from /opt/rh/ruby193/root/usr/share/gems/gems/openshift-origin-node-1.29.3/lib/openshift-origin-node/model/application_container_ext/snapshots.rb:83:in `snapshot'
from /usr/bin/gear:573:in `block (2 levels) in <main>'
from /opt/rh/ruby193/root/usr/share/gems/gems/commander-4.0.3/lib/commander/command.rb:180:in `call'
from /opt/rh/ruby193/root/usr/share/gems/gems/commander-4.0.3/lib/commander/command.rb:180:in `call'
from /opt/rh/ruby193/root/usr/share/gems/gems/commander-4.0.3/lib/commander/command.rb:155:in `run'
from /opt/rh/ruby193/root/usr/share/gems/gems/commander-4.0.3/lib/commander/runner.rb:385:in `run_active_command'
from /opt/rh/ruby193/root/usr/share/gems/gems/commander-4.0.3/lib/commander/runner.rb:62:in `run!'
from /opt/rh/ruby193/root/usr/share/gems/gems/commander-4.0.3/lib/commander/delegates.rb:11:in `run!'
from /opt/rh/ruby193/root/usr/share/gems/gems/commander-4.0.3/lib/commander/import.rb:10:in `block in <top (required)>'

Expected results:
No error.and fuse app is running.

Additional info:
If stop fuse app , then execute 'snapshot' for fuse app, it works.
Form the debugging message, files in ./fuse/container/data/tmp directory is changing. If this tmp directory is under /tmp directory, snapshot will ignore the changes. That's my point of view.

Ben Parees 2014-08-21 10:32:30 EDT

for a sample pre/post snapshot/restore implementation in a control script, see:

https://github.com/openshift/origin-server/blob/master/cartridges/openshift-origin-cartridge-postgresql/bin/control#L271

Anne-Louise Tangring 2014-08-28 09:03:32 EDT

We should fix this if it's an easy or quick fix. Prio set correctly.