• Icon: Bug Bug
    • Resolution: Obsolete
    • Icon: Major Major
    • None
    • None
    • Clustering
    • None

      Hi,

      Recently my system has been in the QA. (includes Stress test, Endurance test)
      During the endurance test, I found that the heap space was getting exausted, and not removed after full gc.
      When the heap space got close to 90%, the gabage collection was happend every 2 min, and my system was stopped reponding.
      The heap space was not cleaned up, nevertheless I ended the test (no request during a few hours)

      I downloaded some heap dumps, and found that the SharedLocalYieldingLockManage.LocalLock() resided much of heap space. (above 60%)
      I think the session expiration doesn't operate porperly.

      If the SessionBasesClusteredSession class raises the expiration signals with "LocalOnly=True", the lock would not be removed.

      Addionally, I reviewed our source code and did a leakage discory test, anything was matter.

      Here is my environment. If you want to see my standalone.xml, please post a reply thread.

      <Cluster>

      • 8 JVM (4 machine, each 2)
      • JDK : 1.6u31
      • OS : Amazon Linux 64bit
      • JGroups : FILE_PING (The shared storage is GlusterFS volume)
      • Infinispan operation mode : L1 + Distribution / ASYNC / expiration 1min
      • Session handling : web.xml (expiration every 1min)
        (Originally our setting was 30 min. Beacuse the load generator was sending too many requests with new session, I lowered the threshold to 1min)
      • Source code : 7.1.3 Final tag (downloaded from Github)

            [WFLY-898] SharedLocalYieldingLockManager.LocalLock

            mark yarborough <myarboro@redhat.com> changed the Status of bug 1039585 from VERIFIED to CLOSED

            RH Bugzilla Integration added a comment - mark yarborough <myarboro@redhat.com> changed the Status of bug 1039585 from VERIFIED to CLOSED

            Richard Janík <rjanik@redhat.com> changed the Status of bug 1039585 from ON_QA to VERIFIED

            RH Bugzilla Integration added a comment - Richard Janík <rjanik@redhat.com> changed the Status of bug 1039585 from ON_QA to VERIFIED

            Paul Gier <pgier@redhat.com> changed the Status of bug 1039585 from MODIFIED to ON_QA

            RH Bugzilla Integration added a comment - Paul Gier <pgier@redhat.com> changed the Status of bug 1039585 from MODIFIED to ON_QA

            Kabir Khan <kkhan@redhat.com> changed the Status of bug 1039585 from POST to MODIFIED

            RH Bugzilla Integration added a comment - Kabir Khan <kkhan@redhat.com> changed the Status of bug 1039585 from POST to MODIFIED

            Paul Ferraro <paul.ferraro@redhat.com> changed the Status of bug 1039585 from NEW to POST

            RH Bugzilla Integration added a comment - Paul Ferraro <paul.ferraro@redhat.com> changed the Status of bug 1039585 from NEW to POST

            Made obsolete by WFLY-406.
            Web session clustering no longer uses this.

            Paul Ferraro added a comment - Made obsolete by WFLY-406 . Web session clustering no longer uses this.

              pferraro@redhat.com Paul Ferraro
              mjhero_jira MJ Kim (Inactive)
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

                Created:
                Updated:
                Resolved: