Uploaded image for project: 'Infinispan'
  1. Infinispan
  2. ISPN-7922

OffHeap stream causes too many entries in memory at once

This issue belongs to an archived project. You can view it, but you can't modify it. Learn more

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Major Major
    • 9.1.0.Final, 9.0.3.Final
    • 9.0.1.Final
    • Core
    • None

      Using flatMap for some reason causes the stream operation to keep entries in memory for all entries that map to a given lock. We should have these processed by address counter instead.

            [ISPN-7922] OffHeap stream causes too many entries in memory at once

            Will Burns added a comment -

            dberinde@redhat.com https://github.com/infinispan/infinispan/blob/master/core/src/main/java/org/infinispan/configuration/cache/MemoryConfigurationBuilder.java#L75

            Will Burns added a comment - dberinde@redhat.com https://github.com/infinispan/infinispan/blob/master/core/src/main/java/org/infinispan/configuration/cache/MemoryConfigurationBuilder.java#L75

            Dan Berindei (Inactive) added a comment -

            wburns@redhat.com what exactly is the address counter? I couldn't find any reference to it in the code

            Dan Berindei (Inactive) added a comment - wburns@redhat.com what exactly is the address counter? I couldn't find any reference to it in the code

            Will Burns added a comment - - edited

            This is the exact bug issue I am running into, where the stream returned in flatMap has to be completely exhausted before sending a single entry down stream https://stackoverflow.com/a/29986041/4222962

            Will Burns added a comment - - edited This is the exact bug issue I am running into, where the stream returned in flatMap has to be completely exhausted before sending a single entry down stream https://stackoverflow.com/a/29986041/4222962

            Will Burns added a comment - - edited

            Looking closer there are some other major bugs issues with flatMap https://stackoverflow.com/questions/29229373/why-filter-after-flatmap-is-not-completely-lazy-in-java-streams

            Will Burns added a comment - - edited Looking closer there are some other major bugs issues with flatMap https://stackoverflow.com/questions/29229373/why-filter-after-flatmap-is-not-completely-lazy-in-java-streams

              wburns@redhat.com Will Burns
              wburns@redhat.com Will Burns
              Archiver:
              rhn-support-adongare Amol Dongare

                Created:
                Updated:
                Resolved:
                Archived: