Uploaded image for project: 'Infinispan'
  1. Infinispan
  2. ISPN-7122

JpaStore Performance is Poor

    XMLWordPrintable

Details

    • Bug
    • Resolution: Obsolete
    • Major
    • None
    • 8.2.4.Final
    • Loaders and Stores
    • None
    • Hide

      Use a JpaStore on an entity with a large dataset.

      Show
      Use a JpaStore on an entity with a large dataset.

    Description

      When using the JpaStore it load's IDs, then iterates around the result and manually getting the record. This means for large datasets the performance is really poor. There is a comment in the code regarding this, but in it's current state it effectively makes it unusable.

      As an example with a dataset of 12,600 records using a a generic but customised JPA:

      • Bulk load: 977ms,
      • JpaStore: 137,906ms

      Increase: 14,015%

      Obviously paralleling the call or another DB might be quicker, but not much!

      Would it possible to have some level of chunking/batching of the load? IMO this would be a suitable compromise.

      I'm afraid I can't share the code for my loader, but it is loading a simple entity with no referenced objects, no so no joins.

      Attachments

        Activity

          People

            remerson@redhat.com Ryan Emerson
            dansiviter Daniel Siviter (Inactive)
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: