Uploaded image for project: 'Hawkular Metrics'
  1. Hawkular Metrics
  2. HWKMETRICS-488

Compression reading needs better merge process

    XMLWordPrintable

    Details

    • Type: Bug
    • Status: Closed (View Workflow)
    • Priority: Major
    • Resolution: Done
    • Affects Version/s: 0.20.0
    • Fix Version/s: 0.21.0
    • Component/s: Core
    • Labels:
      None

      Description

      When reading compressed and uncompressed datapoints, we need a better merging process for those. If an out-of-order write happens after the compression has been done (1-3 hours later than the timestamp time), there's a scenario where datapoints could be returned in incorrect order (first the uncompressed, then the compressed).

      What we need is a RxJava mergeSort operator, that takes two sorted observables and merges them while keeping the sorted order. This needs to be unblocking and allow processing infinite-series (thus, it should only keep 1 datapoint from each observable in memory).

        Gliffy Diagrams

          Attachments

            Activity

              People

              • Assignee:
                burmanm Michael Burman
                Reporter:
                burmanm Michael Burman
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: