XWiki Platform
  1. XWiki Platform
  2. XWIKI-10268

SOLR startup sychronization should use less requests

    Details

    • Type: Improvement Improvement
    • Status: Closed Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 5.4.4
    • Fix Version/s: 6.0, 5.4.5
    • Component/s: Search - Solr
    • Labels:
      None
    • Tests:
      Unit
    • Difficulty:
      Unknown
    • Documentation:
      N/A
    • Documentation in Release Notes:
      N/A
    • Similar issues:

      Description

      To test if a document from the SOLR index still exist in the database we use XWiki#exist on each one but it can be a lot of exist calls and so a lot of very short requests on very big farm.

        Issue Links

          Activity

          Hide
          Thomas Mortagne added a comment -

          Waiting for this before releasing 6.0 since myxwiki.org is not usable right now without this fixed.

          Show
          Thomas Mortagne added a comment - Waiting for this before releasing 6.0 since myxwiki.org is not usable right now without this fixed.
          Hide
          Marius Dumitru Florea added a comment -

          The solution I implemented was to iterate both the Solr index and the database at the same time. The key is that both have to be sorted in the same way. Since the database is the reference point, whenever the current entry from the Solr index doesn't match the current entry from the database we know what action (add or delete) to perform on the index based on the order between the two entries.

          Show
          Marius Dumitru Florea added a comment - The solution I implemented was to iterate both the Solr index and the database at the same time. The key is that both have to be sorted in the same way. Since the database is the reference point, whenever the current entry from the Solr index doesn't match the current entry from the database we know what action (add or delete) to perform on the index based on the order between the two entries.

            People

            • Assignee:
              Marius Dumitru Florea
              Reporter:
              Thomas Mortagne
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:
                Date of First Response: