Uploaded image for project: 'XWiki Commons'
  1. XWiki Commons
  2. XCOMMONS-3835

Get the size and last modification date of listed blobs without one request per blob

    XMLWordPrintable

Details

    • Improvement
    • Resolution: Unresolved
    • Major
    • None
    • 17.10.0
    • Store
    • None
    • Unknown

    Description

      BlobStore#listDescendants with S3 receives the size and date of each object from ListObjectsV2 but drops them, so getSize() on a listed blob sends a HeadObject request. Summing the sizes of 100 listed blobs costs 101 requests.

      Proposal: the S3 iterator passes size() and lastModified() to the S3Blob it creates, which keeps them as a snapshot; the file system walks with BasicFileAttributes. The listDescendants javadoc would say that the size and date of the returned blobs may be the ones seen during the listing. Depends on the last modification date being part of the API.

      Attachments

        Issue Links

          Activity

            People

              ciaens Clément Christiaens
              ciaens Clément Christiaens
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated: