Skip to content
Success

Changes

Summary

  1. ZIP: Streaming option to defer tree walking. (details)
  2. Added a search client implementation with a Collection interface (details)
  3. Refactored rootObjects to be an iterable (details)
  4. Removed unneccessary expansions of all root objects (details)
  5. Fixed NPE when AggregationTree is used for non-aggregations (details)
  6. ZIP: Added 'filter' argument to search export (details)
Commit f5cf802544df05c63d51020b48156a107688c6d8 by Thorsten Vitt
ZIP: Streaming option to defer tree walking.

By default, the ZIP export collects the metadata of all objects it
intends to export before actually starting to output something. This is
sensible when there is a link structure between the various objects that
needs to be rewritten, since we need to know an object's metadata in
order to calculate its filename.  The disadvantage of this method is
that for large sets of data, it may take quite a while until we deliver
our first bytes, which may cause the client or some intermediate proxy
to timeout before we start delivering.

This commit introduces the '&stream=true' parameter to the ZIP export.
When given, it causes exporting to start live while we walk the
aggregation tree: Non-aggregation objects are written as soon as they
are encountered, aggregation representations as soon as all their
aggregated items have been written. This can reduce the delay
drastically. However, the link rewriting table used for each object
includes only those items that have already been seen, thus some
textgrid: links might remain unresolved in the exported files.
The file was modifiedsrc/main/java/info/textgrid/services/aggregator/AbstractExporter.java (diff)
The file was modifiedsrc/main/java/info/textgrid/services/aggregator/zip/ZipResult.java (diff)
The file was modifiedsrc/main/java/info/textgrid/services/aggregator/REST.java (diff)
The file was modifiedsrc/main/java/info/textgrid/services/aggregator/tree/AggregationTreeFactory.java (diff)
Commit bca5be73e9bd436e278fcb2256b01a27864cfcad by Thorsten Vitt
Added a search client implementation with a Collection interface
The file was addedsrc/test/java/info/textgrid/services/aggregator/SearchResultListTest.java (diff)
The file was addedsrc/main/java/info/textgrid/services/aggregator/SearchResultList.java (diff)
Commit 258a80777010f3cf4d95cac9e567af4f39e06dc7 by Thorsten Vitt
Refactored rootObjects to be an iterable
The file was modifiedsrc/main/java/info/textgrid/services/aggregator/AbstractExporter.java (diff)
The file was modifiedsrc/main/java/info/textgrid/services/aggregator/teicorpus/TEICorpusSerializer.java (diff)
The file was modifiedsrc/main/java/info/textgrid/services/aggregator/html/HTMLWriter.java (diff)
The file was modifiedsrc/main/java/info/textgrid/services/aggregator/zip/ZipResult.java (diff)
Commit 078e4c83b53cd29670602a26b350170b9a8b1a4b by Thorsten Vitt
Removed unneccessary expansions of all root objects
The file was modifiedsrc/main/java/info/textgrid/services/aggregator/AbstractExporter.java (diff)
The file was modifiedsrc/main/java/info/textgrid/services/aggregator/zip/ZipResult.java (diff)
Commit 990dc26208c9f8daf97b4b20a6e2b1e88344375b by Thorsten Vitt
Fixed NPE when AggregationTree is used for non-aggregations
The file was modifiedsrc/main/java/info/textgrid/services/aggregator/tree/AggregationTreeFactory.java (diff)
The file was modifiedpom.xml (diff)
Commit 53dfb04a9bd8ee3dd071f3aff7cfe0317e527da1 by Thorsten Vitt
ZIP: Added 'filter' argument to search export
The file was modifiedsrc/main/java/info/textgrid/services/aggregator/SearchResultList.java (diff)
The file was modified.classpath (diff)
The file was modifiedpom.xml (diff)
The file was modifiedsrc/main/java/info/textgrid/services/aggregator/AbstractExporter.java (diff)
The file was modifiedsrc/test/java/info/textgrid/services/aggregator/SearchResultListTest.java (diff)
The file was modifiedsrc/main/java/info/textgrid/services/aggregator/REST.java (diff)