Gatherering Efficiency in Harvest

• SOIF: Summary Object Interchange Format
  • Preserves structure in indexing data
  • Supports arbitrary binary or textual data
  • Streaming format to describe many resources
• Gatherer targets specific information -- doesn't roam wildly
• Gatherer and Broker communicate efficently:
  • Incremental session-oriented transfers of indexing data
  • Reduces network and CPU bottlenecks on servers