Project

Profile

Help

Forums » Help »

saxon memory limits

Added by Anonymous over 14 years ago

Legacy ID: #7576345 Legacy Poster: jtal (jtal)

At what point (XML filesize) is it recommended not to use saxon for querying? My files are 1-10GB. I used the smallest file to try out sax and got this exception: Exception in thread "main" java.lang.OutOfMemoryError: Java heap space at net.sf.saxon.tinytree.TinyTree.ensureNodeCapacity(TinyTree.java:232) at net.sf.saxon.tinytree.TinyTree.addNode(TinyTree.java:343) at net.sf.saxon.tinytree.TinyBuilder.characters(TinyBuilder.java:316) ...


Replies (1)

RE: saxon memory limits - Added by Anonymous over 14 years ago

Legacy ID: #7576360 Legacy Poster: Michael Kay (mhkay)

Unless you use Saxon's streaming capabilities, you need to allocate typically 5 times as much memory as the source document size. So for a 1Gb document, you should allocate 5Gb of memory to the Java VM. For information about streaming capabilities, see http://www.saxonica.com/documentation9.2/sourcedocs/serial.html The immediately following section, on document projection, might also be relevant to you. Note also that the optimizations performed by Saxon-EE become increasingly valuable as the source document size increases.

    (1-1/1)

    Please register to reply