large source file

Added by Anonymous over 18 years ago

Legacy ID: #3870576 Legacy Poster: Rick Schochler (rschochler3)

I am dealing with some rather large source files (87,477 KB, for example). As a result I'm receiving java memory errors. I need to run the entire doc through saxon for a couple of purposes: 1) to generate a toc 2) to chunk up the doc at a specified (chapter) level My initial thought is to use sax instead of DOM...but, I thought I'd toss the situation out to the group to see if anyone had a better idea. Thanks in advance, Rick

Replies (1)

RE: large source file - Added by Anonymous over 18 years ago

Legacy ID: #3870640 Legacy Poster: Michael Kay (mhkay)

87Mb should be quite feasible to process. How much memory did you allocate? I would tackle it with 512Mb. That's -Xmx512m on the Java command line in case you're not familiar with it. If allocating enough memory doesn't help, consider tackling it using the "serial processing" option (http://www.saxonica.com/documentation/sourcedocs/serial.html), if necessary doing a two-phase transformation one just to reduce the size (or split into smaller files) and the other to do the real work.

(1-1/1)

Please register to reply

Project

Profile

Help

Saxon