Saxon

Hello,

I have a big XML file and I tried to split it with a xsl 3.0 including streaming in smaller files to process.

Here is my Java Code:

 StreamingTransformerFactory streamingTransformerFactory =
        XmlTransformerHelper.createStreamingTransformerFactory();

 Templates streamingTemplates =
          XmlTransformerHelper.createTemplate(
              streamingTransformerFactory,
              getClass()
                  .getClassLoader()
                  .getResourceAsStream(RESOURCE_URL_XSL_SPLIT_BIG_ONIX_STREAM));

 okFile = new File(targetDirectory.toString(), "dummy.xml");

 streamingTemplates
          .newTransformer()
          .transform(new StreamSource(bookStream), new StreamResult(okFile));

Here is my XSL:

<xsl:stylesheet version="3.0" xmlns:xsl="http://www.w3.org/1999/XSL/Transform"
                exclude-result-prefixes="#all"
                xmlns:s="http://www.book.org/book/3.0/short"
                xmlns:saxon="http://saxon.sf.net/"
>
    <xsl:mode streamable="yes" on-no-match="shallow-copy" use-accumulators="#all"/>

    <xsl:output indent="yes"/>

    <xsl:accumulator name="header" as="element()?" initial-value="()" streamable="yes">
        <xsl:accumulator-rule match="s:header" phase="end" saxon:capture="yes" select="."/>
    </xsl:accumulator>

    <xsl:template match="s:Entry">
        <xsl:result-document href="{position()}.xml" method="xml">
            <xsl:element name="{name(ancestor::*[last()])}" namespace="{namespace-uri(ancestor::*[last()])}">
                <xsl:copy-of select="accumulator-before('header')"/>
                <xsl:copy-of select="."/>
            </xsl:element>
        </xsl:result-document>
    </xsl:template>

</xsl:stylesheet>

It works fine for small XML files like 200 MB but for a 2 GB XML file I got a OutOfMemoryError (refering to the attachment ).

I startet my Spring Boot Application with this VM arguments "-Xms1G -Xmx3G".

My expectation would have been that with streaming a poor memory processing would have came up.

Is it a wrong assumption or did I do something wrong?