Saxon » SaxonC

As Martin corrected stated in comment #1 you should reuse the PySaxonProcessor object.

1. As a first experiment I ran your code as it is and the memory usage was around 2GB.
2. I then moved the proc variable of the PySaxonProcessor object outside of the function the memory usage went down to 800MB.

See my modified code below:

import os, psutil
from saxoncee import *

print(psutil.Process(os.getpid()).memory_info().rss / 1024 ** 2)
proc = PySaxonProcessor()
xslt_processi = proc.new_xslt30_processor()

def xslt_process(xslt_process, xsl_file_path, dom):
        # xslt_process = proc.new_xslt30_processor()
        document = proc.parse_xml(xml_text=dom)  # Load the XML document
        stylesheet = xslt_process.compile_stylesheet(stylesheet_file=xsl_file_path)  # Compile the XSLT stylesheet
        # Apply the transformation
        input_xslt = stylesheet.transform_to_string(xdm_node=document)

        # cleaning string which we got from XSLT
        input_xslt = ''.join(input_xslt.split("\n")).replace("</output1>", '')
        input_xslt = input_xslt.replace("<output1>", '').strip()
        input_xslt = input_xslt.replace('<?xml version="1.0" encoding="UTF-8"?>', '').strip()
        input_xslt = [x.strip() for x in input_xslt.split(",")]
        print(input_xslt)


xsl_str = '''<xsl:stylesheet xmlns:xsl='http://www.w3.org/1999/XSL/Transform' version='3.0'> <xsl:param name='values' select='(2,3,4)' /><xsl:output method='xml'
indent='yes' /><xsl:template match='*'><output><xsl:value-of select='//person[1]'/><xsl:for-each select='$values' ><out><xsl:value-of select='. *
3'/></out></xsl:for-each></output></xsl:template></xsl:stylesheet>'''
with open('test.xsl', "w") as xsl_file:
            xsl_file.write(xsl_str.strip())

dom = "<doc><item>text1</item><item>text2</item><item>text3</item></doc>"
file = "test.xsl"

for i in range(10000):
    print(psutil.Process(os.getpid()).memory_info().rss / 1024 ** 2)
    xslt_process(xslt_processi, file, dom)
    print(psutil.Process(os.getpid()).memory_info().rss / 1024 ** 2)
print(psutil.Process(os.getpid()).memory_info().rss / 1024 ** 2)

Still investigating why the memory is not going down.

just to confirm the problem is the Java object for the XsltExecutable is not been released when it is finished with therefore it cannot be garbage collected. I have applied a patch in the C++ code: Specifically the destructor of the XsltExecutable.

I ran the example code above (from comment #4) and we are now using 60MB at the end of the python script.

I will do some more experiments before I mark this bug issue as resolved

Bug fixed and available for the next maintenance release.

Fix applied in SaxonC 12.4.2 maintenance release