Saxon » SaxonC

I have been using the same code for a year and a half on many XHTML files and it has never crashed.

The code is as follows:

from saxoncee import PySaxonProcessor
saxon = PySaxonProcessor(license=True)
saxon_source = saxon.parse_xml(xml_file_name="test.html")

Effectively the error appears after 3 or 4 files pass the checks without problems. Then I have to change IP to make the system keep working. So it seems that the W3C server is blocking the requests.

I think caching copies of the documents is a good solution.

In the meantime can you recommend a hotfix to unblock the work?

Does this also work in Python?

Gregorio Pellegrino wrote in #note-9:

Effectively the error appears after 3 or 4 files pass the checks without problems. Then I have to change IP to make the system keep working. So it seems that the W3C server is blocking the requests.

I think caching copies of the documents is a good solution.

In the meantime can you recommend a hotfix to unblock the work?

If you can't edit the XHTML files to remove the DOCTYPE referencing the W3C DTDs but don't need them anyway (this means your XHTML doesn't use any character references, for instance, declared in the DTD), with Python you can configure Saxon to tell the Apache parser to not load external DTDs with e.g.

saxon.set_configuration_property('http://saxon.sf.net/feature/parserFeature?uri=http%3A//apache.org/xml/features/nonvalidating/load-external-dtd', 'false')

Take that only as a workaround, obviously, and it will only work if no DTD declared entity/character references are used (which, however, is common these days where most people just use UTF-8 anyway to write all characters instead of needing e.g. ä to escape them.

Gregorio Pellegrino wrote in #note-11:

Does this also work in Python?

I have tested that doing e.g.

from saxonche import *

with PySaxonProcessor() as saxon_proc:
    print(saxon_proc.version)

    saxon_proc.set_catalog(r'org/xmlresolver/catalog.xml')
    
    for i in range(0, 100):
        xdm_doc = saxon_proc.parse_xml(xml_file_name='test1.xhtml')
        print(xdm_doc.node_kind)

works fine (assuming I unjared that xmlresolver data jar in the current working dir and that way that then contains e.g. a subfolder org with a subfolder xmlresolver with that catalog.xml).

Martin Honnen wrote in #note-13:

Gregorio Pellegrino wrote in #note-11:

Does this also work in Python?

I have tested that doing e.g.

from saxonche import *

with PySaxonProcessor() as saxon_proc:
    print(saxon_proc.version)

    saxon_proc.set_catalog(r'org/xmlresolver/catalog.xml')
    
    for i in range(0, 100):
        xdm_doc = saxon_proc.parse_xml(xml_file_name='test1.xhtml')
        print(xdm_doc.node_kind)

works fine (assuming I unjared that xmlresolver data jar in the current working dir and that way that then contains e.g. a subfolder org with a subfolder xmlresolver with that catalog.xml).

That's the way it works, thank you. The problem is that now I get the error

saxoncee.PySaxonApiError: Source document not found. Line number: -1

When I try to validate the doc:

validator.validate(xdm_node= xdm_doc)

Can it be related to the catalog I entered?

Please can you supply the complete python script with the validator where it fails. Thanks

Copied across from another bug issue:

saxon = PySaxonProcessor(license=True)
saxon_source = saxon.parse_xml(xml_file_name="test.html")

saxon.set_configuration_property("http://saxon.sf.net/feature/licenseFileLocation", "saxon-license.lic")
saxon.set_configuration_property("xsdversion", "1.1")
saxon.set_catalog("org/xmlresolver/catalog.xml"))

validator = saxon.new_schema_validator()
validator.set_property("report-node", "true")
validator.set_property("verbose", "false")
validator.register_schema(xsd_file="my_schema.xsd")
validator.validate(xdm_node=saxon_source)

Please can you send me your file my_schema.xsd

I cannot share it publically, may I send it privately via email?

The user sent the xsd file via email and I was able to reproduce the error. Investigating the issue now.

The keyword xdm_node seems broken. As a workaround you can pass the file directly in the validator. See the following example which works for me:

validator.validate(file_name="test.html")

I have moved the issue relating to the PySchemaValidator "not finding the source as XdmNode" to a new bug issue #6469.