|
Return-Path: <erik.wilde@dret.net>
|
|
Received: from mi005.mc1.hosteurope.de ([80.237.138.250]) by wp245.webpack.hosteurope.de running ExIM with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) id 1cWNtG-0005yE-M7; Wed, 25 Jan 2017 14:45:34 +0100
|
|
Received: from postoffice.gristmillmedia.com ([96.30.18.196]) by mx0.webpack.hosteurope.de (mi005.mc1.hosteurope.de) with esmtps (TLSv1.2:DHE-RSA-AES256-GCM-SHA384:256) id 1cWNtD-0002Tq-Vu for dropbox+saxonica+f38e+saxon@plan.io; Wed, 25 Jan 2017 14:45:34 +0100
|
|
Received: from [95.152.254.241] (port=26021 helo=dretpro.ca.com) by postoffice.gristmillmedia.com with esmtpsa (TLSv1.2:ECDHE-RSA-AES128-GCM-SHA256:128) (Exim 4.87) (envelope-from <erik.wilde@dret.net>) id 1cWNtB-0006pJ-FW for dropbox+saxonica+f38e+saxon@plan.io; Wed, 25 Jan 2017 08:45:29 -0500
|
|
Date: Wed, 25 Jan 2017 14:45:28 +0100
|
|
From: Erik Wilde <erik.wilde@dret.net>
|
|
To: Saxonica Developer Community <dropbox+saxonica+f38e+saxon@plan.io>
|
|
Message-ID: <e7b90279-c6b0-a860-f4e2-69c7b4d2cd5a@dret.net>
|
|
In-Reply-To: <redmine.journal-7875.20170124150422.5854328e90ce33e3@plan.io>
|
|
References: <redmine.issue-3100.20170110180534@plan.io>
|
|
<redmine.journal-7875.20170124150422.5854328e90ce33e3@plan.io>
|
|
Subject: Re: [Saxon - Support #3100] (Closed) Processing many files
|
|
Mime-Version: 1.0
|
|
Content-Type: text/plain;
|
|
charset=utf-8;
|
|
format=flowed
|
|
Content-Transfer-Encoding: 7bit
|
|
Delivery-date: Wed, 25 Jan 2017 14:45:34 +0100
|
|
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=dret.net;
|
|
s=default; h=Content-Transfer-Encoding:Content-Type:In-Reply-To:MIME-Version
|
|
:Date:Message-ID:From:References:To:Subject:Sender:Reply-To:Cc:Content-ID:
|
|
Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc
|
|
:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe:
|
|
List-Post:List-Owner:List-Archive;
|
|
bh=XXyfBtTOEQi3gcZjAHsrGkg+TzA5dE3NZJjtg0Je/Po=; b=oCv4+kBs9cmEgcwbjoHZFmBBXB
|
|
dwswPsdKfJ2b232vQbqmyRbqvrh2y0gAV6wERCwgHUBxzeOOvIMpN6QRJ782mhkCHHKTKwgR7iulH
|
|
kulC/S+73Cv0D0W7He9ycS5l+FHQ8cP/ZnKl+gfzll0C7tPPCQm+esq978M9kBOXX8UZgUiIduPDV
|
|
EgcykzbK1idm/h58Mcs/UyYKbT0n6y7FgyP6EiRJXu+KDlYN+zeqaZoSFE6DpeYQOQM/ZI4040394
|
|
CaknEfNVmjuu5pwduQyn7qcs+curxLYyaLDk6NiXVjMwL8Hb6XqKdFSXK2XsJOEEP+Y7resTlMO5e
|
|
1+8NQvSw==;
|
|
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:45.0)
|
|
Gecko/20100101 Thunderbird/45.6.0
|
|
X-AntiAbuse: This header was added to track abuse, please include it with any
|
|
abuse report
|
|
X-AntiAbuse: Primary Hostname - postoffice.gristmillmedia.com
|
|
X-AntiAbuse: Original Domain - plan.io
|
|
X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12]
|
|
X-AntiAbuse: Sender Address Domain - dret.net
|
|
X-Get-Message-Sender-Via: postoffice.gristmillmedia.com: authenticated_id:
|
|
birdhouse@dret.net
|
|
X-Authenticated-Sender: postoffice.gristmillmedia.com: birdhouse@dret.net
|
|
X-Source:
|
|
X-Source-Args:
|
|
X-Source-Dir:
|
|
X-HE-Virus-Scanned: Yes
|
|
X-HE-Spam-Level: /
|
|
X-HE-Spam-Score: 0.1
|
|
X-HE-Spam-Report: Content analysis details: (0.1 points) pts rule name
|
|
description ---- ----------------------
|
|
-------------------------------------------------- 0.1 DKIM_SIGNED Message has
|
|
a DKIM or DK signature, not necessarily valid 0.0 T_DKIM_INVALID
|
|
DKIM-Signature header exists but is not valid
|
|
X-HE-SPF: PASSED
|
|
Envelope-to: dropbox+saxonica+f38e+saxon@plan.io
|
|
|
|
thanks for the suggestions! i have now used uri-collection() and then
|
|
open the files individually via doc(). that seems to work well, and i
|
|
was able to open and process all files without memory issues. thanks a
|
|
lot for the suggestion and the help! cheers, dret.
|
|
|
|
On 2017-01-24 16:04, Saxonica Developer Community wrote:
|
|
> --- In your reply, please do not write below this line ---
|
|
>
|
|
> Issue #3100 has been updated by Michael Kay.
|
|
>
|
|
> * *Status* changed from /New/ to /Closed/
|
|
>
|
|
> ------------------------------------------------------------------------
|
|
>
|
|
>
|
|
> Support #3100: Processing many files
|
|
> <https://saxonica.plan.io/issues/3100?pn=1#change-7875>
|
|
>
|
|
> * Author: Erik Wilde
|
|
> * Status: Closed
|
|
> * Priority: Normal
|
|
> * Assignee: Michael Kay
|
|
> * Category:
|
|
> * Sprint/Milestone:
|
|
> * Legacy ID:
|
|
> * Applies to branch:
|
|
> * Fix Committed on Branch:
|
|
> * Fixed in Maintenance Release:
|
|
> * Found in version:
|
|
>
|
|
> As mentioned in an email conversation, I am trying to process many files
|
|
> (~2000), all of them moderate in size (1-2MB), but it seems like I am no
|
|
> using discard-document correctly. I always get Java heap space errors,
|
|
> so I am assuming that I must be doing something wrong. My starting point
|
|
> was the code shown on
|
|
> http://www.saxonica.com/html/documentation/functions/saxon/discard-document.html,
|
|
> but maybe I am doing something wrong in the way how I use it.
|
|
>
|
|
> Files training.xsl
|
|
> <https://saxonica.plan.io/attachments/download/594/training.xsl> (696 Bytes)
|
|
>
|
|
> ------------------------------------------------------------------------
|
|
>
|
|
> You have received this notification because you have either subscribed
|
|
> to or are involved in a project on Saxonica Developer Community site.
|
|
> To change your notification preferences, please click here:
|
|
> https://saxonica.plan.io/my/account?tour=mail_preferences
|
|
>
|
|
>
|
|
>
|
|
> This notification was cheerfully delivered by <https://plan.io/>
|
|
>
|
|
> Planio <https://plan.io/>
|
|
>
|
|
|
|
--
|
|
erik wilde | mailto:erik.wilde@dret.net |
|
|
| http://dret.net/netdret |
|
|
| http://twitter.com/dret |
|
|
|