Project

Profile

Help

Support #3100 ยป Support #7884 - 2017-01-25T13_45_49Z.eml

Erik Wilde, 2017-01-25 14:45

 
Return-Path: <erik.wilde@dret.net>
Received: from mi005.mc1.hosteurope.de ([80.237.138.250]) by wp245.webpack.hosteurope.de running ExIM with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) id 1cWNtG-0005yE-M7; Wed, 25 Jan 2017 14:45:34 +0100
Received: from postoffice.gristmillmedia.com ([96.30.18.196]) by mx0.webpack.hosteurope.de (mi005.mc1.hosteurope.de) with esmtps (TLSv1.2:DHE-RSA-AES256-GCM-SHA384:256) id 1cWNtD-0002Tq-Vu for dropbox+saxonica+f38e+saxon@plan.io; Wed, 25 Jan 2017 14:45:34 +0100
Received: from [95.152.254.241] (port=26021 helo=dretpro.ca.com) by postoffice.gristmillmedia.com with esmtpsa (TLSv1.2:ECDHE-RSA-AES128-GCM-SHA256:128) (Exim 4.87) (envelope-from <erik.wilde@dret.net>) id 1cWNtB-0006pJ-FW for dropbox+saxonica+f38e+saxon@plan.io; Wed, 25 Jan 2017 08:45:29 -0500
Date: Wed, 25 Jan 2017 14:45:28 +0100
From: Erik Wilde <erik.wilde@dret.net>
To: Saxonica Developer Community <dropbox+saxonica+f38e+saxon@plan.io>
Message-ID: <e7b90279-c6b0-a860-f4e2-69c7b4d2cd5a@dret.net>
In-Reply-To: <redmine.journal-7875.20170124150422.5854328e90ce33e3@plan.io>
References: <redmine.issue-3100.20170110180534@plan.io>
<redmine.journal-7875.20170124150422.5854328e90ce33e3@plan.io>
Subject: Re: [Saxon - Support #3100] (Closed) Processing many files
Mime-Version: 1.0
Content-Type: text/plain;
charset=utf-8;
format=flowed
Content-Transfer-Encoding: 7bit
Delivery-date: Wed, 25 Jan 2017 14:45:34 +0100
DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=dret.net;
s=default; h=Content-Transfer-Encoding:Content-Type:In-Reply-To:MIME-Version
:Date:Message-ID:From:References:To:Subject:Sender:Reply-To:Cc:Content-ID:
Content-Description:Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc
:Resent-Message-ID:List-Id:List-Help:List-Unsubscribe:List-Subscribe:
List-Post:List-Owner:List-Archive;
bh=XXyfBtTOEQi3gcZjAHsrGkg+TzA5dE3NZJjtg0Je/Po=; b=oCv4+kBs9cmEgcwbjoHZFmBBXB
dwswPsdKfJ2b232vQbqmyRbqvrh2y0gAV6wERCwgHUBxzeOOvIMpN6QRJ782mhkCHHKTKwgR7iulH
kulC/S+73Cv0D0W7He9ycS5l+FHQ8cP/ZnKl+gfzll0C7tPPCQm+esq978M9kBOXX8UZgUiIduPDV
EgcykzbK1idm/h58Mcs/UyYKbT0n6y7FgyP6EiRJXu+KDlYN+zeqaZoSFE6DpeYQOQM/ZI4040394
CaknEfNVmjuu5pwduQyn7qcs+curxLYyaLDk6NiXVjMwL8Hb6XqKdFSXK2XsJOEEP+Y7resTlMO5e
1+8NQvSw==;
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.12; rv:45.0)
Gecko/20100101 Thunderbird/45.6.0
X-AntiAbuse: This header was added to track abuse, please include it with any
abuse report
X-AntiAbuse: Primary Hostname - postoffice.gristmillmedia.com
X-AntiAbuse: Original Domain - plan.io
X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12]
X-AntiAbuse: Sender Address Domain - dret.net
X-Get-Message-Sender-Via: postoffice.gristmillmedia.com: authenticated_id:
birdhouse@dret.net
X-Authenticated-Sender: postoffice.gristmillmedia.com: birdhouse@dret.net
X-Source:
X-Source-Args:
X-Source-Dir:
X-HE-Virus-Scanned: Yes
X-HE-Spam-Level: /
X-HE-Spam-Score: 0.1
X-HE-Spam-Report: Content analysis details: (0.1 points) pts rule name
description ---- ----------------------
-------------------------------------------------- 0.1 DKIM_SIGNED Message has
a DKIM or DK signature, not necessarily valid 0.0 T_DKIM_INVALID
DKIM-Signature header exists but is not valid
X-HE-SPF: PASSED
Envelope-to: dropbox+saxonica+f38e+saxon@plan.io

thanks for the suggestions! i have now used uri-collection() and then
open the files individually via doc(). that seems to work well, and i
was able to open and process all files without memory issues. thanks a
lot for the suggestion and the help! cheers, dret.

On 2017-01-24 16:04, Saxonica Developer Community wrote:
> --- In your reply, please do not write below this line ---
>
> Issue #3100 has been updated by Michael Kay.
>
> * *Status* changed from /New/ to /Closed/
>
> ------------------------------------------------------------------------
>
>
> Support #3100: Processing many files
> <https://saxonica.plan.io/issues/3100?pn=1#change-7875>
>
> * Author: Erik Wilde
> * Status: Closed
> * Priority: Normal
> * Assignee: Michael Kay
> * Category:
> * Sprint/Milestone:
> * Legacy ID:
> * Applies to branch:
> * Fix Committed on Branch:
> * Fixed in Maintenance Release:
> * Found in version:
>
> As mentioned in an email conversation, I am trying to process many files
> (~2000), all of them moderate in size (1-2MB), but it seems like I am no
> using discard-document correctly. I always get Java heap space errors,
> so I am assuming that I must be doing something wrong. My starting point
> was the code shown on
> http://www.saxonica.com/html/documentation/functions/saxon/discard-document.html,
> but maybe I am doing something wrong in the way how I use it.
>
> Files training.xsl
> <https://saxonica.plan.io/attachments/download/594/training.xsl> (696 Bytes)
>
> ------------------------------------------------------------------------
>
> You have received this notification because you have either subscribed
> to or are involved in a project on Saxonica Developer Community site.
> To change your notification preferences, please click here:
> https://saxonica.plan.io/my/account?tour=mail_preferences
>
>
>
> This notification was cheerfully delivered by <https://plan.io/>
>
> Planio <https://plan.io/>
>

--
erik wilde | mailto:erik.wilde@dret.net |
| http://dret.net/netdret |
| http://twitter.com/dret |

    (1-1/1)