<div dir="ltr">Thanks! We tried the recompute tasks and they work as we expected.</div><div class="gmail_extra"><br clear="all"><div><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><div><div dir="ltr"><b><span></span><span></span>Ing. Martín Marchese</b><br><img src="http://www.identicum.com/img/favicon.ico">Identicum S.A.<br>Jorge Newbery 3226<br>Tel: +54 (11) 4552-3050<br><a href="mailto:mmarchese@identicum.com" target="_blank">mmarchese@identicum.com</a><br><a href="http://www.identicum.com" target="_blank">www.identicum.com</a></div></div></div></div></div></div></div></div></div></div></div>
<br><div class="gmail_quote">On Mon, Aug 29, 2016 at 6:41 PM, Pavol Mederly <span dir="ltr"><<a href="mailto:mederly@evolveum.com" target="_blank">mederly@evolveum.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
<p>Hello Martin,</p>
<p>I have a feeling I've fixed boundless growth of operation result
for bulk actions (but I'm not quite sure). Please try with the
current master and let us know.</p>
<p>But I would say that bulk actions are too general mechanism to do
a simple recomputation. It would be better to use standard
"recompute" task, with an extension value of <b>mext:objectQuery</b>
used to limit the objects processed. See <a href="https://github.com/Evolveum/midpoint/blob/master/samples/tasks/task-user-recompute-selected-users-only.xml" target="_blank">https://github.com/Evolveum/<wbr>midpoint/blob/master/samples/<wbr>tasks/task-user-recompute-<wbr>selected-users-only.xml</a>.
Advantages over bulk actions are:</p>
<ol>
<li>For standard recompute task, the operation result growth has
been fixed (maybe already in 3.4).<br>
</li>
<li>Standard recompute task can be parallelized by setting <b>workerThreads</b>
value.</li>
<li>Bulk actions are still not resilient enough. There was no time
to implement flexible error treatment policies; so currently
these tasks stop at the first occurrence of an error. On the
other hand, standard recompute task proceeds even when errors
are encountered.</li>
</ol>
<p>Best regards,<br>
</p>
<pre cols="72">Pavol Mederly
Software developer
<a href="http://evolveum.com" target="_blank">evolveum.com</a>
</pre><div><div class="h5">
<div>On 29.08.2016 22:04, Martin Marchese
wrote:<br>
</div>
</div></div><blockquote type="cite"><div><div class="h5">
<div dir="ltr">Hi all,
<div><br>
</div>
<div>I have 10 bulk action tasks in order to recompute all users
based on a substring filter. Each task has the following
filter:</div>
<div><br>
</div>
<div>
<div><font size="1"><s:search></font></div>
<div><font size="1"><span style="white-space:pre-wrap"> </span><s:type>c:UserType</s:type></font></div>
<div><font size="1"><span style="white-space:pre-wrap"> </span><s:searchFilter></font></div>
<div><font size="1"><span style="white-space:pre-wrap"> </span><q:substring></font></div>
<div><font size="1"><span style="white-space:pre-wrap"> </span><q:matching>polyStringNorm</q:<wbr>matching></font></div>
<div><font size="1"><span style="white-space:pre-wrap"> </span><q:path>c:name</q:path></font></div>
<div><font size="1"><span style="white-space:pre-wrap"> </span><q:value>0</q:value></font></div>
<div><font size="1"><span style="white-space:pre-wrap"> </span><q:anchorEnd>true</q:<wbr>anchorEnd></font></div>
<div><font size="1"><span style="white-space:pre-wrap"> </span></q:substring></font></div>
<div><font size="1"><span style="white-space:pre-wrap"> </span></s:searchFilter></font></div>
<div><font size="1"><span style="white-space:pre-wrap"> </span><s:action></font></div>
</div>
<blockquote style="margin:0 0 0 40px;border:none;padding:0px">
<div>
<div><font size="1"><span style="white-space:pre-wrap"> </span><s:type>recompute</s:type></font></div>
</div>
</blockquote>
<div>
<div><font size="1"><span style="white-space:pre-wrap"> </span></s:action></font></div>
<div><font size="1"></s:search></font></div>
</div>
<div><br>
</div>
<div>With the value changing from 0 (within the first task) to 9
(on task # 10), so we can run then one at a time.<br>
Even though all of them are suspended, once I try to list
tasks thru the GUI, MidPoint stops responding and checking the
logs I saw an <b>Out Of Memory: Java Heap Size limit</b>
error.</div>
<div><br>
</div>
<div>The total users count is aprox. 400k.</div>
<div><br>
</div>
<div>Is this the best way to recompute all the users? Which will
be the best way to do this based on the large amount of users
we have?</div>
<div><br>
</div>
<div>Thanks in advance</div>
<div><br>
</div>
<div>
<div>
<div data-smartmail="gmail_signature">
<div dir="ltr">
<div>
<div dir="ltr">
<div>
<div dir="ltr">
<div>
<div dir="ltr">
<div>
<div dir="ltr"><b><span></span><span></span>Ing.
Martín Marchese</b><br>
<img src="http://www.identicum.com/img/favicon.ico">Identicum
S.A.<br>
Jorge Newbery 3226<br>
Tel: +54 (11) 4552-3050<br>
<a href="mailto:mmarchese@identicum.com" target="_blank">mmarchese@identicum.com</a><br>
<a href="http://www.identicum.com" target="_blank">www.identicum.com</a></div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<br>
<fieldset></fieldset>
<br>
</div></div><pre>______________________________<wbr>_________________
midPoint mailing list
<a href="mailto:midPoint@lists.evolveum.com" target="_blank">midPoint@lists.evolveum.com</a>
<a href="http://lists.evolveum.com/mailman/listinfo/midpoint" target="_blank">http://lists.evolveum.com/<wbr>mailman/listinfo/midpoint</a>
</pre>
</blockquote>
<br>
</div>
<br>______________________________<wbr>_________________<br>
midPoint mailing list<br>
<a href="mailto:midPoint@lists.evolveum.com">midPoint@lists.evolveum.com</a><br>
<a href="http://lists.evolveum.com/mailman/listinfo/midpoint" rel="noreferrer" target="_blank">http://lists.evolveum.com/<wbr>mailman/listinfo/midpoint</a><br>
<br></blockquote></div><br></div>