<html>
  <head>
    <meta content="text/html; charset=utf-8" http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    <p>Hello Martin,</p>
    <p>I have a feeling I've fixed boundless growth of operation result
      for bulk actions (but I'm not quite sure). Please try with the
      current master and let us know.</p>
    <p>But I would say that bulk actions are too general mechanism to do
      a simple recomputation. It would be better to use standard
      "recompute" task, with an extension value of <b>mext:objectQuery</b>
      used to limit the objects processed. See <a
href="https://github.com/Evolveum/midpoint/blob/master/samples/tasks/task-user-recompute-selected-users-only.xml">https://github.com/Evolveum/midpoint/blob/master/samples/tasks/task-user-recompute-selected-users-only.xml</a>.
      Advantages over bulk actions are:</p>
    <ol>
      <li>For standard recompute task, the operation result growth has
        been fixed (maybe already in 3.4).<br>
      </li>
      <li>Standard recompute task can be parallelized by setting <b>workerThreads</b>
        value.</li>
      <li>Bulk actions are still not resilient enough. There was no time
        to implement flexible error treatment policies; so currently
        these tasks stop at the first occurrence of an error. On the
        other hand, standard recompute task proceeds even when errors
        are encountered.</li>
    </ol>
    <p>Best regards,<br>
    </p>
    <pre class="moz-signature" cols="72">Pavol Mederly
Software developer
evolveum.com
</pre>
    <div class="moz-cite-prefix">On 29.08.2016 22:04, Martin Marchese
      wrote:<br>
    </div>
    <blockquote
cite="mid:CAG3rmdro3Rajn1e5H=aK6qNv=CATJKx3iSV-CVcUsi5TcUa8UQ@mail.gmail.com"
      type="cite">
      <div dir="ltr">Hi all,
        <div><br>
        </div>
        <div>I have 10 bulk action tasks in order to recompute all users
          based on a substring filter. Each task has the following
          filter:</div>
        <div><br>
        </div>
        <div>
          <div><font size="1"><s:search></font></div>
          <div><font size="1"><span class="" style="white-space:pre">   </span><s:type>c:UserType</s:type></font></div>
          <div><font size="1"><span class="" style="white-space:pre">           </span><s:searchFilter></font></div>
          <div><font size="1"><span class="" style="white-space:pre">                   </span><q:substring></font></div>
          <div><font size="1"><span class="" style="white-space:pre">                           </span><q:matching>polyStringNorm</q:matching></font></div>
          <div><font size="1"><span class="" style="white-space:pre">                           </span><q:path>c:name</q:path></font></div>
          <div><font size="1"><span class="" style="white-space:pre">                           </span><q:value>0</q:value></font></div>
          <div><font size="1"><span class="" style="white-space:pre">                           </span><q:anchorEnd>true</q:anchorEnd></font></div>
          <div><font size="1"><span class="" style="white-space:pre">                   </span></q:substring></font></div>
          <div><font size="1"><span class="" style="white-space:pre">           </span></s:searchFilter></font></div>
          <div><font size="1"><span class="" style="white-space:pre">           </span><s:action></font></div>
        </div>
        <blockquote style="margin:0 0 0 40px;border:none;padding:0px">
          <div>
            <div><font size="1"><span class="" style="white-space:pre">         </span><s:type>recompute</s:type></font></div>
          </div>
        </blockquote>
        <div>
          <div><font size="1"><span class="" style="white-space:pre">           </span></s:action></font></div>
          <div><font size="1"></s:search></font></div>
        </div>
        <div><br>
        </div>
        <div>With the value changing from 0 (within the first task) to 9
          (on task # 10), so we can run then one at a time.<br>
          Even though all of them are suspended, once I try to list
          tasks thru the GUI, MidPoint stops responding and checking the
          logs I saw an <b>Out Of Memory: Java Heap Size limit</b>
          error.</div>
        <div><br>
        </div>
        <div>The total users count is aprox. 400k.</div>
        <div><br>
        </div>
        <div>Is this the best way to recompute all the users? Which will
          be the best way to do this based on the large amount of users
          we have?</div>
        <div><br>
        </div>
        <div>Thanks in advance</div>
        <div><br>
        </div>
        <div>
          <div>
            <div class="gmail_signature"
              data-smartmail="gmail_signature">
              <div dir="ltr">
                <div>
                  <div dir="ltr">
                    <div>
                      <div dir="ltr">
                        <div>
                          <div dir="ltr">
                            <div>
                              <div dir="ltr"><b><span></span><span></span>Ing.
                                  Martín Marchese</b><br>
                                <img moz-do-not-send="true"
                                  src="http://www.identicum.com/img/favicon.ico">Identicum
                                S.A.<br>
                                Jorge Newbery 3226<br>
                                Tel: +54 (11) 4552-3050<br>
                                <a moz-do-not-send="true"
                                  href="mailto:mmarchese@identicum.com"
                                  target="_blank">mmarchese@identicum.com</a><br>
                                <a moz-do-not-send="true"
                                  href="http://www.identicum.com"
                                  target="_blank">www.identicum.com</a></div>
                            </div>
                          </div>
                        </div>
                      </div>
                    </div>
                  </div>
                </div>
              </div>
            </div>
          </div>
        </div>
      </div>
      <br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <br>
      <pre wrap="">_______________________________________________
midPoint mailing list
<a class="moz-txt-link-abbreviated" href="mailto:midPoint@lists.evolveum.com">midPoint@lists.evolveum.com</a>
<a class="moz-txt-link-freetext" href="http://lists.evolveum.com/mailman/listinfo/midpoint">http://lists.evolveum.com/mailman/listinfo/midpoint</a>
</pre>
    </blockquote>
    <br>
  </body>
</html>