<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body>
<p>Hello Anton,</p>
<p>for "stateful" task suspension and resume you need to use
buckets. It is still a kind of experimental functionality, but
basically it should work.<br>
</p>
<p>See e.g. here <a moz-do-not-send="true"
href="https://wiki.evolveum.com/display/midPoint/Multi-node%2C+partitioned+and+stateful+tasks">https://wiki.evolveum.com/display/midPoint/Multi-node%2C+partitioned+and+stateful+tasks</a></p>
<p>However, 65000 entries is not so much. If you say 20 hours, this
is approximately 900 milliseconds per account. This might or might
not be adequate, depending on the runtime complexity of your
configuration.</p>
<p>As Oskar has said, paralellizing (i.e. using worker threads)
should help here. Using multiple nodes can help further.</p>
<p>But I would suggest looking at internal performance numbers as a
hint where performance can be improved. Are mappings slow? Is
repository slow? Is there anything else that slows down the
execution, e.g. notifications? Could more aggresive caching or
some experimental optimization options help?</p>
<p>The optimization matters are a little bit complex, so maybe our
professional services would be most beneficial to you. It depends.</p>
<p>Best regards,<br>
</p>
<pre class="moz-signature" cols="72">Pavol Mederly
Software developer
evolveum.com
</pre>
<div class="moz-cite-prefix">On 25/03/2020 08:55, Oskar Butovič -
AMI Praha a.s. wrote:<br>
</div>
<blockquote type="cite"
cite="mid:CAE8MtZABBiDmd+gyt=s5wxJJZfPOcaOaYNf+OXNT9m6i1cij-w@mail.gmail.com">
<meta http-equiv="content-type" content="text/html; charset=UTF-8">
<div dir="ltr">Hello Anton,
<div><br>
</div>
<div>for the reconciliation task, you can use multiple worker
threads. <a
href="https://wiki.evolveum.com/display/midPoint/Parallelized+background+tasks"
moz-do-not-send="true">https://wiki.evolveum.com/display/midPoint/Parallelized+background+tasks</a></div>
<div><br>
</div>
<div>As long as you have enough CPU cores and your DB handles
the load without failures midpoint performance in
reconciliation scales almost linearly with the number of the
worker threads.</div>
<div><br>
</div>
<div>Best Regards</div>
<div>Oskar Butovič</div>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">st 25. 3. 2020 v 8:04
odesílatel Щенев Антон Вячеславович <<a
href="mailto:anton.shchenev@beeper.ru"
moz-do-not-send="true">anton.shchenev@beeper.ru</a>>
napsal:<br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div lang="RU">
<div class="gmail-m_-5995120129985163870WordSection1">
<p class="MsoNormal"><span lang="EN-US">Hello</span>!</p>
<p class="MsoNormal"><span lang="EN-US">Could you ask me
pls, what best practices for work with big DB
tables(>65000 entires)(Import some attributes for
midPoint’s users)</span></p>
<p class="MsoNormal"><span lang="EN-US">The task
processing 8 hours and this time not enough,
approximately need 20 hours</span></p>
<p class="MsoNormal"><span
class="gmail-m_-5995120129985163870tlid-translation"><span
lang="EN">Can some script optimization help in
synchronization? Or may be there are some variants ?</span></span></p>
<p class="MsoNormal"><span lang="EN-US">I tried this
setting: Configured worker threads,
</span><span
class="gmail-m_-5995120129985163870tlid-translation"><span
lang="EN">but it was not so useful</span></span></p>
<p class="MsoNormal"><span lang="EN-US">Scheduling </span><span
class="gmail-m_-5995120129985163870tlid-translation"><span
lang="EN">does not provide an opportunity to suspend
a task (or maybe I'm wrong?)
</span></span></p>
<p class="MsoNormal"><span
class="gmail-m_-5995120129985163870tlid-translation"><span
lang="EN">Every time he starts it again…</span></span></p>
<p class="MsoNormal"><span
class="gmail-m_-5995120129985163870tlid-translation"><span
lang="EN">I would be grateful for some kind of
answer, because this functionality is very good and
very flexible</span></span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)"><img
id="gmail-m_-5995120129985163870Рисунок_x0020_6"
src="cid:part4.FC2C4E61.CBC94113@evolveum.com"
alt="Описание: Описание: Описание:
cid:image004.png@01D47D0D.3B8B0380" class=""
width="247" height="4"></span><span
style="color:rgb(31,73,125)"></span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)"> </span></p>
<p class="MsoNormal"><span
style="font-size:6pt;color:rgb(31,73,125)"> </span><span
style="color:rgb(31,73,125)"></span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">С
уважением,</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">Щенев
Антон Вячеславович</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">Ведущий
инженер по ИБ</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)"
lang="EN-US">BEEPER
</span><span style="color:rgb(31,73,125)">(ООО
«Инфо-контент»)</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)"> </span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">620075,
г. Екатеринбург,
</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">Улица
Розы Люксембург, дом 19, 4 этаж</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)">8-343-300-00-11
доп. 3392</span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)"
lang="EN-US"><a href="mailto:anton.shchenev@beeper.ru"
target="_blank" moz-do-not-send="true">anton<span
lang="RU">.</span>shchenev<span lang="RU">@</span>beeper<span
lang="RU">.</span>ru</a>
</span><span style="color:rgb(31,73,125)"></span></p>
<p class="MsoNormal"><span style="color:rgb(33,33,33)"
lang="EN-US"><a href="http://www.beeper.ru/"
target="_blank" moz-do-not-send="true">www<span
lang="RU">.</span>beeper<span lang="RU">.</span>ru</a>
</span><span style="color:rgb(31,73,125)"></span></p>
<p class="MsoNormal"><span
style="font-size:6pt;color:rgb(31,73,125)"> </span></p>
<p class="MsoNormal"><span style="color:rgb(31,73,125)"><img
id="gmail-m_-5995120129985163870Рисунок_x0020_5"
src="cid:part7.DB1CFAB0.F886C494@evolveum.com"
alt="Описание: Описание: Описание:
cid:image010.png@01D47D0D.3B8B0380" class=""
width="201" height="70" border="0"></span><span
style="color:rgb(31,73,125)"></span></p>
<p class="MsoNormal"><span
style="font-size:6pt;color:rgb(31,73,125)"> </span></p>
<p class="MsoNormal"><a href="https://vk.com/beeperteam"
target="_blank" moz-do-not-send="true"><span
style="color:rgb(31,73,125);text-decoration:none"><img
id="gmail-m_-5995120129985163870Рисунок_x0020_4"
src="cid:part8.CA15A3F5.A4BB2D7D@evolveum.com"
alt="Описание: Описание: Описание: ВК" class=""
width="38" height="38" border="0"></span></a><span
style="color:rgb(31,73,125)">
</span><a href="https://www.facebook.com/beeper.ru"
target="_blank" moz-do-not-send="true"><span
style="color:rgb(31,73,125);text-decoration:none"><img
id="gmail-m_-5995120129985163870Рисунок_x0020_3"
src="cid:part10.F89B79BC.A8BED8EF@evolveum.com"
alt="Описание: Описание: Описание: FB" class=""
width="38" height="38" border="0"></span></a><span
style="color:rgb(31,73,125)"> </span><a
href="https://ok.ru/group/55521990672392"
target="_blank" moz-do-not-send="true"><span
style="color:rgb(31,73,125);text-decoration:none"><img
id="gmail-m_-5995120129985163870Рисунок_x0020_2"
src="cid:part12.9303B050.06D4459A@evolveum.com"
alt="Описание: Описание: Описание: OK" class=""
width="38" height="38" border="0"></span></a><span
style="color:rgb(31,73,125)"> </span><a
href="https://www.instagram.com/beeper_team/"
target="_blank" moz-do-not-send="true"><span
style="text-decoration:none"><img
id="gmail-m_-5995120129985163870Рисунок_x0020_7"
src="cid:part14.0E25DCE4.F7FADB8C@evolveum.com"
alt="Описание: Описание: Описание: In" class=""
width="37" height="38" border="0"></span></a><span
style="color:rgb(31,73,125)"> </span></p>
<p class="MsoNormal"> </p>
</div>
</div>
_______________________________________________<br>
midPoint mailing list<br>
<a href="mailto:midPoint@lists.evolveum.com" target="_blank"
moz-do-not-send="true">midPoint@lists.evolveum.com</a><br>
<a href="https://lists.evolveum.com/mailman/listinfo/midpoint"
rel="noreferrer" target="_blank" moz-do-not-send="true">https://lists.evolveum.com/mailman/listinfo/midpoint</a><br>
</blockquote>
</div>
<br clear="all">
<div><br>
</div>
-- <br>
<div dir="ltr" class="gmail_signature">
<div dir="ltr">
<div>
<div dir="ltr">
<div>
<p><strong
style="color:rgb(0,0,0);font-family:Arial,sans-serif;font-size:13px">Oskar
Butovič</strong><br>
<font face="Arial, sans-serif" color="#808080"><span
style="font-size:11px">vedoucí vývoje</span></font><br>
</p>
</div>
<p
style="color:rgb(0,0,0);font-family:Arial,sans-serif;font-size:11px">gsm:
[+420] 774 480 101<br>
e‑mail: <a href="mailto:oskar.butovic@ami.cz"
target="_blank" moz-do-not-send="true">oskar.butovic@ami.cz</a></p>
<p
style="color:rgb(0,0,0);font-family:Arial,sans-serif;font-size:11px"><strong>AMI
Praha a.s.</strong><br>
Pláničkova 11, 162 00 Praha 6</p>
<p
style="color:rgb(0,0,0);font-family:Arial,sans-serif;font-size:11px">tel.:
[+420] 274 783 239 | web: <a href="https://www.ami.cz/"
target="_blank" moz-do-not-send="true">www.ami.cz</a></p>
<p
style="color:rgb(0,0,0);font-family:Verdana,Arial,Helvetica,sans-serif;font-size:10px;margin-top:20px"><img
src="http://www.ami.cz/images/podpis/ami_logo.gif"
alt="AMI Praha a.s." style="border: 0px;"
moz-do-not-send="true"></p>
<p
style="font-family:Arial,sans-serif;font-size:11px;color:rgb(170,170,170)">Textem
tohoto e‑mailu podepisující neslibuje uzavřít
ani neuzavírá za společnost AMI Praha a.s.<br>
jakoukoliv smlouvu. Každá smlouva, pokud bude uzavřena,
musí mít výhradně písemnou formu.<br>
<span style="font-size:6px"> </span><br>
Tento e‑mail je určen výhradně pro potřeby
jeho adresáta/ů a může obsahovat důvěrné nebo osobní<br>
informace. Nejste‑li zamýšleným příjemcem, je zakázáno
jakékoliv zveřejňování, zprostředkování<br>
nebo jiné použití těchto informací. Pokud jste obdrželi
e‑mail neoprávněně, informujte o tom prosím<br>
odesílatele a vymažte neprodleně všechny kopie tohoto
e‑mailu včetně všech jeho příloh. Nakládáním<br>
s neoprávněně získanými informacemi se vystavujete
riziku právního postihu.</p>
</div>
</div>
</div>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<pre class="moz-quote-pre" wrap="">_______________________________________________
midPoint mailing list
<a class="moz-txt-link-abbreviated" href="mailto:midPoint@lists.evolveum.com">midPoint@lists.evolveum.com</a>
<a class="moz-txt-link-freetext" href="https://lists.evolveum.com/mailman/listinfo/midpoint">https://lists.evolveum.com/mailman/listinfo/midpoint</a>
</pre>
</blockquote>
</body>
</html>