[midPoint] Task Performance Improvement With Buckets and Workers

[Haywood, Jeremiah]

Hey all, 

 

I have been looking to improve the performance of some of our large Midpoint
reconciliation/import tasks. Reading through documentation I initially
looked into tweaking workerThreads, but it seems that configuration of
workers and buckets is advantageous for a clustered setup. I haven't been
able to find too many examples or docs on the options and how they work.
Below is an example of a multi-node import task I am attempting to get to
work to no avail:

 

<activity>

        <work>

            <import>

                <resourceObjects>

                    <resourceRef oid="<oid>"/>

                    <objectclass>ri:AccountObjectClass</objectclass>

                </resourceObjects>

            </import>

        </work>

        <distribution>

            <buckets>

                <stringSegmentation>

                    <discriminator>attributes/icfs:name</discriminator>

                    <matchingRule>stringIgnoreCase</matchingRule>

                    <boundary>

                        <position>1</position>

                        <characters>abcdefghijklmnopqrstuvwxyz</characters>

                    </boundary>

                </stringSegmentation>

            </buckets>

            <workers>

                <workersPerNode>

                    <count>8</count>

                </workersPerNode>

            </workers>

            <workerThreads>8</workerThreads>

        </distribution>

    </activity>

 

Would anyone be able to speak to how to correctly configure the distribution
section?

 

Thank you,

 

Jeremiah Haywood

Lead IAM Administrator

Office of Technology Solutions | Illinois State University

Phone Number (309) 438-3829

 

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.evolveum.com/pipermail/midpoint/attachments/20221110/8b54806c/attachment-0001.htm>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 7264 bytes
Desc: not available
URL: <https://lists.evolveum.com/pipermail/midpoint/attachments/20221110/8b54806c/attachment-0001.bin>