<div dir="ltr">you can also decrease schema size in resource over this:<div><div><schema></div><div><span class="" style="white-space:pre"> </span><generationConstraints></div><div><span class="" style="white-space:pre"> </span><generateObjectClass>ri:inetOrgPerson</generateObjectClass></div><div><span class="" style="white-space:pre"> </span><generateObjectClass>ri:groupOfNames</generateObjectClass></div><div><span class="" style="white-space:pre"> </span></generationConstraints></div><div></schema></div><div><br></div><div>when ri:inetOrgPerson and ri:groupOfNames are your object classes what you are using in schemaHandling section.</div><div><br></div><div>Gustav</div><div class="gmail_extra"><br><div class="gmail_quote">2016-08-26 10:40 GMT+02:00 Radovan Semancik <span dir="ltr"><<a href="mailto:radovan.semancik@evolveum.com" target="_blank">radovan.semancik@evolveum.com</a>></span>:<br><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div bgcolor="#FFFFFF" text="#000000">
Yes, it is. But the memory consumption of the LDAP connector should
be proportional to schema size and number of connector instances. It
should NOT be proportional to the number of LDAP entries.<br>
<br>
The memory consumption should normally increase at the beginning of
the import. But after first few entries are imported the memory
consumption should stay more or less constant. If the heap size
continually increases during import it is most likely midpoint bug,
connector bug or Apache Directory API bug.<span class=""><font color="#888888"><br>
<br>
<pre cols="72">--
Radovan Semancik
Software Architect
<a href="http://evolveum.com" target="_blank">evolveum.com</a>
</pre></font></span><div><div class="h5">
<br>
<br>
<div>On 08/25/2016 04:28 PM, Ivan Noris
wrote:<br>
</div>
<blockquote type="cite">
<div style="font-family:"times new roman","new york",times,serif;font-size:12pt;color:rgb(0,0,0)">
<div>I have a feeling that LDAP connector might be a little
resource consuming for some resources with big schemas etc.<br>
</div>
<div>Ivan<br>
</div>
<div><br>
</div>
<hr>
<blockquote style="border-left:2px solid rgb(16,16,255);margin-left:5px;padding-left:5px;color:rgb(0,0,0);font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt"><b>From:
</b>"Jason Everling" <a href="mailto:jeverling@bshp.edu" target="_blank"><jeverling@bshp.edu></a><br>
<b>To: </b>"midPoint General Discussion"
<a href="mailto:midpoint@lists.evolveum.com" target="_blank"><midpoint@lists.evolveum.com></a><br>
<b>Sent: </b>Thursday, August 25, 2016 5:15:33 PM<br>
<b>Subject: </b>Re: [midPoint] Running out of Java Heap Space<br>
<div><br>
</div>
<div dir="ltr">I had the same issue when I imported around 20k
accounts from one of our databases in the beginning,
although, we have more than one java application running on
this server, 64bit jdk,
<div><br>
</div>
<div>-Xms512m -Xmx4096m -XX:PermSize=512m
-XX:MaxPermSize=1024m<br>
</div>
</div>
<div class="gmail_extra"><br clear="all">
<div>
<div>
<div dir="ltr">JASON</div>
</div>
</div>
<br>
<div class="gmail_quote">On Thu, Aug 25, 2016 at 1:36 AM,
Ivan Noris <span dir="ltr"><<a href="mailto:Ivan.Noris@evolveum.com" target="_blank">Ivan.Noris@evolveum.com</a>></span>
wrote:<br>
<blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div>
<div style="font-family:"times new roman","new york",times,serif;font-size:12pt;color:rgb(0,0,0)">
<div>Hi Matt,<br>
</div>
<div>please try to increase -Xmx to at least 2048m
and see if it helps.<br>
</div>
<div><br>
</div>
<div>Ivan<br>
</div>
<div><br>
</div>
<hr>
<blockquote style="border-left:2px solid rgb(16,16,255);margin-left:5px;padding-left:5px;color:rgb(0,0,0);font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica,Arial,sans-serif;font-size:12pt"><b>From:
</b>"Matt Mencel" <<a href="mailto:mr-mencel@wiu.edu" target="_blank">mr-mencel@wiu.edu</a>><br>
<b>To: </b>"midPoint General Discussion" <<a href="mailto:midpoint@lists.evolveum.com" target="_blank">midpoint@lists.evolveum.com</a>><br>
<b>Sent: </b>Thursday, August 25, 2016 12:01:33
AM<br>
<b>Subject: </b>[midPoint] Running out of Java
Heap Space
<div>
<div><br>
<div><br>
</div>
<div dir="ltr">Is there any further
recommendations for setting the Java memory
requirements? My JAVA_OPTS is set to this.
<div><br>
</div>
<div><span style="font-family:monospace,monospace">JAVA_OPTS="$JAVA_OPTS
$JSSE_OPTS -Dmidpoint.home=/opt/midpoint
-Djavax.net.ssl.trustStore=/<wbr>opt/midpoint/keystore.jceks
-Djavax.net.ssl.<wbr>trustStoreType=jceks
-XX:MaxPermSize=1024m -Xss1m -Xmx1024m"<br>
</span>
<div><br>
</div>
<div>I'm running into the error below
after an LDAP import task suspends due
to an error. I have yet to resolve the
error, see my earlier post about how to
ignore an LDAP attribute on import.
I've got plenty of memory on the VM, but
I may need to tune my Java even further.</div>
<div><br>
</div>
<div>Thanks,</div>
<div>Matt</div>
<div><br>
</div>
<div><br>
</div>
<div>
<div>2016-08-24 13:29:56,835 []
[midPointScheduler_Worker-4] INFO
(com.evolveum.midpoint.task.<wbr>quartzimpl.execution.<wbr>JobExecutor):
Task encountered temporary error,
suspending it. Task =
Task(id:1472058712002-0-1, name:LDAP
Import,
oid:bfeccb74-5aa2-40f2-a107-<wbr>18e120b765fc)</div>
<div>2016-08-24 13:29:56,836 []
[midPointScheduler_Worker-4] INFO
(com.evolveum.midpoint.task.<wbr>quartzimpl.<wbr>TaskManagerQuartzImpl):
Suspending tasks
[Task(id:1472058712002-0-1, name:LDAP
Import,
oid:bfeccb74-5aa2-40f2-a107-<wbr>18e120b765fc)];
do not stop tasks.</div>
<div>2016-08-24 13:51:21,162 []
[NioProcessor-1] WARN
(org.apache.directory.ldap.<wbr>client.api.<wbr>LdapNetworkConnection):
Java heap space</div>
<div>java.lang.OutOfMemoryError: Java
heap space</div>
<div>2016-08-24 13:52:46,208 []
[NioProcessor-1] WARN
(org.apache.directory.ldap.<wbr>client.api.<wbr>LdapNetworkConnection):
Java heap space</div>
<div>java.lang.OutOfMemoryError: Java
heap space</div>
<div>2016-08-24 14:01:27,961 []
[ClusterManagerThread] ERROR
(com.evolveum.midpoint.task.<wbr>quartzimpl.cluster.<wbr>ClusterManager):
Unexpected exception in ClusterManager
thread; continuing execution., reason:
Java heap space (class
java.lang.OutOfMemoryError)</div>
<div>2016-08-24 14:02:59,710 []
[midPointScheduler_Worker-5] ERROR
(org.quartz.core.JobRunShell): Job
DEFAULT.00000000-0000-0000-<wbr>0000-000000000006
threw an unhandled Exception:</div>
<div>java.lang.OutOfMemoryError: Java
heap space</div>
<div>2016-08-24 14:03:01,507 []
[NioProcessor-2] WARN
(org.apache.directory.ldap.<wbr>client.api.<wbr>LdapNetworkConnection):
Java heap space</div>
<div>java.lang.OutOfMemoryError: Java
heap space</div>
<div>2016-08-24 14:03:03,490 []
[NioProcessor-2] WARN
(org.apache.directory.ldap.<wbr>client.api.<wbr>LdapNetworkConnection):
Java heap space</div>
<div>java.lang.OutOfMemoryError: Java
heap space</div>
<div>2016-08-24 14:03:03,490 []
[midPointScheduler_Worker-5] ERROR
(org.quartz.core.ErrorLogger): Job
(DEFAULT.00000000-0000-0000-<wbr>0000-000000000006
threw an exception.</div>
<div>org.quartz.SchedulerException: Job
threw an unhandled exception.</div>
<div> at
org.quartz.core.JobRunShell.<wbr>run(JobRunShell.java:224)
~[quartz-2.1.3.jar:na]</div>
<div> at
org.quartz.simpl.<wbr>SimpleThreadPool$WorkerThread.<wbr>run(SimpleThreadPool.java:557)
[quartz-2.1.3.jar:na]</div>
<div>Caused by:
java.lang.OutOfMemoryError: Java heap
space</div>
<div>2016-08-24 14:29:17,649 []
[Thread-9] ERROR
(org.activiti.engine.impl.<wbr>jobexecutor.<wbr>AcquireJobsRunnableImpl):
exception during job acquisition: Java
heap space</div>
<div>java.lang.OutOfMemoryError: Java
heap space</div>
<div> at
sun.reflect.<wbr>GeneratedConstructorAccessor5.<wbr>newInstance(Unknown
Source) ~[na:na]</div>
<div> at
sun.reflect.<wbr>DelegatingConstructorAccessorI<wbr>mpl.newInstance(<wbr>DelegatingConstructorAccessorI<wbr>mpl.java:45)
~[na:1.8.0_101]</div>
<div> at
java.lang.reflect.Constructor.<wbr>newInstance(Constructor.java:<wbr>423)
~[na:1.8.0_101]</div>
<div> at
com.mysql.jdbc.Util.<wbr>handleNewInstance(Util.java:<wbr>404)
~[mysql-connector-java-5.1.39-<wbr>bin.jar:5.1.39]</div>
<div> at
com.mysql.jdbc.ResultSetImpl.<wbr>getInstance(ResultSetImpl.<wbr>java:319)
~[mysql-connector-java-5.1.39-<wbr>bin.jar:5.1.39]</div>
<div> at
com.mysql.jdbc.MysqlIO.<wbr>buildResultSetWithUpdates(<wbr>MysqlIO.java:3187)
~[mysql-connector-java-5.1.39-<wbr>bin.jar:5.1.39]</div>
<div> at
com.mysql.jdbc.MysqlIO.<wbr>readResultsForQueryOrUpdate(<wbr>MysqlIO.java:3087)
~[mysql-connector-java-5.1.39-<wbr>bin.jar:5.1.39]</div>
<div> at
com.mysql.jdbc.MysqlIO.<wbr>readAllResults(MysqlIO.java:<wbr>2336)
~[mysql-connector-java-5.1.39-<wbr>bin.jar:5.1.39]</div>
<div> at
com.mysql.jdbc.MysqlIO.<wbr>sqlQueryDirect(MysqlIO.java:<wbr>2729)
~[mysql-connector-java-5.1.39-<wbr>bin.jar:5.1.39]</div>
<div> at
com.mysql.jdbc.ConnectionImpl.<wbr>execSQL(ConnectionImpl.java:<wbr>2545)
~[mysql-connector-java-5.1.39-<wbr>bin.jar:5.1.39]</div>
<div> at
com.mysql.jdbc.ConnectionImpl.<wbr>setAutoCommit(ConnectionImpl.<wbr>java:4842)
~[mysql-connector-java-5.1.39-<wbr>bin.jar:5.1.39]</div>
<div> at
sun.reflect.<wbr>GeneratedMethodAccessor254.<wbr>invoke(Unknown
Source) ~[na:na]</div>
<div> at
sun.reflect.<wbr>DelegatingMethodAccessorImpl.<wbr>invoke(<wbr>DelegatingMethodAccessorImpl.<wbr>java:43)
~[na:1.8.0_101]</div>
<div> at
java.lang.reflect.Method.<wbr>invoke(Method.java:498)
~[na:1.8.0_101]</div>
<div> at
org.apache.ibatis.datasource.<wbr>pooled.PooledConnection.<wbr>invoke(PooledConnection.java:<wbr>245)
~[mybatis-3.3.0.jar:3.3.0]</div>
<div> at
com.sun.proxy.$Proxy106.<wbr>setAutoCommit(Unknown
Source) ~[na:na]</div>
<div> at
org.apache.ibatis.transaction.<wbr>jdbc.JdbcTransaction.<wbr>setDesiredAutoCommit(<wbr>JdbcTransaction.java:104)
~[mybatis-3.3.0.jar:3.3.0]</div>
<div> at
org.apache.ibatis.transaction.<wbr>jdbc.JdbcTransaction.<wbr>openConnection(<wbr>JdbcTransaction.java:144)
~[mybatis-3.3.0.jar:3.3.0]</div>
<div> at
org.apache.ibatis.transaction.<wbr>jdbc.JdbcTransaction.<wbr>getConnection(JdbcTransaction.<wbr>java:62)
~[mybatis-3.3.0.jar:3.3.0]</div>
<div> at
org.apache.ibatis.executor.<wbr>BaseExecutor.getConnection(<wbr>BaseExecutor.java:315)
~[mybatis-3.3.0.jar:3.3.0]</div>
<div> at
org.apache.ibatis.executor.<wbr>SimpleExecutor.<wbr>prepareStatement(<wbr>SimpleExecutor.java:75)
~[mybatis-3.3.0.jar:3.3.0]</div>
<div> at
org.apache.ibatis.executor.<wbr>SimpleExecutor.doQuery(<wbr>SimpleExecutor.java:61)
~[mybatis-3.3.0.jar:3.3.0]</div>
<div> at
org.apache.ibatis.executor.<wbr>BaseExecutor.<wbr>queryFromDatabase(<wbr>BaseExecutor.java:303)
~[mybatis-3.3.0.jar:3.3.0]</div>
<div> at
org.apache.ibatis.executor.<wbr>BaseExecutor.query(<wbr>BaseExecutor.java:154)
~[mybatis-3.3.0.jar:3.3.0]</div>
<div> at
org.apache.ibatis.executor.<wbr>CachingExecutor.query(<wbr>CachingExecutor.java:102)
~[mybatis-3.3.0.jar:3.3.0]</div>
<div> at
org.apache.ibatis.executor.<wbr>CachingExecutor.query(<wbr>CachingExecutor.java:82)
~[mybatis-3.3.0.jar:3.3.0]</div>
<div> at
org.apache.ibatis.session.<wbr>defaults.DefaultSqlSession.<wbr>selectList(DefaultSqlSession.<wbr>java:120)
~[mybatis-3.3.0.jar:3.3.0]</div>
<div> at
org.apache.ibatis.session.<wbr>defaults.DefaultSqlSession.<wbr>selectList(DefaultSqlSession.<wbr>java:113)
~[mybatis-3.3.0.jar:3.3.0]</div>
<div> at
org.activiti.engine.impl.db.<wbr>DbSqlSession.<wbr>selectListWithRawParameter(<wbr>DbSqlSession.java:438)
~[activiti-engine-5.19.0.2.<wbr>jar:5.19.0.2]</div>
<div> at
org.activiti.engine.impl.db.<wbr>DbSqlSession.selectList(<wbr>DbSqlSession.java:429)
~[activiti-engine-5.19.0.2.<wbr>jar:5.19.0.2]</div>
<div> at
org.activiti.engine.impl.db.<wbr>DbSqlSession.selectList(<wbr>DbSqlSession.java:424)
~[activiti-engine-5.19.0.2.<wbr>jar:5.19.0.2]</div>
<div> at
org.activiti.engine.impl.db.<wbr>DbSqlSession.selectList(<wbr>DbSqlSession.java:411)
~[activiti-engine-5.19.0.2.<wbr>jar:5.19.0.2]</div>
</div>
<div><br>
</div>
</div>
</div>
<br>
</div>
</div>
______________________________<wbr>_________________<br>
midPoint mailing list<br>
<a href="mailto:midPoint@lists.evolveum.com" target="_blank">midPoint@lists.evolveum.com</a><br>
<a href="http://lists.evolveum.com/mailman/listinfo/midpoint" target="_blank">http://lists.evolveum.com/<wbr>mailman/listinfo/midpoint</a><span><span style="color:rgb(136,136,136)" color="#888888"><br>
</span></span></blockquote>
<span><span style="color:rgb(136,136,136)" color="#888888">
<div><br>
<div><br>
</div>
</div>
<div><br>
</div>
<div>-- <br>
</div>
<div><span></span>Ivan Noris<br>
Senior Identity Engineer<br>
<a href="http://evolveum.com" target="_blank">evolveum.com</a><span></span><br>
</div>
</span></span></div>
</div>
<br>
______________________________<wbr>_________________<br>
midPoint mailing list<br>
<a href="mailto:midPoint@lists.evolveum.com" target="_blank">midPoint@lists.evolveum.com</a><br>
<a href="http://lists.evolveum.com/mailman/listinfo/midpoint" rel="noreferrer" target="_blank">http://lists.evolveum.com/<wbr>mailman/listinfo/midpoint</a><br>
<br>
</blockquote>
</div>
<br>
</div>
<br>
<span style="font-size:small" size="2"><br>
<div><br>
</div>
CONFIDENTIALITY NOTICE:<br>
This e-mail together with any attachments is proprietary and
confidential; intended for only the recipient(s) named above
and may contain information that is privileged. You should
not retain, copy or use this e-mail or any attachments for
any purpose, or disclose all or any part of the contents to
any person. Any views or opinions expressed in this e-mail
are those of the author and do not represent those of the
Baptist School of Health Professions. If you have received
this e-mail in error, or are not the named recipient(s), you
are hereby notified that any review, dissemination,
distribution or copying of this communication is prohibited
by the sender and to do so might constitute a violation of
the Electronic Communications Privacy Act, 18 U.S.C. section
2510-2521. Please immediately notify the sender and delete
this e-mail and any attachments from your computer. </span><br>
<div><br>
</div>
______________________________<wbr>_________________<br>
midPoint mailing list<br>
<a href="mailto:midPoint@lists.evolveum.com" target="_blank">midPoint@lists.evolveum.com</a><br>
<a href="http://lists.evolveum.com/mailman/listinfo/midpoint" target="_blank">http://lists.evolveum.com/<wbr>mailman/listinfo/midpoint</a><br>
</blockquote>
<div><br>
<br>
</div>
<div><br>
</div>
<div>-- <br>
</div>
<div><span name="x"></span>Ivan Noris<br>
Senior Identity Engineer<br>
<a href="http://evolveum.com" target="_blank">evolveum.com</a><span name="x"></span><br>
</div>
</div>
<br>
<fieldset></fieldset>
<br>
<pre>______________________________<wbr>_________________
midPoint mailing list
<a href="mailto:midPoint@lists.evolveum.com" target="_blank">midPoint@lists.evolveum.com</a>
<a href="http://lists.evolveum.com/mailman/listinfo/midpoint" target="_blank">http://lists.evolveum.com/<wbr>mailman/listinfo/midpoint</a>
</pre>
</blockquote>
<br>
</div></div></div>
<br>______________________________<wbr>_________________<br>
midPoint mailing list<br>
<a href="mailto:midPoint@lists.evolveum.com">midPoint@lists.evolveum.com</a><br>
<a href="http://lists.evolveum.com/mailman/listinfo/midpoint" rel="noreferrer" target="_blank">http://lists.evolveum.com/<wbr>mailman/listinfo/midpoint</a><br>
<br></blockquote></div><br><br clear="all"><div><br></div>-- <br><div class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div>Gustáv Pálos</div><div>Identity Engineer</div><a href="http://evolveum.com/" rel="noreferrer" style="color:rgb(17,85,204);font-size:12.8px" target="_blank">evolveum.com</a><br></div></div>
</div></div></div>