<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
font-size:11.0pt;
font-family:"Calibri",sans-serif;
mso-fareast-language:EN-US;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0in;
font-size:10.0pt;
font-family:"Courier New";}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:Consolas;}
span.EmailStyle21
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="en-CH" link="blue" vlink="purple" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal"><span lang="EN-US">Hello Pavol,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">Thank you very much for the reply!<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">It seems like midpoint cannot find the either the user account or the associated groups in that user account.
<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">But the shadow exists in midpoint<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><img width="1054" height="343" style="width:10.9833in;height:3.575in" id="Picture_x0020_1" src="cid:image001.png@01D8A74C.D7C7FAB0"></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><img width="954" height="366" style="width:9.9416in;height:3.8166in" id="Picture_x0020_2" src="cid:image002.png@01D8A74C.BE307730"></span><span lang="EN-US"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">And from the<b> REPO CONFLICT</b> log, the</span><span lang="EN-US">
</span><span lang="EN-US">resourceObject given to findConflictingShadow seems to be the right object but without oid. The
<b>potential conflicting repo shadow </b>is exactly the object that exists in database.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">What’s your advice to proceed?<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">Thank you very much for your help!<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">Best regards,<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">Hsin-Fang<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">Below is just part of the log I copied:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">022-08-03 13:21:03,928 [PROVISIONING] [http-nio-8088-exec-7] TRACE (com.evolveum.midpoint.provisioning.impl.shadows.ShadowedObjectConstruction):
<b>Start adopting associations: 1</b><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">2022-08-03 13:21:03,928 [PROVISIONING] [http-nio-8088-exec-7] TRACE (com.evolveum.midpoint.provisioning.impl.shadows.ShadowedObjectConstruction):
<b>Determining shadowRef</b> for PCV(null):[PP({.../common/common-3}name):[PPV(ItemName:group)], RAC(identifiers):[PCV(null):[RA({.../resource/instance-3}dn):[PPV(String:CN=grp-staff,OU=xxxxxx,DC=xxxxx,DC=xx)]]]]<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">2022-08-03 13:21:03,929 [PROVISIONING] [http-nio-8088-exec-7] TRACE (com.evolveum.midpoint.provisioning.impl.shadows.ShadowedObjectConstruction): Processing kind=ENTITLEMENT, intent=group (from the definition)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">2022-08-03 13:21:03,929 [PROVISIONING] [http-nio-8088-exec-7] TRACE (com.evolveum.midpoint.provisioning.impl.shadows.manager.ShadowFinder): Searching for shadow using filter (repo):<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">2022-08-03 13:21:03,949 [PROVISIONING] [http-nio-8088-exec-7] TRACE (com.evolveum.midpoint.provisioning.impl.shadows.manager.ShadowFinder): Searching for shadow by primary identifier (attributes) using filter:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">2022-08-03 13:21:03,950 [PROVISIONING] [http-nio-8088-exec-7] TRACE (com.evolveum.midpoint.provisioning.impl.shadows.manager.ShadowFinder):
<b>Found 0 shadows (live or dead)<o:p></o:p></b></span></p>
<p class="MsoNormal"><span lang="EN-US">2022-08-03 13:21:03,951 [PROVISIONING] [http-nio-8088-exec-7] TRACE (com.evolveum.midpoint.provisioning.impl.shadows.ShadowAcquisition):
<b>Shadow object (in repo) corresponding to the resource object (on the resource) was not found. The repo shadow will be created. The resource object:<o:p></o:p></b></span></p>
<p class="MsoNormal"><b><span lang="EN-US">shadow:null(null)<o:p></o:p></span></b></p>
<p class="MsoNormal"><span lang="EN-US">2022-08-03 13:21:03,951 [PROVISIONING] [http-nio-8088-exec-7] TRACE (com.evolveum.midpoint.provisioning.impl.shadows.manager.ShadowManager): Adding new shadow from resource object:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> shadow: (null, ShadowType)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">2022-08-03 13:21:03,961 [PROVISIONING] [http-nio-8088-exec-7] DEBUG (com.evolveum.midpoint.provisioning.impl.shadows.ShadowAcquisition): Attempt to create new repo shadow for shadow:null(null) ended up in conflict,
<b>re-trying the search for repo shadow<o:p></o:p></b></span></p>
<p class="MsoNormal"><span lang="EN-US">2022-08-03 13:21:03,962 [PROVISIONING] [http-nio-8088-exec-7] TRACE (com.evolveum.midpoint.provisioning.impl.shadows.manager.ShadowFinder): Searching for shadow by primary identifier (attributes) using filter:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">2022-08-03 13:21:03,962 [PROVISIONING] [http-nio-8088-exec-7] TRACE (com.evolveum.midpoint.provisioning.impl.shadows.manager.ShadowFinder):
<b>Found 0 shadows (live or dead)</b><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">2022-08-03 13:21:03,963 [PROVISIONING] [http-nio-8088-exec-7] TRACE (com.evolveum.midpoint.provisioning.impl.shadows.manager.ShadowFinder): Searching for shadow by primaryIdentifierValue using filter:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">2022-08-03 13:21:03,964 [PROVISIONING] [http-nio-8088-exec-7] ERROR (com.evolveum.midpoint.provisioning.impl.shadows.ShadowAcquisition): Unexpected repository behavior: object already exists error even after we double-checked
shadow uniqueness: Conflicting object already exists, constraint violation message: ERROR: duplicate key value violates unique constraint "m_shadow_primidval_objcls_resrefoid_key"<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> Detail: Key (primaryidentifiervalue, objectclassid, resourcereftargetoid)=(756d6959-9a3a-4f33-a5e4-0c08ef72db37, 17, 412a9b5d-4c88-4a64-a281-2995d46146c8) already exists.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">com.evolveum.midpoint.util.exception.ObjectAlreadyExistsException: Conflicting object already exists, constraint violation message: ERROR: duplicate key value violates unique constraint "m_shadow_primidval_objcls_resrefoid_key"<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> Detail: Key (primaryidentifiervalue, objectclassid, resourcereftargetoid)=(756d6959-9a3a-4f33-a5e4-0c08ef72db37, 17, 412a9b5d-4c88-4a64-a281-2995d46146c8) already exists.<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">2022-08-03 13:21:03,964 [PROVISIONING] [http-nio-8088-exec-7] DEBUG (com.evolveum.midpoint.provisioning.impl.shadows.ShadowAcquisition):
<b>REPO CONFLICT: resource shadow<o:p></o:p></b></span></p>
<p class="MsoNormal"><span lang="EN-US"> shadow: (null, ShadowType)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> oid=null, version=null<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> attributes:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> objectSid: S-1-5-21-4039012443-3458975651-2582944172-1142<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> uSNChanged: 1721254<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> sAMAccountName: grp-staff<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> whenCreated: 2021-04-20T07:16:16.000Z<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> cn: grp-staff<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> member: [ CN=Midpoint Testneun, name: grp-staff<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> uSNCreated: 76200<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> objectCategory: CN=Group,CN=Schema,CN=Configuration,DC=xxxx,DC=xx<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> </span><span lang="DE">dSCorePropagationData: [ 2021-07-07T07:22:32.000Z, 2021-06-21T07:18:39.000Z, 2021-06-21T06:52:50.000Z, 2021-05-21T10:54:59.000Z, 1601-07-14T22:36:48.000Z ]<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="DE"> dn: CN=grp-staff,OU=xxxx-xxxxx,DC=xxxx,DC=xx<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="DE"> </span><span lang="EN-US">distinguishedName: CN=grp-staff,OU=xxxx-xxxx,DC=xxxx,DC=xx<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> instanceType: 4<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> groupType: -2147483646<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> whenChanged: 2022-07-20T06:55:32.000Z<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> objectGUID: 756d6959-9a3a-4f33-a5e4-0c08ef72db37<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> objectClass: {...resource/instance-3}group<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> exists: true<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">2022-08-03 13:21:03,970 [PROVISIONING] [http-nio-8088-exec-7] DEBUG (com.evolveum.midpoint.provisioning.impl.shadows.ShadowAcquisition):
<b>REPO CONFLICT: resource shadow: determined primaryIdentifierValue</b>: 756d6959-9a3a-4f33-a5e4-0c08ef72db37<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">2022-08-03 13:21:03,970 [PROVISIONING] [http-nio-8088-exec-7] DEBUG (com.evolveum.midpoint.provisioning.impl.shadows.ShadowAcquisition):
<b>REPO CONFLICT: potential conflicting repo shadow (by primaryIdentifierValue)<o:p></o:p></b></span></p>
<p class="MsoNormal"><span lang="EN-US"> </span><span lang="DE">shadow: (fe35d3e8-7fc2-481d-9063-e9285fbb6164, v0, ShadowType)<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="DE"> oid=fe35d3e8-7fc2-481d-9063-e9285fbb6164, version=0<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="DE"> </span><span lang="EN-US">name: CN=grp-staff,OU=xxx-xxx,DC=xxxx,DC=xx<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> resourceRef: oid=412a9b5d-4c88-4a64-a281-2995d46146c8(ResourceType)[default]<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> synchronizationTimestamp: 2021-04-20T11:44:06.815+02:00<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> fullSynchronizationTimestamp: 2021-04-20T11:44:06.815+02:00<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> objectClass: {...resource/instance-3}group<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> primaryIdentifierValue: 756d6959-9a3a-4f33-a5e4-0c08ef72db37<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> kind: ENTITLEMENT<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> intent: group<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> exists: true<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> attributes:<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> dn: [ cn=grp-staff,ou=xxxxxx,dc=xxx,dc=xx (raw) ]<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> objectGUID: [ 756d6959-9a3a-4f33-a5e4-0c08ef72db37 (raw) ]<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">2022-08-03 13:21:03,971 [PROVISIONING] [http-nio-8088-exec-7] ERROR (com.evolveum.midpoint.model.impl.ModelObjectResolver): Error resolving object with oid 000425a8-6b34-4cad-83ef-f1e8177f0bf7, expected type was class
com.evolveum.midpoint.xml.ns._public.common.common_3.ShadowType..<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US">com.evolveum.midpoint.util.exception.SystemException: Unexpected repository behavior: object already exists error even after we double-checked shadow uniqueness: Conflicting object already exists, constraint violation
message: ERROR: duplicate key value violates unique constraint "m_shadow_primidval_objcls_resrefoid_key"<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US"> Detail: Key (primaryidentifiervalue, objectclassid, resourcereftargetoid)=(756d6959-9a3a-4f33-a5e4-0c08ef72db37, 17, 412a9b5d-4c88-4a64-a281-2995d46146c8) already exists.<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div style="border:none;border-top:solid #E1E1E1 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span lang="EN-US" style="mso-fareast-language:#2000">From:</span></b><span lang="EN-US" style="mso-fareast-language:#2000"> midPoint <midpoint-bounces@lists.evolveum.com>
<b>On Behalf Of </b>Pavol Mederly via midPoint<br>
<b>Sent:</b> Wednesday, August 3, 2022 10:57 AM<br>
<b>To:</b> midpoint@lists.evolveum.com<br>
<b>Cc:</b> Pavol Mederly <mederly@evolveum.com><br>
<b>Subject:</b> Re: [midPoint] duplicate key value violates unique constraint "m_shadow_primidval_objcls_resrefoid_key"<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p>Hello Hsin-Fang,<o:p></o:p></p>
<p>there is a troubleshooting piece of code related to that exception:<o:p></o:p></p>
<p><a href="https://github.com/Evolveum/midpoint/blob/5e841416523a6d46431443d36b056e91ada0b9f1/provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/shadows/ShadowAcquisition.java#L188-L196">https://github.com/Evolveum/midpoint/blob/5e841416523a6d46431443d36b056e91ada0b9f1/provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/shadows/ShadowAcquisition.java#L188-L196</a><o:p></o:p></p>
<p>You should enable the respective DEBUG logging and midPoint will provide you with more information.<o:p></o:p></p>
<p>Best regards,<o:p></o:p></p>
<pre>-- <o:p></o:p></pre>
<pre>Pavol Mederly<o:p></o:p></pre>
<pre>Software developer<o:p></o:p></pre>
<pre>evolveum.com<o:p></o:p></pre>
<div>
<p class="MsoNormal">On 03/08/2022 10:53, Hsin-Fang Hsu via midPoint wrote:<o:p></o:p></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<p class="MsoNormal"><span lang="EN-US">Hi,</span><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-US">I upgraded midpoint from 4.4.1 (postgresql) to 4.4.2 (postgresql native).</span><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-US">The data was exported and imported into the database using ninja and the content in the new database also seems to be fine.</span><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-US">ADLdapConnector v3.3 is used.</span><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-US">AD test connection works. But when I tried to access any AD account, I got these kind of errors:</span><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-US">com.evolveum.midpoint.util.exception.SystemException: Unexpected repository behavior: object already exists error even after we double-checked shadow uniqueness: Conflicting object already exists, constraint violation
message: ERROR: duplicate key value violates unique constraint "m_shadow_primidval_objcls_resrefoid_key" Detail: Key (primaryidentifiervalue, objectclassid, resourcereftargetoid)=(bc1cd126-81dc-4c2a-acd0-b30eafdc40ef, 11, 412a9b5d-4c88-4a64-a281-2995d46146c8)
already exists. </span><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-US">Error resolving object with oid 'eb303210-59dd-499f-bbca-9c57cefa3295': Unexpected repository behavior: object already exists error even after we double-checked shadow uniqueness: Conflicting object already exists, constraint
violation message: ERROR: duplicate key value violates unique constraint "m_shadow_primidval_objcls_resrefoid_key" Detail: Key (primaryidentifiervalue, objectclassid, resourcereftargetoid)=(b035b94c-e127-466a-9011-1e4a2dc41fc5, 17, 412a9b5d-4c88-4a64-a281-2995d46146c8)
already exists.</span><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-US">I guess the error occurs because midpoint try to save what it reads from AD to a new shadow but that shadow already exists in the database. But the configuration works fine in 4.4.1. How can I solve this?</span><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-US">Thank you very much for your help in advance!</span><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-US"> </span><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-US">Best regards,</span><o:p></o:p></p>
<p class="MsoNormal"><span lang="EN-US">Hsin-Fang</span><o:p></o:p></p>
<p class="MsoNormal"><span style="mso-fareast-language:#2000"><br>
<br>
<o:p></o:p></span></p>
<pre>_______________________________________________<o:p></o:p></pre>
<pre>midPoint mailing list<o:p></o:p></pre>
<pre><a href="mailto:midPoint@lists.evolveum.com">midPoint@lists.evolveum.com</a><o:p></o:p></pre>
<pre><a href="https://lists.evolveum.com/mailman/listinfo/midpoint">https://lists.evolveum.com/mailman/listinfo/midpoint</a><o:p></o:p></pre>
</blockquote>
</div>
</body>
</html>