[midPoint] CSV Connector in clustered environment

[Chris Woods]

Hi František,

that's actually what I tried to do in the end, but still ended up getting the error which is why I'm confused. I get that my original idea of trying to use a CSV resource in a docker swarm where multiple systems are trying to access the same file was probably not a stroke of genius, but now I'm using one connector on a remote connector host (which actually works fine with our old Sun IdM).

Oh well, I'll just have to dig a bit more. 

Regards,
Chris

-----Original Message-----
From: František Dvořák <valtri at civ.zcu.cz> 
Sent: Monday, March 1, 2021 2:14 PM
To: midPoint General Discussion <midpoint at lists.evolveum.com>
Cc: Woods Chris 12OAD <Chris.Woods at rohde-schwarz.com>
Subject: *EXT* Re: [midPoint] CSV Connector in clustered environment

Hello,

you could try to tune connection pool for the CSV connector: set
maxObjects=1 and maxIdle=1.

(just an idea, I actually have no expirence with CSV connector and/or
Windows)

Cheers,
  František

Chris Woods via midPoint píše v Po 01. 03. 2021 v 09:17 +0000:
> Hi,
> I hope someone out there can save my sanity. We have a CSV resource 
> that is on a remote share (I know this is not a supported scenario, 
> but I’m not sure whether that is the problem). When I run a 
> reconciliation on the resource I get the following error (not for each 
> entry, just sporadically, but regularly):
> CommunicationException: Error communicating with connector
> ConnectorInstanceIcfImpl(connector:dee21223-5c73-48ff-84e0-
> 51f829b886ad(ConnId com.evolveum.polygon.connector.csv.CsvConnector
> v2.4 @ICF Connector server on amuxxxxx.xxxxx.xxx:8610)): IO error:
> org.identityconnectors.framework.common.exceptions.ConnectorIOExcepti
> on(Error during account 'Attribute: {Name=__UID__, Value=[10610]}'
> UPDATE, IO exception occurred, reason: C:\Program Files (x86)\Identity 
> Connectors\connector_server_java-
> 1.2.6195_2\data\employeeIDExport4midPoint.csv: The process cannot 
> access the file because it is being used by another process.??)-
> >org.identityconnectors.framework.impl.api.remote.RemoteWrappedExcept
> ion(Error during account 'Attribute: {Name=__UID__, Value=[10610]}'
> UPDATE, IO exception occurred, reason: C:\Program Files (x86)\Identity 
> Connectors\connector_server_java-
> 1.2.6195_2\data\employeeIDExport4midPoint.csv: The process cannot 
> access the file because it is being used by another process.??)-
> >org.identityconnectors.framework.impl.api.remote.RemoteWrappedExcept
> ion(C:\Program Files (x86)\Identity Connectors\connector_server_java-
> 1.2.6195_2\data\employeeIDExport4midPoint.csv: The process cannot 
> access the file because it is being used by another process.??) I am 
> running the connector on a remote host at the moment as an attempt to 
> stop each midpoint node accessing the file simultaneously.
> In theory there should only be one connector instance accessing the 
> file. In the connector pooling, minIdle, maxIdle and maxObjects are 
> set to 1.
> Originally, I had the CIFS mounts on the linux hosts but when using 
> this setup the file would be deleted after a couple of accounts during 
> reconciliation or livesync.
> Does anyone have any idea what I’m doing wrong or if the network share 
> really is so much of a problem? Thanks in advance!
> Regards,
> Chris
> CHRIS WOODS
> Identity Management
> Information and Business Technology
>  
> Rohde & Schwarz GmbH & Co. KG
> Mühldofstraße 15| 81671 München
> Telefon: +49 89 4129 15735
> Internet: https://www.rohde-schwarz.com
>  
> 
> 
> Content provided within this e-mail including any attachments, is for 
> the use of the intended recipients and may contain Rohde & Schwarz 
> company restricted information. Any unauthorized use, disclosure, or 
> distribution of this communication in whole or in part is strictly 
> prohibited. If you are not the intended recipient, please notify the 
> sender by reply email or by telephone and delete the communication in 
> its entirety.
> _______________________________________________
> midPoint mailing list
> midPoint at lists.evolveum.com
> https://lists.evolveum.com/mailman/listinfo/midpoint



Content provided within this e-mail including any attachments, is for the use of the intended recipients and may contain Rohde & Schwarz company restricted information. Any unauthorized use, disclosure, or distribution of this communication in whole or in part is strictly prohibited. If you are not the intended recipient, please notify the sender by reply email or by telephone and delete the communication in its entirety.