[midPoint] New Connector not loading

Thu Sep 7 22:25:22 CEST 2017

Great! I'm glad you succeeded.

Best regards,

Pavol Mederly
Software developer
evolveum.com

On 07.09.2017 22:21, Kromhout, Ethan A. wrote:
> Okay, I think I got this. Reading through the org.identityconnectors.framework.impl.api.local.LocalConnectorInfoManagerImpl.java , the createConnectorInfo method that returns the information midPoint needs for the ConnectorKey relies on an annotation which I didn't have in my connector class. I added the below annotation and my connector now shows as a connector object in midPoint.
>
> @ConnectorClass(displayNameKey = "UI_AMQP_CONNECTOR_NAME", configurationClass = AmqpConfiguration.class)
>
> Thanks,
>
> Ethan
> ________________________________________
> From: midPoint <midpoint-bounces at lists.evolveum.com> on behalf of Kromhout, Ethan A. <ethan at unc.edu>
> Sent: Thursday, September 7, 2017 1:01 PM
> To: midpoint at lists.evolveum.com
> Subject: Re: [midPoint] New Connector not loading
>
> [This sender failed our fraud detection checks and may not be who they appear to be. Learn about spoofing at http://aka.ms/LearnAboutSpoofing]
>
> Re-sending without the full log attached for now since it was larger than the default size limit on the list.
>
> Thanks,
>
> Ethan
> ________________________________________
> From: Kromhout, Ethan A.
> Sent: Thursday, September 7, 2017 12:14 PM
> To: midpoint at lists.evolveum.com
> Subject: Re: [midPoint] New Connector not loading
>
> Thank you again Pavol, I do get better logs with the change in logback.xml that you suggested.
>
> Looking at the difference between a successfully loading connector (connector-csv-2.1-SNAPSHOT.jar) and mine, I keep thinking that somehow my connector isn't giving ConnectorFactoryConnIdImpl a ConnectorKey, but I'm unsure about where that Key is supposed to come from. bundleName is probably from the MANIFEST.MF as written by maven, but I don't understand where the connectorName is represented in the jar file.
>
>
> 2017-09-07 15:53:32,941 [] [localhost-startStop-1] INFO (com.evolveum.midpoint.provisioning.ucf.impl.connid.ConnectorFactoryConnIdImpl): Discovered ICF bundle in JAR: com.evolveum.polygon.connector-csv version: 2.1-SNAPSHOT
> 2017-09-07 15:53:32,985 [] [localhost-startStop-1] DEBUG (org.identityconnectors.framework.impl.api.local.LocalConnectorInfoManagerImpl): method: null msg:Add ConnectorInfo ConnectorKey( bundleName=com.evolveum.polygon.connector-csv bundleVersion=2.1-SNAPSHOT connectorName=com.evolveum.polygon.connector.csv.CsvConnector ) to Local Connector Info Manager from file:/var/opt/midpoint/icf-connectors/connector-csv-2.1-SNAPSHOT.jar
> 2017-09-07 15:53:32,987 [] [localhost-startStop-1] TRACE (com.evolveum.midpoint.provisioning.ucf.impl.connid.ConnectorFactoryConnIdImpl): Found 1 compatible connectors in bundle file:/var/opt/midpoint/icf-connectors/connector-csv-2.1-SNAPSHOT.jar
>
> 2017-09-07 15:53:32,999 [] [localhost-startStop-1] INFO (com.evolveum.midpoint.provisioning.ucf.impl.connid.ConnectorFactoryConnIdImpl): Discovered ICF bundle in JAR: edu.unc.polygon.connector-amqp-import version: 0.1-SNAPSHOT
> 2017-09-07 15:53:33,036 [] [localhost-startStop-1] ERROR (com.evolveum.midpoint.provisioning.ucf.impl.connid.ConnectorFactoryConnIdImpl): Strange error happened. ConnId is not accepting bundle file:/var/opt/midpoint/icf-connectors/connector-amqp-import-0.1-SNAPSHOT.jar. But no error is indicated.
> 2017-09-07 15:53:33,036 [] [localhost-startStop-1] WARN (com.evolveum.midpoint.provisioning.ucf.impl.connid.ConnectorFactoryConnIdImpl): Skip loading budle file:/var/opt/midpoint/icf-connectors/connector-amqp-import-0.1-SNAPSHOT.jar due error occured
>
> Ethan
> ________________________________________
> From: midPoint <midpoint-bounces at lists.evolveum.com> on behalf of Pavol Mederly <mederly at evolveum.com>
> Sent: Thursday, September 7, 2017 3:50 AM
> To: midpoint at lists.evolveum.com
> Subject: Re: [midPoint] New Connector not loading
>
> I am afraid there is a problem with the logback.xml file (because there're no logging entries at all while it's in use).
>
> I would suggest simply adding these two lines:
>
>      <logger name="org.identityconnectors" level="TRACE"/>
>      <logger name="com.evolveum.midpoint.provisioning.ucf.impl.connid" level="TRACE"/>
>
>
>
>
>
>
> Pavol Mederly
> Software developer
> evolveum.com
>
>
> On 06.09.2017 20:59, Kromhout, Ethan A. wrote:
>
> I added the following to WEB-INF/classes/logback.xml:
>
>      <logger name="org.identityconnectors" level="ALL">
>          <appender-ref ref="IDM_LOG"/>
>      </logger>
>      <logger name="com.evolveum.midpoint.provisioning.ucf.impl.connid" level="ALL">
>          <appender-ref ref="IDM_LOG"/>
>      </logger>
>
> But curiously I no longer see any mention of my connector at all, so I'm not sure I've done this correctly.
>
> Thanks again,
>
> Ethan
> ________________________________________
> From: midPoint <midpoint-bounces at lists.evolveum.com><mailto:midpoint-bounces at lists.evolveum.com> on behalf of Pavol Mederly <mederly at evolveum.com><mailto:mederly at evolveum.com>
> Sent: Wednesday, September 6, 2017 12:15 PM
> To: midpoint at lists.evolveum.com<mailto:midpoint at lists.evolveum.com>
> Subject: Re: [midPoint] New Connector not loading
>
> Oh, I see. I forgot about that.
>
> So please make the change also in WEB-INF/classes/logback.xml file. It is used until system configuration is read from the repository and logging from it is applied.
>
> Pavol Mederly
> Software developer
> evolveum.com
>
>
> On 06.09.2017 17:37, Kromhout, Ethan A. wrote:
>
> Hi Pavol,
>
> Thank you for looking at it with me. I have org.identityconnectors set to ALL, and the attached is what I see on a clean startup. I think I'm not getting much for my connector from the org.identityconnectors logs because the failure is so early in the initialization.
>
> Thanks,
>
> Ethan
> ________________________________________
> From: midPoint <midpoint-bounces at lists.evolveum.com><mailto:midpoint-bounces at lists.evolveum.com><mailto:midpoint-bounces at lists.evolveum.com><mailto:midpoint-bounces at lists.evolveum.com> on behalf of Pavol Mederly <mederly at evolveum.com><mailto:mederly at evolveum.com><mailto:mederly at evolveum.com><mailto:mederly at evolveum.com>
> Sent: Wednesday, September 6, 2017 8:50 AM
> To: midpoint at lists.evolveum.com<mailto:midpoint at lists.evolveum.com><mailto:midpoint at lists.evolveum.com><mailto:midpoint at lists.evolveum.com>
> Subject: Re: [midPoint] New Connector not loading
>
> Hello Ethan,
>
> you could try setting TRACE or ALL logging level on
> org.identityconnectors.framework package. Maybe we could find something
> useful in the log then.
>
> Best regards,
>
> Pavol Mederly
> Software developer
> evolveum.com
>
> On 06.09.2017 14:37, Ivan Noris wrote:
>
>
> Hi Ethan,
>
> definitely very strange, unfortunately this is out of my experience, I
> have never seen that.
>
> I hope someone else might have a clue.
>
> Best regards,
>
> Ivan
>
>
> On 06.09.2017 13:04, Kromhout, Ethan A. wrote:
>
>
> Thank you Ivan, I double checked permissions, and got rid of an old logback.xml file, and set logging for com.evolveum.midpoint.provisioning.ucf.impl.connid to ALL. I got the below log snippet that at least mentions my jar, but doesn't give me much more information. Do you know of any additional logging that might tell me more about this error, or does this error look familiar at all? Googling takes me to this condition in the source for ConnectorFactoryConnIdImpl , but I'm still reading through to figure out  how I'm meeting the condition "if (connectorInfos == null || connectorInfos.isEmpty())".
>
> Thanks,
>
> Ethan
>
>
> 2017-09-06 10:50:05,778 [] [localhost-startStop-1] INFO (com.evolveum.midpoint.provisioning.ucf.impl.connid.ConnectorFactoryConnIdImpl): Discovered ICF bundle in JAR: unc.edu.polygon.connector-amqp-import version: 0.1-SNAPSHOT
> 2017-09-06 10:50:05,806 [] [localhost-startStop-1] ERROR (com.evolveum.midpoint.provisioning.ucf.impl.connid.ConnectorFactoryConnIdImpl): Strange error happened. ConnId is not accepting bundle file:/var/opt/midpoint/icf-connectors/connector-amqp-import-0.1-SNAPSHOT.jar. But no error is indicated.
> 2017-09-06 10:50:05,807 [] [localhost-startStop-1] WARN (com.evolveum.midpoint.provisioning.ucf.impl.connid.ConnectorFactoryConnIdImpl): Skip loading budle file:/var/opt/midpoint/icf-connectors/connector-amqp-import-0.1-SNAPSHOT.jar due error occured
>
> ________________________________________
> From: midPoint <midpoint-bounces at lists.evolveum.com><mailto:midpoint-bounces at lists.evolveum.com><mailto:midpoint-bounces at lists.evolveum.com><mailto:midpoint-bounces at lists.evolveum.com> on behalf of Ivan Noris <ivan.noris at evolveum.com><mailto:ivan.noris at evolveum.com><mailto:ivan.noris at evolveum.com><mailto:ivan.noris at evolveum.com>
> Sent: Wednesday, September 6, 2017 3:20 AM
> To: midpoint at lists.evolveum.com<mailto:midpoint at lists.evolveum.com><mailto:midpoint at lists.evolveum.com><mailto:midpoint at lists.evolveum.com>
> Subject: Re: [midPoint] New Connector not loading
>
> Hi,
>
> my only tip and question is - have you put the connector to the correct
> directory? $midpoint.home/icf-connectors/
>
> If there is no message, not even error related to that connector when
> midPoint starts, I'd say it has not been picked up. I remember in the
> past I had some bad connector which was unable to load, but there was a
> message in idm.log each time when midPoint started. So the connector was
> detected, but not usable.
>
> Please check if the connector jar file is in correct directory (and has
> correct permissions etc. to be readable by midPoint/tomcat).
>
> Best regards,
>
> Ivan
>
>
> On 05.09.2017 16:42, Kromhout, Ethan A. wrote:
>
>
> I have a new connector I've been working on, and it doesn't appear to get loaded when I restart midPoint. I've tried manually creating a Connector definition for it, but I get and exception when trying to configure it as a resource, so I think I'm missing something basic that the connector needs to load.
>
> My connector is just implementing a few operations:
>
> public class AmqpConnector implements  Connector, DeleteOp, SearchOp<String>, SchemaOp {
>
> And provides init, getConfiguration, dispose, createFilterTranslator, schema, executeQuery and delete.
>
> It contains the following  classes and files:
>
> META-INF/
> META-INF/MANIFEST.MF
> lib/
> lib/commons-csv-1.4.jar
> lib/amqp-client-4.0.2.jar
> lib/slf4j-api-1.7.21.jar
> edu/
> edu/unc/
> edu/unc/polygon/
> edu/unc/polygon/connector/
> edu/unc/polygon/connector/amqp/
> edu/unc/polygon/connector/amqp/AmqpFilterTranslator.class
> edu/unc/polygon/connector/amqp/AmqpConfiguration.class
> edu/unc/polygon/connector/amqp/AmqpConnector.class
> edu/unc/polygon/connector/amqp/Messages.properties
>
> And has the following manifest:
>
> Manifest-Version: 1.0
> Archiver-Version: Plexus Archiver
> Built-By: ekromhout
> ConnectorBundle-FrameworkVersion: 1.4.2.14
> ConnectorBundle-Version: 0.1-SNAPSHOT
> Created-By: Apache Maven 3.3.9
> Build-Jdk: 1.8.0_141
> ConnectorBundle-Name: unc.edu.polygon.connector-amqp-import
>
> When midpoint starts up, I see the other jar files being loaded by org.identityconnectors.framework.impl.api.local.LocalConnectorInfoManagerImpl  , but I don't see anything for my jar file above.
>
> Just hoping someone sees something obvious missing in the way of a file or method that would cause the jar file not to be picked up as a connector.
>
> Thanks,
>
> Ethan
> 6C2F 9067 96D4 AB4A 9621  4FEB 3069 4100 EBFB 55D1
> _______________________________________________
> midPoint mailing list
> midPoint at lists.evolveum.com<mailto:midPoint at lists.evolveum.com><mailto:midPoint at lists.evolveum.com><mailto:midPoint at lists.evolveum.com>
> http://lists.evolveum.com/mailman/listinfo/midpoint
>
>
> --
> Ivan Noris
> Senior Identity Engineer
> evolveum.com
>
> _______________________________________________
> midPoint mailing list
> midPoint at lists.evolveum.com<mailto:midPoint at lists.evolveum.com><mailto:midPoint at lists.evolveum.com><mailto:midPoint at lists.evolveum.com>
> http://lists.evolveum.com/mailman/listinfo/midpoint
> _______________________________________________
> midPoint mailing list
> midPoint at lists.evolveum.com<mailto:midPoint at lists.evolveum.com><mailto:midPoint at lists.evolveum.com><mailto:midPoint at lists.evolveum.com>
> http://lists.evolveum.com/mailman/listinfo/midpoint
>
>
>
> _______________________________________________
> midPoint mailing list
> midPoint at lists.evolveum.com<mailto:midPoint at lists.evolveum.com><mailto:midPoint at lists.evolveum.com><mailto:midPoint at lists.evolveum.com>
> http://lists.evolveum.com/mailman/listinfo/midpoint
>
>
>
>
> _______________________________________________
> midPoint mailing list
> midPoint at lists.evolveum.com<mailto:midPoint at lists.evolveum.com><mailto:midPoint at lists.evolveum.com><mailto:midPoint at lists.evolveum.com>
> http://lists.evolveum.com/mailman/listinfo/midpoint
>
>
>
>
>
>
> _______________________________________________
> midPoint mailing list
> midPoint at lists.evolveum.com<mailto:midPoint at lists.evolveum.com>
> http://lists.evolveum.com/mailman/listinfo/midpoint
>
>
> _______________________________________________
> midPoint mailing list
> midPoint at lists.evolveum.com
> http://lists.evolveum.com/mailman/listinfo/midpoint
> _______________________________________________
> midPoint mailing list
> midPoint at lists.evolveum.com
> http://lists.evolveum.com/mailman/listinfo/midpoint