[midPoint] Filtering out bad or out-of-band data at import

[Collins, Kevin J]

Gustav,


Many thanks for that.

Wouldn't that mean, though, that the Midpoint IDM would have a shadow object for *every* record in the CSV file? The live ones as well as the stale ones?


-Kev

________________________________
From: midPoint <midpoint-bounces at lists.evolveum.com> on behalf of Pálos Gustáv <gustav.palos at evolveum.com>
Sent: 15 February 2019 04:25
To: midPoint General Discussion
Subject: Re: [midPoint] Filtering out bad or out-of-band data at import

Hi Kevin,

you can use condition in synchronization to write your needs:
https://wiki.evolveum.com/display/midPoint/Synchronization+Configuration#SynchronizationConfiguration-Conditions

Best regards

Gustav

št 14. 2. 2019 o 17:00 Collins, Kevin J <K.J.Collins at hw.ac.uk<mailto:K.J.Collins at hw.ac.uk>> napísal(a):
Hi everyone,


During a data import (from a csv file) is it possible to examine dates in the source record in the csv file to determine whether or not the record should be skipped or imported? For example…

personID,sn,givenName,personalTitle,description,startDate,endDate
“1234”,”Collins”,”Kevin”,”Mr”,”Specialist”,”10-Jan-2015”,””
“5678”,”Butter”,”Roland”,”Dr”,”System Theologian”,”01-Jul-1996”,”30-Nov-2018”
“9101”,”Calamity”,”Jane”,”Ms”,”Data Packet Wrangler”,”24-Feb-1998”,”31-Mar-2019”

In the above csv, I’d like to achieve this:

Collins, Kevin —> imported (no end-date set in HR), and
Calamity, Jane —> imported (end-date is in the future), and
Butter, Roland —> not imported (end-date in the past)

…but I can’t see how to do this in the examples. I could easily pre-process the csv (Python, Perl, etc) to remove any record with a date in the past, but I’m thinking that it ought to be possible entirely in MidPoint, and that I’m just not seeing it.


-Kev_C

-
Kevin Collins,
Senior Specialist,
Information Services,
Rm 23, Allen McTernan Building,
Heriot-Watt University
Edinburgh Campus
EH14 4AS



________________________________

Heriot-Watt University is The Times & The Sunday Times International University of the Year 2018

Founded in 1821, Heriot-Watt is a leader in ideas and solutions. With campuses and students across the entire globe we span the world, delivering innovation and educational excellence in business, engineering, design and the physical, social and life sciences. This email is generated from the Heriot-Watt University Group, which includes:

  1.  Heriot-Watt University, a Scottish charity registered under number SC000278
  2.  Edinburgh Business School a Charity Registered in Scotland, SC026900. Edinburgh Business School is a company limited by guarantee, registered in Scotland with registered number SC173556 and registered office at Heriot-Watt University Finance Office, Riccarton, Currie, Midlothian, EH14 4AS
  3.  Heriot- Watt Services Limited (Oriam), Scotland's national performance centre for sport. Heriot-Watt Services Limited is a private limited company registered is Scotland with registered number SC271030 and registered office at Research & Enterprise Services Heriot-Watt University, Riccarton, Edinburgh, EH14 4AS.

The contents (including any attachments) are confidential. If you are not the intended recipient of this e-mail, any disclosure, copying, distribution or use of its contents is strictly prohibited, and you should please notify the sender immediately and then delete it (including any attachments) from your system.

_______________________________________________
midPoint mailing list
midPoint at lists.evolveum.com<mailto:midPoint at lists.evolveum.com>
http://lists.evolveum.com/mailman/listinfo/midpoint


--
Gustáv Pálos
Senior Identity Engineer
evolveum.com<http://evolveum.com/>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.evolveum.com/pipermail/midpoint/attachments/20190215/fd9bb84d/attachment.htm>