[midPoint] Filtering out bad or out-of-band data at import

[Collins, Kevin J]

Hi everyone,


During a data import (from a csv file) is it possible to examine dates in the source record in the csv file to determine whether or not the record should be skipped or imported? For example…

personID,sn,givenName,personalTitle,description,startDate,endDate
“1234”,”Collins”,”Kevin”,”Mr”,”Specialist”,”10-Jan-2015”,””
“5678”,”Butter”,”Roland”,”Dr”,”System Theologian”,”01-Jul-1996”,”30-Nov-2018”
“9101”,”Calamity”,”Jane”,”Ms”,”Data Packet Wrangler”,”24-Feb-1998”,”31-Mar-2019”

In the above csv, I’d like to achieve this:

Collins, Kevin —> imported (no end-date set in HR), and
Calamity, Jane —> imported (end-date is in the future), and
Butter, Roland —> not imported (end-date in the past)

…but I can’t see how to do this in the examples. I could easily pre-process the csv (Python, Perl, etc) to remove any record with a date in the past, but I’m thinking that it ought to be possible entirely in MidPoint, and that I’m just not seeing it.


-Kev_C

-
Kevin Collins,
Senior Specialist,
Information Services,
Rm 23, Allen McTernan Building,
Heriot-Watt University
Edinburgh Campus
EH14 4AS



________________________________

Heriot-Watt University is The Times & The Sunday Times International University of the Year 2018

Founded in 1821, Heriot-Watt is a leader in ideas and solutions. With campuses and students across the entire globe we span the world, delivering innovation and educational excellence in business, engineering, design and the physical, social and life sciences. This email is generated from the Heriot-Watt University Group, which includes:

  1.  Heriot-Watt University, a Scottish charity registered under number SC000278
  2.  Edinburgh Business School a Charity Registered in Scotland, SC026900. Edinburgh Business School is a company limited by guarantee, registered in Scotland with registered number SC173556 and registered office at Heriot-Watt University Finance Office, Riccarton, Currie, Midlothian, EH14 4AS
  3.  Heriot- Watt Services Limited (Oriam), Scotland's national performance centre for sport. Heriot-Watt Services Limited is a private limited company registered is Scotland with registered number SC271030 and registered office at Research & Enterprise Services Heriot-Watt University, Riccarton, Edinburgh, EH14 4AS.

The contents (including any attachments) are confidential. If you are not the intended recipient of this e-mail, any disclosure, copying, distribution or use of its contents is strictly prohibited, and you should please notify the sender immediately and then delete it (including any attachments) from your system.
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.evolveum.com/pipermail/midpoint/attachments/20190214/dadea1c6/attachment.htm>