[midPoint] Filtering out bad or out-of-band data at import

[Ivan Noris]

Hi Kevin,


midpoint creates a shadow object whenever it discovers a resource
object, so yes, there should be shadows created for everything from the
CSV file.


Ivan


On 15. 2. 2019 8:55, Collins, Kevin J wrote:
> Gustav,
>
>
> Many thanks for that.
>
> Wouldn't that mean, though, that the Midpoint IDM would have a shadow
> object for *every* record in the CSV file? The live ones as well as
> the stale ones?
>
>
> -Kev
>
> ------------------------------------------------------------------------
> *From:* midPoint <midpoint-bounces at lists.evolveum.com> on behalf of
> Pálos Gustáv <gustav.palos at evolveum.com>
> *Sent:* 15 February 2019 04:25
> *To:* midPoint General Discussion
> *Subject:* Re: [midPoint] Filtering out bad or out-of-band data at import
>  
> Hi Kevin,
>
> you can use condition in synchronization to write your needs:
> https://wiki.evolveum.com/display/midPoint/Synchronization+Configuration#SynchronizationConfiguration-Conditions
>
> Best regards
>
> Gustav
>
> št 14. 2. 2019 o 17:00 Collins, Kevin J <K.J.Collins at hw.ac.uk
> <mailto:K.J.Collins at hw.ac.uk>> napísal(a):
>
>     Hi everyone,
>
>
>     During a data import (from a csv file) is it possible to examine
>     dates in the source record in the csv file to determine whether or
>     not the record should be skipped or imported? For example…
>
>     personID,sn,givenName,personalTitle,description,startDate,endDate
>     “1234”,”Collins”,”Kevin”,”Mr”,”Specialist”,”10-Jan-2015”,””
>     “5678”,”Butter”,”Roland”,”Dr”,”System
>     Theologian”,”01-Jul-1996”,”30-Nov-2018”
>     “9101”,”Calamity”,”Jane”,”Ms”,”Data Packet
>     Wrangler”,”24-Feb-1998”,”31-Mar-2019”
>
>     In the above csv, I’d like to achieve this:
>
>     Collins, Kevin —> imported (no end-date set in HR), and
>     Calamity, Jane —> imported (end-date is in the future), and
>     Butter, Roland —> not imported (end-date in the past)
>
>     …but I can’t see how to do this in the examples. I could easily
>     pre-process the csv (Python, Perl, etc) to remove any record with
>     a date in the past, but I’m thinking that it ought to be possible
>     entirely in MidPoint, and that I’m just not seeing it.
>
>
>     -Kev_C
>
>     - 
>     Kevin Collins,
>     Senior Specialist,
>     Information Services,
>     Rm 23, Allen McTernan Building,
>     Heriot-Watt University
>     Edinburgh Campus
>     EH14 4AS
>
>
>
>     ------------------------------------------------------------------------
>
>     */Heriot-Watt University is The Times & The Sunday Times
>     International University of the Year 2018/*
>
>     Founded in 1821, Heriot-Watt is a leader in ideas and solutions.
>     With campuses and students across the entire globe we span the
>     world, delivering innovation and educational excellence in
>     business, engineering, design and the physical, social and life
>     sciences. This email is generated from the Heriot-Watt University
>     Group, which includes:
>
>      1. Heriot-Watt University, a Scottish charity registered under
>         number SC000278
>      2. Edinburgh Business School a Charity Registered in Scotland,
>         SC026900. Edinburgh Business School is a company limited by
>         guarantee, registered in Scotland with registered number
>         SC173556 and registered office at Heriot-Watt University
>         Finance Office, Riccarton, Currie, Midlothian, EH14 4AS
>      3. Heriot- Watt Services Limited (Oriam), Scotland's national
>         performance centre for sport. Heriot-Watt Services Limited is
>         a private limited company registered is Scotland with
>         registered number SC271030 and registered office at Research &
>         Enterprise Services Heriot-Watt University, Riccarton,
>         Edinburgh, EH14 4AS.
>
>     The contents (including any attachments) are confidential. If you
>     are not the intended recipient of this e-mail, any disclosure,
>     copying, distribution or use of its contents is strictly
>     prohibited, and you should please notify the sender immediately
>     and then delete it (including any attachments) from your system.
>
>     _______________________________________________
>     midPoint mailing list
>     midPoint at lists.evolveum.com <mailto:midPoint at lists.evolveum.com>
>     http://lists.evolveum.com/mailman/listinfo/midpoint
>
>
>
> -- 
> Gustáv Pálos
> Senior Identity Engineer
> evolveum.com <http://evolveum.com/>
>
> _______________________________________________
> midPoint mailing list
> midPoint at lists.evolveum.com
> http://lists.evolveum.com/mailman/listinfo/midpoint

-- 
Ivan Noris
Senior Identity Engineer
evolveum.com

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <https://lists.evolveum.com/pipermail/midpoint/attachments/20190215/52c696da/attachment.htm>