[midPoint-git] [Evolveum/midpoint] a75240: Add configurable normalization

[mederly]

  Branch: refs/heads/feature/smart-correlation-prototype
  Home:   https://github.com/Evolveum/midpoint
  Commit: a75240db6bb31d8b2f36ac0a04e56e584641cca2
      https://github.com/Evolveum/midpoint/commit/a75240db6bb31d8b2f36ac0a04e56e584641cca2
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2022-08-08 (Mon, 08 Aug 2022)

  Changed paths:
    M infra/schema/src/main/java/com/evolveum/midpoint/schema/merger/TypeSpecificMergersConfigurator.java
    M infra/schema/src/main/java/com/evolveum/midpoint/schema/util/CorrelationItemDefinitionUtil.java
    M infra/schema/src/main/java/com/evolveum/midpoint/schema/util/FocusTypeUtil.java
    M infra/schema/src/main/resources/xml/ns/public/common/common-correlation-3.xsd
    M model/model-api/src/main/java/com/evolveum/midpoint/model/api/correlator/CorrelatorContext.java
    M model/model-api/src/main/java/com/evolveum/midpoint/model/api/identities/IdentityManagementConfiguration.java
    A model/model-api/src/main/java/com/evolveum/midpoint/model/api/identities/IndexingConfiguration.java
    A model/model-api/src/main/java/com/evolveum/midpoint/model/api/identities/IndexingItemConfiguration.java
    A model/model-api/src/main/java/com/evolveum/midpoint/model/api/identities/Normalization.java
    A model/model-api/src/main/java/com/evolveum/midpoint/model/api/identities/NormalizationStep.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/ModelBeans.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/correlation/CorrelationPropertiesCreator.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/correlation/CorrelatorContextCreator.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/correlator/BaseCorrelator.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/correlator/idmatch/IdMatchObjectCreator.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/correlator/items/CorrelationItem.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/correlator/items/CorrelationItems.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/LensFocusContext.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/executor/DeltaExecution.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/identities/IdentitiesManager.java
    A model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/identities/IndexingManager.java
    A model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/identities/Normalizer.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/projector/focus/inbounds/prep/ClockworkSource.java
    M model/model-impl/src/test/java/com/evolveum/midpoint/model/impl/correlator/correlation/TestCorrelators.java
    M model/model-impl/src/test/resources/correlator/correlation/accounts-by-name-default.csv
    A model/model-impl/src/test/resources/correlator/correlation/accounts-by-name-original.csv
    A model/model-impl/src/test/resources/correlator/correlation/correlator-by-name-original.xml
    M model/model-impl/src/test/resources/correlator/correlation/user-template-default-indexing.xml
    A model/model-impl/src/test/resources/correlator/correlation/user-template-original-indexing.xml
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/TestIdentities.java
    M model/model-test/src/main/java/com/evolveum/midpoint/model/test/AbstractModelIntegrationTest.java
    M testing/story/src/test/java/com/evolveum/midpoint/testing/story/correlation/AbstractMediumIdMatchCorrelationTest.java
    M testing/story/src/test/java/com/evolveum/midpoint/testing/story/correlation/TestInternalCorrelationMedium.java
    M testing/story/src/test/resources/correlation/idmatch/simple/resource-sis.xml

  Log Message:
  -----------
  Add configurable normalization

It is now possible to configure how data in identity/items/normalized
are computed.

Other changes:
- Removed obsolete correlator/definitions schema item (and relatives).

Work in progress.


  Commit: 6cb231d4694450f3f09f6174239bdd659659357c
      https://github.com/Evolveum/midpoint/commit/6cb231d4694450f3f09f6174239bdd659659357c
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2022-08-08 (Mon, 08 Aug 2022)

  Changed paths:
    M model/model-api/src/main/java/com/evolveum/midpoint/model/api/correlator/CorrelatorContext.java
    M model/model-api/src/main/java/com/evolveum/midpoint/model/api/identities/IdentityItemConfiguration.java
    M model/model-api/src/main/java/com/evolveum/midpoint/model/api/identities/IdentityManagementConfiguration.java
    R model/model-api/src/main/java/com/evolveum/midpoint/model/api/identities/IndexingConfiguration.java
    R model/model-api/src/main/java/com/evolveum/midpoint/model/api/identities/IndexingItemConfiguration.java
    R model/model-api/src/main/java/com/evolveum/midpoint/model/api/identities/Normalization.java
    R model/model-api/src/main/java/com/evolveum/midpoint/model/api/identities/NormalizationStep.java
    A model/model-api/src/main/java/com/evolveum/midpoint/model/api/indexing/IndexingConfiguration.java
    A model/model-api/src/main/java/com/evolveum/midpoint/model/api/indexing/IndexingItemConfiguration.java
    A model/model-api/src/main/java/com/evolveum/midpoint/model/api/indexing/Normalization.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/correlation/CorrelationServiceImpl.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/correlation/CorrelatorContextCreator.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/correlator/items/CorrelationItem.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/correlator/items/CorrelationItems.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/correlator/items/ItemsCorrelator.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/LensContext.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/LensFocusContext.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/executor/DeltaExecution.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/identities/IdentitiesManager.java
    A model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/identities/IdentityItemConfiguration.java
    A model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/identities/IdentityItemConfigurationImpl.java
    A model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/identities/IdentityManagementConfigurationImpl.java
    A model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/identities/IndexingConfigurationImpl.java
    A model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/identities/IndexingItemConfigurationImpl.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/identities/IndexingManager.java
    A model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/identities/NormalizationImpl.java
    A model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/identities/NormalizationStep.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/identities/Normalizer.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/projector/focus/TemplateMappingsEvaluation.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/projector/focus/inbounds/prep/ClockworkSource.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/projector/focus/inbounds/prep/MSource.java
    M model/model-impl/src/test/java/com/evolveum/midpoint/model/impl/correlator/correlation/TestCorrelators.java
    A model/model-impl/src/test/resources/correlator/correlation/accounts-complex.csv
    A model/model-impl/src/test/resources/correlator/correlation/correlator-complex.xml
    A model/model-impl/src/test/resources/correlator/correlation/user-template-complex.xml
    M model/model-impl/src/test/resources/correlator/correlation/user-template-original-indexing.xml
    A model/model-impl/src/test/resources/correlator/correlation/users-complex.xml
    M model/model-impl/src/test/resources/correlator/correlation/users-items.xml

  Log Message:
  -----------
  Add custom (scripted) normalization

We can now use custom scripts to compute normalized values.

Work in progress.


Compare: https://github.com/Evolveum/midpoint/compare/b6200ef44b30...6cb231d46944