[midPoint-git] [Evolveum/midpoint] cdd805: Start working on classification simulation

mederly noreply at github.com
Thu Feb 9 22:05:44 CET 2023


  Branch: refs/heads/master
  Home:   https://github.com/Evolveum/midpoint
  Commit: cdd805a999445aa8658a197304e6a807a6e4428a
      https://github.com/Evolveum/midpoint/commit/cdd805a999445aa8658a197304e6a807a6e4428a
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2023-02-07 (Tue, 07 Feb 2023)

  Changed paths:
    M infra/schema/src/main/java/com/evolveum/midpoint/schema/TaskExecutionMode.java
    M infra/schema/src/main/resources/xml/ns/public/common/common-core-3.xsd
    M infra/schema/src/main/resources/xml/ns/public/common/common-tasks-3.xsd
    M model/model-common/src/main/java/com/evolveum/midpoint/model/common/MarkManager.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/controller/ModelInteractionServiceImpl.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/Clockwork.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/ClockworkAuditHelper.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/ElementState.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/LensContext.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/OperationExecutionRecorderForClockwork.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/executor/ChangeModeApplication.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/executor/DeltaExecution.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/executor/LinkUpdater.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/executor/ScriptExecutor.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/sync/ShadowUpdater.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/sync/SynchronizationContext.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/sync/SynchronizationServiceImpl.java
    M model/model-test/src/main/java/com/evolveum/midpoint/model/test/util/SynchronizationRequest.java
    M provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/ProvisioningContext.java
    M provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/resourceobjects/ResourceObjectConverter.java
    M provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/resources/ResourceManager.java
    M provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/shadows/ClassificationHelper.java
    M provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/shadows/ShadowAddOperation.java
    M provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/shadows/ShadowDeleteOperation.java
    M provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/shadows/ShadowModifyOperation.java
    M provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/shadows/ShadowRefreshHelper.java
    A provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/simulation/ShadowSimulationDataImpl.java
    M provisioning/provisioning-impl/src/test/java/com/evolveum/midpoint/provisioning/impl/misc/TestResourceLifecycle.java
    A provisioning/provisioning-impl/src/test/java/com/evolveum/midpoint/provisioning/impl/mock/SimulationResultMock.java
    A provisioning/provisioning-impl/src/test/java/com/evolveum/midpoint/provisioning/impl/mock/SimulationTransactionMock.java
    M provisioning/ucf-api/src/main/java/com/evolveum/midpoint/provisioning/ucf/api/UcfExecutionContext.java
    M provisioning/ucf-api/src/main/java/com/evolveum/midpoint/provisioning/ucf/api/connectors/AbstractManualConnectorInstance.java
    M provisioning/ucf-impl-builtin/src/main/java/com/evolveum/midpoint/provisioning/ucf/impl/builtin/async/provisioning/AsyncProvisioningConnectorInstance.java
    M provisioning/ucf-impl-connid/src/main/java/com/evolveum/midpoint/provisioning/ucf/impl/connid/ConnectorInstanceConnIdImpl.java
    A repo/system-init/src/main/resources/initial-objects/mark/736-mark-shadow-classification-changed.xml
    A repo/system-init/src/main/resources/initial-objects/mark/737-mark-shadow-correlation-state-changed.xml
    M repo/task-api/src/main/java/com/evolveum/midpoint/task/api/Task.java

  Log Message:
  -----------
  Start working on classification simulation

This commit opens the possibility to simulate even low-level shadow
management operations (classification, correlation) that would be
carried out even under "regular" simulation.

In particular, the support for classification simulation was added
at the lowest levels (tasks, provisioning).

Work in progress. Experimental.


  Commit: fb3e6898b087c42367faa63dae932a2372eb9c0a
      https://github.com/Evolveum/midpoint/commit/fb3e6898b087c42367faa63dae932a2372eb9c0a
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2023-02-08 (Wed, 08 Feb 2023)

  Changed paths:
    M model/model-api/src/main/java/com/evolveum/midpoint/model/api/simulation/SimulationResultManager.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/simulation/ProcessedObjectImpl.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/simulation/ProcessedObjectsWriter.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/simulation/SimulationResultManagerImpl.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/sync/SynchronizationContext.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/sync/SynchronizationServiceImpl.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/sync/tasks/recon/ReconciliationActivityHandler.java
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/simulation/AbstractBasicSimulationExecutionTest.java
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/simulation/AbstractSimulationsTest.java
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/simulation/TestDevelopmentSimulations.java
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/simulation/TestProductionSimulations.java
    M model/model-intest/src/test/resources/simulation/resource-simple-development-source.xml
    M model/model-test/src/main/java/com/evolveum/midpoint/model/test/AbstractModelIntegrationTest.java
    M model/model-test/src/main/java/com/evolveum/midpoint/model/test/CommonInitialObjects.java
    M model/model-test/src/main/java/com/evolveum/midpoint/model/test/util/SynchronizationRequest.java
    A provisioning/provisioning-api/src/main/java/com/evolveum/midpoint/provisioning/api/ShadowSimulationData.java
    M provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/shadows/ClassificationHelper.java
    M provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/shadows/sync/LiveSynchronizer.java
    M provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/simulation/ShadowSimulationDataImpl.java
    M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/activity/definition/ActivityExecutionModeDefinition.java
    M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/activity/run/AbstractActivityRun.java
    M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/activity/run/IterativeActivityRun.java
    M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/activity/run/LocalActivityRun.java
    M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/activity/run/processing/ProcessingCoordinator.java

  Log Message:
  -----------
  Make shadow classification simulation working

Simulation of shadows classification is now implemented on back-end:

1. A persistence mode of "NONE" is supported, sending classification
deltas to the simulation result and preventing synchronization actions
from being executed. There is an equivalent setting for activities
(mode = shadowManagementPreview). However, these names should be
revised, as they are not understandable enough.

2. "Processed objects" are now created for these classification deltas.


  Commit: 9a254359bfea939fd0219bb344cc09c310ccf855
      https://github.com/Evolveum/midpoint/commit/9a254359bfea939fd0219bb344cc09c310ccf855
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2023-02-09 (Thu, 09 Feb 2023)

  Changed paths:
    M model/model-api/src/main/java/com/evolveum/midpoint/model/api/correlator/CorrelatorFactoryRegistry.java
    M model/model-api/src/main/java/com/evolveum/midpoint/model/api/simulation/ProcessedObject.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/ModelBeans.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/correlation/CorrelationServiceImpl.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/correlator/BaseCorrelator.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/correlator/CorrelatorFactoryRegistryImpl.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/correlator/idmatch/IdMatchCorrelator.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/simulation/ProcessedObjectImpl.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/sync/CorrelationProcessing.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/sync/ShadowUpdater.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/sync/SynchronizationServiceImpl.java
    M model/model-impl/src/test/java/com/evolveum/midpoint/model/impl/correlator/correlation/TestCorrelators.java
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/simulation/AbstractBasicSimulationExecutionTest.java
    M model/model-test/src/main/java/com/evolveum/midpoint/model/test/asserter/ProcessedObjectFinder.java
    M provisioning/provisioning-api/src/main/java/com/evolveum/midpoint/provisioning/api/ShadowSimulationData.java
    M provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/shadows/ClassificationHelper.java
    R provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/simulation/ShadowSimulationDataImpl.java
    M provisioning/provisioning-impl/src/test/java/com/evolveum/midpoint/provisioning/impl/misc/TestResourceLifecycle.java
    M testing/story/src/test/resources/delivery/roles/role-it-5-requires-it-1-elaine.xml
    M testing/story/src/test/resources/delivery/rules/k20.xml

  Log Message:
  -----------
  Make (experimental) correlation simulation working

Simulation of shadows correlation is now implemented on back-end.
The respective deltas are sent to the simulation result.

Notes:

1. Clearing of correlation state before re-starting the correlation was
removed. It is most probably not necessary; and it would complicate
the simulation process.

2. Shadow-simulation mode is not supported when ID Match correlator
is used.

Work in progress. Some tests may fail.


  Commit: afeae51f58b23299bd233686faf3bfdbf09ffef4
      https://github.com/Evolveum/midpoint/commit/afeae51f58b23299bd233686faf3bfdbf09ffef4
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2023-02-09 (Thu, 09 Feb 2023)

  Changed paths:
    M provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/shadows/ClassificationHelper.java

  Log Message:
  -----------
  Weaken an assertion during shadow classification

This should fix failing TestSemiManual in provisioning-impl.


  Commit: 4d3be35a1fa16d5a6b926fad73e1097d5c276996
      https://github.com/Evolveum/midpoint/commit/4d3be35a1fa16d5a6b926fad73e1097d5c276996
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2023-02-09 (Thu, 09 Feb 2023)

  Changed paths:
    M infra/schema/src/main/java/com/evolveum/midpoint/schema/TaskExecutionMode.java
    M infra/schema/src/main/resources/xml/ns/public/common/common-core-3.xsd
    M infra/schema/src/main/resources/xml/ns/public/common/common-tasks-3.xsd
    M model/model-api/src/main/java/com/evolveum/midpoint/model/api/correlator/CorrelatorFactoryRegistry.java
    M model/model-api/src/main/java/com/evolveum/midpoint/model/api/simulation/ProcessedObject.java
    M model/model-api/src/main/java/com/evolveum/midpoint/model/api/simulation/SimulationResultManager.java
    M model/model-common/src/main/java/com/evolveum/midpoint/model/common/MarkManager.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/ModelBeans.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/controller/ModelInteractionServiceImpl.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/correlation/CorrelationServiceImpl.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/correlator/BaseCorrelator.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/correlator/CorrelatorFactoryRegistryImpl.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/correlator/idmatch/IdMatchCorrelator.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/Clockwork.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/ClockworkAuditHelper.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/ElementState.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/LensContext.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/OperationExecutionRecorderForClockwork.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/executor/ChangeModeApplication.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/executor/DeltaExecution.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/executor/LinkUpdater.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/executor/ScriptExecutor.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/simulation/ProcessedObjectImpl.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/simulation/ProcessedObjectsWriter.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/simulation/SimulationResultManagerImpl.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/sync/CorrelationProcessing.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/sync/ShadowUpdater.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/sync/SynchronizationContext.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/sync/SynchronizationServiceImpl.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/sync/tasks/recon/ReconciliationActivityHandler.java
    M model/model-impl/src/test/java/com/evolveum/midpoint/model/impl/correlator/correlation/TestCorrelators.java
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/simulation/AbstractBasicSimulationExecutionTest.java
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/simulation/AbstractSimulationsTest.java
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/simulation/TestDevelopmentSimulations.java
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/simulation/TestProductionSimulations.java
    M model/model-intest/src/test/resources/simulation/resource-simple-development-source.xml
    M model/model-test/src/main/java/com/evolveum/midpoint/model/test/AbstractModelIntegrationTest.java
    M model/model-test/src/main/java/com/evolveum/midpoint/model/test/CommonInitialObjects.java
    M model/model-test/src/main/java/com/evolveum/midpoint/model/test/asserter/ProcessedObjectFinder.java
    M model/model-test/src/main/java/com/evolveum/midpoint/model/test/util/SynchronizationRequest.java
    A provisioning/provisioning-api/src/main/java/com/evolveum/midpoint/provisioning/api/ShadowSimulationData.java
    M provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/ProvisioningContext.java
    M provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/resourceobjects/ResourceObjectConverter.java
    M provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/resources/ResourceManager.java
    M provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/shadows/ClassificationHelper.java
    M provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/shadows/ShadowAddOperation.java
    M provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/shadows/ShadowDeleteOperation.java
    M provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/shadows/ShadowModifyOperation.java
    M provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/shadows/ShadowRefreshHelper.java
    M provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/shadows/sync/LiveSynchronizer.java
    M provisioning/provisioning-impl/src/test/java/com/evolveum/midpoint/provisioning/impl/misc/TestResourceLifecycle.java
    A provisioning/provisioning-impl/src/test/java/com/evolveum/midpoint/provisioning/impl/mock/SimulationResultMock.java
    A provisioning/provisioning-impl/src/test/java/com/evolveum/midpoint/provisioning/impl/mock/SimulationTransactionMock.java
    M provisioning/ucf-api/src/main/java/com/evolveum/midpoint/provisioning/ucf/api/UcfExecutionContext.java
    M provisioning/ucf-api/src/main/java/com/evolveum/midpoint/provisioning/ucf/api/connectors/AbstractManualConnectorInstance.java
    M provisioning/ucf-impl-builtin/src/main/java/com/evolveum/midpoint/provisioning/ucf/impl/builtin/async/provisioning/AsyncProvisioningConnectorInstance.java
    M provisioning/ucf-impl-connid/src/main/java/com/evolveum/midpoint/provisioning/ucf/impl/connid/ConnectorInstanceConnIdImpl.java
    M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/activity/definition/ActivityExecutionModeDefinition.java
    M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/activity/run/AbstractActivityRun.java
    M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/activity/run/IterativeActivityRun.java
    M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/activity/run/LocalActivityRun.java
    M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/activity/run/processing/ProcessingCoordinator.java
    A repo/system-init/src/main/resources/initial-objects/mark/736-mark-shadow-classification-changed.xml
    A repo/system-init/src/main/resources/initial-objects/mark/737-mark-shadow-correlation-state-changed.xml
    M repo/task-api/src/main/java/com/evolveum/midpoint/task/api/Task.java
    M testing/story/src/test/resources/delivery/roles/role-it-5-requires-it-1-elaine.xml
    M testing/story/src/test/resources/delivery/rules/k20.xml

  Log Message:
  -----------
  Merge branch 'tmp/shadow-simulations'


Compare: https://github.com/Evolveum/midpoint/compare/eebbe89dccb8...4d3be35a1fa1


More information about the midPoint-svn mailing list