[midPoint-git] [Evolveum/midpoint] 260443: Improve operation execution recording
mederly
noreply at github.com
Thu Feb 18 16:57:36 CET 2021
Branch: refs/heads/master
Home: https://github.com/Evolveum/midpoint
Commit: 26044356d6895f751191b0498f547945c7bcd0bb
https://github.com/Evolveum/midpoint/commit/26044356d6895f751191b0498f547945c7bcd0bb
Author: Pavol Mederly <mederly at evolveum.com>
Date: 2021-02-17 (Wed, 17 Feb 2021)
Changed paths:
M infra/schema/src/main/resources/xml/ns/public/common/common-core-3.xsd
M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/OperationExecutionRecorderForClockwork.java
M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/reporting/TestTaskReporting.java
M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/ItemProcessingGatekeeper.java
M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/util/OperationExecutionRecorderForTasks.java
M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/util/OperationExecutionWriter.java
Log Message:
-----------
Improve operation execution recording
Now it is more suitable for keeping information objects that failed
processing in tasks:
1) separate simple/complex cleanup and recording options
2) keeping the simple/complex op. execution records from the last
task run only
Work in progress. Does not know of multi-task trees.
Commit: 7aaa974302dd9ca4c9c3f5ffa2fd78a53cf1b8e3
https://github.com/Evolveum/midpoint/commit/7aaa974302dd9ca4c9c3f5ffa2fd78a53cf1b8e3
Author: Pavol Mederly <mederly at evolveum.com>
Date: 2021-02-18 (Thu, 18 Feb 2021)
Changed paths:
M infra/prism-impl/src/main/java/com/evolveum/midpoint/prism/impl/query/builder/R_AtomicFilter.java
M infra/schema/src/main/java/com/evolveum/midpoint/schema/constants/SchemaConstants.java
M infra/schema/src/main/java/com/evolveum/midpoint/schema/util/ObjectQueryUtil.java
M infra/schema/src/main/resources/xml/ns/public/common/common-core-3.xsd
M infra/schema/src/main/resources/xml/ns/public/model/extension-3.xsd
M infra/util/src/main/java/com/evolveum/midpoint/util/MiscUtil.java
M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/tasks/DeleteNotUpdatedShadowTaskHandler.java
M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/tasks/ExecuteChangesTaskHandler.java
M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/tasks/RecomputeTaskHandler.java
M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/tasks/simple/Processing.java
M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/tasks/simple/SimpleIterativeTaskHandler.java
M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/reporting/TestTaskReporting.java
A model/model-intest/src/test/resources/reporting/task-import-retry.xml
M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/AbstractIterativeTaskPartExecution.java
M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/AbstractSearchIterativeItemProcessor.java
M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/AbstractSearchIterativeTaskPartExecution.java
M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/AbstractTaskExecution.java
A repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/FailedObjectsFilterCreator.java
M repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/work/WorkStateManager.java
Log Message:
-----------
Implement failedObjectsSelector for tasks
This is to allow re-processing of previously failed objects, based on
operation execution records. (Not complete, though. Out of three
selection/filtering modes, one is still not implemented.)
Two generally useful util methods added:
1. MiscUtil.asListTreatingNull(T[])
2. ObjectQueryUtil.addConjunctions(..)
Commit: 6c046e22433e269e73b7c761749af5cd93e69c13
https://github.com/Evolveum/midpoint/commit/6c046e22433e269e73b7c761749af5cd93e69c13
Author: Pavol Mederly <mederly at evolveum.com>
Date: 2021-02-18 (Thu, 18 Feb 2021)
Changed paths:
M infra/prism-api/src/main/java/com/evolveum/midpoint/prism/query/builder/S_ConditionEntry.java
M infra/schema/src/main/resources/xml/ns/public/common/common-core-3.xsd
M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/sync/tasks/imp/ImportFromResourceTaskPartExecution.java
M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/tasks/AbstractIterativeModelTaskPartExecution.java
A model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/tasks/ShadowFetchingPreprocessor.java
M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/reporting/TestTaskReporting.java
A model/model-intest/src/test/resources/reporting/task-import-retry-by-fetching.xml
A model/model-intest/src/test/resources/reporting/task-import-retry-by-filtering.xml
R model/model-intest/src/test/resources/reporting/task-import-retry.xml
M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/AbstractSearchIterativeItemProcessor.java
M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/AbstractSearchIterativeTaskPartExecution.java
M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/FailedObjectsFilterCreator.java
A repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/ObjectPreprocessor.java
Log Message:
-----------
Implement "fetchFailedObjects" selection method
Done via (newly added) object preprocessing concept in search-iterative
item processor class.
Commit: 3b56ead7312471342a09487f1f618bd9a8792b8e
https://github.com/Evolveum/midpoint/commit/3b56ead7312471342a09487f1f618bd9a8792b8e
Author: Pavol Mederly <mederly at evolveum.com>
Date: 2021-02-18 (Thu, 18 Feb 2021)
Changed paths:
M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/reporting/TestTaskReporting.java
M provisioning/provisioning-api/src/main/java/com/evolveum/midpoint/provisioning/api/SynchronizationEvent.java
M provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/resourceobjects/ResourceObjectChange.java
M provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/resourceobjects/ResourceObjectFound.java
M provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/shadows/ShadowedChange.java
M provisioning/provisioning-impl/src/test/java/com/evolveum/midpoint/provisioning/impl/dummy/TestDummyNegative.java
M repo/repo-test-util/src/main/java/com/evolveum/midpoint/test/asserter/ShadowAsserter.java
M repo/repo-test-util/src/main/java/com/evolveum/midpoint/test/asserter/prism/PrismObjectAsserter.java
Log Message:
-----------
Add tests for uncreatable shadows (long uid)
Plus some state checks on ShadowedChange.getShadowChangeDescription.
Commit: 889a0b0634588eb0f49755c35461cf69107a8088
https://github.com/Evolveum/midpoint/commit/889a0b0634588eb0f49755c35461cf69107a8088
Author: Pavol Mederly <mederly at evolveum.com>
Date: 2021-02-18 (Thu, 18 Feb 2021)
Changed paths:
M gui/admin-gui/src/main/java/com/evolveum/midpoint/web/util/ExpressionUtil.java
M infra/common/src/main/java/com/evolveum/midpoint/common/StaticExpressionUtil.java
M infra/prism-api/src/main/java/com/evolveum/midpoint/prism/xnode/XNode.java
M infra/prism-api/src/main/java/com/evolveum/prism/xml/ns/_public/types_3/RawType.java
M infra/prism-impl/src/main/java/com/evolveum/midpoint/prism/impl/PrismPropertyValueImpl.java
M infra/prism-impl/src/main/java/com/evolveum/midpoint/prism/impl/marshaller/BeanUnmarshaller.java
M infra/prism-impl/src/test/java/com/evolveum/midpoint/prism/TestFundamentals.java
M infra/schema/src/main/java/com/evolveum/midpoint/schema/DeltaConvertor.java
M infra/schema/src/test/java/com/evolveum/midpoint/schema/TestDeltaConverter.java
M infra/schema/src/test/java/com/evolveum/midpoint/schema/TestJaxbParsing.java
M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/ChangeExecutor.java
M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/sync/TestRecomputeTask.java
M model/model-test/src/main/java/com/evolveum/midpoint/model/test/TaskFinishChecker.java
M pom.xml
M provisioning/ucf-impl-connid/src/test/java/com/evolveum/midpoint/provisioning/ucf/impl/connid/TestUcfOpenDj.java
M provisioning/ucf-impl-connid/src/test/resources/connector-ldap.xml
M repo/repo-sqale/sql/pgnew-repo.sql
M repo/repo-sqale/src/main/java/com/evolveum/midpoint/repo/sqale/SqaleRepositoryBeanConfig.java
M repo/repo-sqale/src/main/java/com/evolveum/midpoint/repo/sqale/qmodel/assignment/QAssignment.java
A repo/repo-sqale/src/main/java/com/evolveum/midpoint/repo/sqale/qmodel/object/MTrigger.java
M repo/repo-sqale/src/main/java/com/evolveum/midpoint/repo/sqale/qmodel/object/QObjectMapping.java
A repo/repo-sqale/src/main/java/com/evolveum/midpoint/repo/sqale/qmodel/object/QTrigger.java
A repo/repo-sqale/src/main/java/com/evolveum/midpoint/repo/sqale/qmodel/object/QTriggerMapping.java
M repo/repo-sqlbase/src/main/java/com/evolveum/midpoint/repo/sqlbase/SqlQueryContext.java
M testing/conntest/src/test/java/com/evolveum/midpoint/testing/conntest/ad/AbstractAdLdapMultidomainTest.java
M testing/schrodingertest/src/test/java/com/evolveum/midpoint/testing/schrodinger/UserTest.java
M testing/schrodingertest/src/test/java/com/evolveum/midpoint/testing/schrodinger/labs/M10ObjectTemplate.java
M testing/schrodingertest/src/test/java/com/evolveum/midpoint/testing/schrodinger/labs/M7SynchronizationFlavours.java
M testing/schrodingertest/src/test/java/com/evolveum/midpoint/testing/schrodinger/labs/M9OrganizationalStructure.java
M testing/schrodingertest/src/test/java/com/evolveum/midpoint/testing/schrodinger/page/TaskPageTest.java
M testing/schrodingertest/src/test/java/com/evolveum/midpoint/testing/schrodinger/scenarios/SynchronizationTests.java
M testing/story/src/test/java/com/evolveum/midpoint/testing/story/consistency/TestConsistencyMechanism.java
Log Message:
-----------
Merge branch 'master' into feature/retry-using-op-execution
Compare: https://github.com/Evolveum/midpoint/compare/0fb4f65ca9ad...889a0b063458
More information about the midPoint-svn
mailing list