[midPoint-git] [Evolveum/midpoint] 9bb7d3: Adapt bucketing performance measurement

[mederly]

  Branch: refs/heads/master
  Home:   https://github.com/Evolveum/midpoint
  Commit: 9bb7d3149e7f454bf05755f32d3a278b4e1f33d3
      https://github.com/Evolveum/midpoint/commit/9bb7d3149e7f454bf05755f32d3a278b4e1f33d3
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2021-08-21 (Sat, 21 Aug 2021)

  Changed paths:
    M infra/schema/src/main/java/com/evolveum/midpoint/schema/statistics/ActivityStatisticsUtil.java
    M testing/story/src/test/java/com/evolveum/midpoint/testing/story/buckets/TestBucketsPerformance.java
    M testing/story/src/test/resources/buckets/task-recompute-16-04.xml
    M testing/story/src/test/resources/buckets/task-recompute-256-30.xml

  Log Message:
  -----------
  Adapt bucketing performance measurement

It was adapted to the new activity framework.


  Commit: 7f04fd48389850daafbed2641d92652401e94cda
      https://github.com/Evolveum/midpoint/commit/7f04fd48389850daafbed2641d92652401e94cda
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2021-08-23 (Mon, 23 Aug 2021)

  Changed paths:
    M infra/schema/src/main/java/com/evolveum/midpoint/schema/util/task/BucketingUtil.java
    M infra/schema/src/main/java/com/evolveum/midpoint/schema/util/task/work/BucketingConstants.java
    M infra/schema/src/main/resources/xml/ns/public/common/common-tasks-3.xsd
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/sync/TestSyncStoryUsingReconciliationMultithreaded.java
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/sync/TestSyncStoryUsingReconciliationPartitioned.java
    M model/model-test/src/main/java/com/evolveum/midpoint/model/test/AbstractModelIntegrationTest.java
    M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/IterativeActivityExecution.java
    M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/work/BucketOperation.java
    A repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/work/BucketingConfigurationOverrides.java
    M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/work/BucketingManager.java
    M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/work/CompleteBucketOperation.java
    M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/work/GetBucketOperation.java
    A repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/work/GetBucketOperationAttempt.java
    A repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/work/GetBucketOperationOptions.java
    R repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/work/ReleaseAllBucketsOperation.java
    R repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/work/ReleaseBucketOperation.java
    A repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/work/ReleaseBucketsOperation.java
    M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/work/segmentation/BucketAllocator.java
    M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/work/workers/WorkersReconciliation.java
    M repo/repo-common/src/test/java/com/evolveum/midpoint/repo/common/tasks/TestActivities.java
    M repo/repo-common/src/test/java/com/evolveum/midpoint/repo/common/tasks/TestBucketingLive.java
    M repo/repo-common/src/test/java/com/evolveum/midpoint/repo/common/tasks/TestBucketingStatic.java
    M repo/repo-common/src/test/java/com/evolveum/midpoint/repo/common/tasks/TestWorkerTasks.java
    M repo/repo-common/src/test/resources/tasks/bucketing-static/task-210-1.xml
    M repo/repo-common/src/test/resources/tasks/bucketing-static/task-210-c.xml
    M repo/repo-test-util/src/main/java/com/evolveum/midpoint/test/AbstractIntegrationTest.java
    M repo/task-api/src/main/java/com/evolveum/midpoint/task/api/RunningTask.java
    M repo/task-api/src/main/java/com/evolveum/midpoint/task/api/TaskManager.java
    M repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/RunningLightweightTaskImpl.java
    M repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/RunningTaskQuartzImpl.java
    M repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/TaskManagerQuartzImpl.java
    M repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/run/JobExecutor.java
    M repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/tasks/TaskInstantiator.java
    M repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/tasks/TaskRetriever.java
    M testing/story/src/test/java/com/evolveum/midpoint/testing/story/TestThresholds.java

  Log Message:
  -----------
  Stop maintaining buckets in worker tasks

It seems that careful and systematic use of modifyObjectDynamically
obsoletes the original design of "borrowing" buckets from coordinator
and storing them in workers.

So this commit:

1) Stops storing buckets in the worker tasks.
2) Migrates all bucket management operations to modifyObjectDynamically
mechanism.

This simplifies the bucketing code, makes it more robust, and reduces
the number of repository operations (e.g. it eliminates all getObject
operations when manipulating the buckets).

Related changes:
- RunningTask has now a reference to (resolved) parent task.


  Commit: 210c3dab459ffcf12713d26cf666d1ad62b1a73d
      https://github.com/Evolveum/midpoint/commit/210c3dab459ffcf12713d26cf666d1ad62b1a73d
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2021-08-23 (Mon, 23 Aug 2021)

  Changed paths:
    M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/IterativeActivityExecution.java
    M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/PlainIterativeActivityExecution.java
    M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/PlainIterativeActivityExecutionSpecifics.java
    M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/SearchBasedActivityExecution.java

  Log Message:
  -----------
  Merge remote-tracking branch 'origin/master'

# Conflicts:
#	repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/IterativeActivityExecution.java


Compare: https://github.com/Evolveum/midpoint/compare/6b666f2db3d8...210c3dab459f