[midPoint-git] [Evolveum/midpoint] 6c723d: Add buckets sampling

[mederly]

  Branch: refs/heads/master
  Home:   https://github.com/Evolveum/midpoint
  Commit: 6c723ddfb0c07f4e138d5531390c179e01c1520d
      https://github.com/Evolveum/midpoint/commit/6c723ddfb0c07f4e138d5531390c179e01c1520d
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2021-09-04 (Sat, 04 Sep 2021)

  Changed paths:
    M infra/schema/src/main/java/com/evolveum/midpoint/schema/constants/ExpressionConstants.java
    M infra/schema/src/main/java/com/evolveum/midpoint/schema/util/task/work/BucketingConstants.java
    M infra/schema/src/main/resources/xml/ns/public/common/common-tasks-3.xsd
    A model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/tasks/TestNoOpTask.java
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/tasks/package-info.java
    A model/model-intest/src/test/resources/tasks/noop/task-bucket-analysis-with-condition.xml
    A model/model-intest/src/test/resources/tasks/noop/task-bucket-analysis-with-random-sampling.xml
    A model/model-intest/src/test/resources/tasks/noop/task-bucket-analysis-with-regular-sampling.xml
    M model/model-intest/testng-integration-full.xml
    M model/model-test/src/main/java/com/evolveum/midpoint/model/test/AbstractModelIntegrationTest.java
    M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/activity/Activity.java
    M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/activity/definition/ActivityControlFlowDefinition.java
    M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/IterativeActivityExecution.java
    M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/work/BucketOperation.java
    M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/work/GetBucketOperation.java
    M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/work/GetBucketOperationAttempt.java
    M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/work/ReleaseBucketsOperation.java
    R repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/work/segmentation/BucketAllocator.java
    A repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/task/work/segmentation/BucketFactory.java
    M repo/repo-common/src/test/java/com/evolveum/midpoint/repo/common/tasks/TestBucketingStatic.java

  Log Message:
  -----------
  Add buckets sampling

Buckets sampling allows processing of a subset of buckets only. It is
typically used when analyzing buckets size (to make a quick estimate),
but it's imaginable to use it also for sampling real processing.

Three sampling modes are provided:
1. Regular sampling: the user specifies either sample size or sampling
interval.
2. Probabilistic (random) sampling: the user specifies either desired
sample size or a probability of including a bucket in the sample.
3. Condition-based sampling: the user writes a condition expression.
(This carries an overhead of allocating+completing also skipped buckets,
so it's slower for larger skips.)

Related change:
- A cleanup of BucketAllocator / GetBucketOperationAttempt
combo was required. Now the code is much more clean.

Functional changes:
- Some features (like random bucket allocation) were removed.
They were introduced primarily to lower the contention when
allocating buckets. This reason is no longer relevant.


  Commit: 2f5651432920a74c0d81cf698c5f7df1be7fe89b
      https://github.com/Evolveum/midpoint/commit/2f5651432920a74c0d81cf698c5f7df1be7fe89b
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2021-09-04 (Sat, 04 Sep 2021)

  Changed paths:
    M model/report-impl/src/main/java/com/evolveum/midpoint/report/impl/activity/SaveReportFileSupport.java
    M model/report-impl/src/test/java/com/evolveum/midpoint/report/EmptyReportIntegrationTest.java

  Log Message:
  -----------
  Fix report-impl tests on Windows

The way of finding exported report data files is a bit fragile,
because it depends on specific file naming scheme. The test was now
adapted to a minor change in the scheme that was needed for Windows
environments.


  Commit: 229a5e1494d3b299f8e8049a6209bef299a7759d
      https://github.com/Evolveum/midpoint/commit/229a5e1494d3b299f8e8049a6209bef299a7759d
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2021-09-04 (Sat, 04 Sep 2021)

  Changed paths:
    M repo/repo-sqale/sql/pgnew-experiments.sql
    M repo/repo-sqale/sql/pgnew-repo-audit.sql
    M repo/repo-sqale/src/main/java/com/evolveum/midpoint/repo/sqale/audit/SqaleAuditService.java

  Log Message:
  -----------
  Merge remote-tracking branch 'origin/master'


Compare: https://github.com/Evolveum/midpoint/compare/b423c7dfd739...229a5e1494d3