[midPoint-git] [Evolveum/midpoint] 56767a: Add midpoint.nodeIdSource parameter (MID-5057)

Mon Feb 11 11:17:05 CET 2019

  Branch: refs/heads/tmp/fixes-for-vilo-new
  Home:   https://github.com/Evolveum/midpoint
  Commit: 56767a2f9bd9878acfb1b7dc8c0d9fb61c26defc
      https://github.com/Evolveum/midpoint/commit/56767a2f9bd9878acfb1b7dc8c0d9fb61c26defc
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2019-02-11 (Mon, 11 Feb 2019)

  Changed paths:
    M infra/common/src/main/java/com/evolveum/midpoint/common/configuration/api/MidpointConfiguration.java
    M repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/TaskManagerConfiguration.java
    M repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/cluster/NodeRegistrar.java

  Log Message:
  -----------
  Add midpoint.nodeIdSource parameter (MID-5057)

It is used to provide nodeId from a specified source (hostname, random).

(cherry picked from commit 5c4839664f4193893483158cd43ab0d3a465ef22)

  Commit: 599fb5f3a0fe535835223f71b04eadd16ab11e38
      https://github.com/Evolveum/midpoint/commit/599fb5f3a0fe535835223f71b04eadd16ab11e38
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2019-02-11 (Mon, 11 Feb 2019)

  Changed paths:
    M model/workflow-impl/src/main/java/com/evolveum/midpoint/wf/impl/processors/primary/WfPrepareChildOperationTaskHandler.java
    M model/workflow-impl/src/main/java/com/evolveum/midpoint/wf/impl/processors/primary/WfPrepareRootOperationTaskHandler.java
    M model/workflow-impl/src/main/java/com/evolveum/midpoint/wf/impl/processors/primary/WfPropagateTaskObjectReferenceTaskHandler.java
    M model/workflow-impl/src/main/java/com/evolveum/midpoint/wf/impl/tasks/WfProcessInstanceShadowTaskHandler.java
    M model/workflow-impl/src/main/java/com/evolveum/midpoint/wf/impl/tasks/WfTask.java
    M model/workflow-impl/src/main/java/com/evolveum/midpoint/wf/impl/tasks/WfTaskUtil.java
    M repo/repo-sql-impl-test/src/test/java/com/evolveum/midpoint/repo/sql/util/SimpleTaskAdapter.java
    M repo/task-api/src/main/java/com/evolveum/midpoint/task/api/Task.java
    M repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/TaskQuartzImpl.java

  Log Message:
  -----------
  Treat tasks with no result (MID-5109)

A bug in reindex operation leaves tasks without operation results,
causing problems especially for workflow tasks. This commit allows
workflows to correctly deal with no-result tasks.

(cherry picked from commit b183de7cee6b33ddd0ce78a74a2472972111f450)

  Commit: f1ed0f7077134d4e5b5bb986e30424bff8332821
      https://github.com/Evolveum/midpoint/commit/f1ed0f7077134d4e5b5bb986e30424bff8332821
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2019-02-11 (Mon, 11 Feb 2019)

  Changed paths:
    M gui/admin-gui/src/main/java/com/evolveum/midpoint/gui/impl/util/ReportPeerQueryInterceptor.java
    M infra/schema/src/main/resources/xml/ns/public/common/common-core-3.xsd
    M model/model-api/src/main/java/com/evolveum/midpoint/model/api/TaskService.java
    M model/model-api/src/main/java/com/evolveum/midpoint/model/api/authentication/NodeAuthenticationEvaluator.java
    M model/model-common/pom.xml
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/ClusterCacheListener.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/ModelRestService.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/controller/ModelController.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/security/MidpointRestAuthenticationHandler.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/security/NodeAuthenticationEvaluatorImpl.java
    R model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/security/RestAuthenticationMethod.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/util/RestServiceUtil.java
    M model/model-test/pom.xml
    M provisioning/provisioning-impl/pom.xml
    M provisioning/ucf-impl-connid/pom.xml
    M repo/repo-common/pom.xml
    M repo/repo-sql-impl/pom.xml
    A repo/security-api/src/main/java/com/evolveum/midpoint/security/api/RestAuthenticationMethod.java
    M repo/security-api/src/main/java/com/evolveum/midpoint/security/api/SecurityUtil.java
    M repo/task-api/pom.xml
    A repo/task-api/src/main/java/com/evolveum/midpoint/task/api/RemoteExecutionHelper.java
    M repo/task-api/src/main/java/com/evolveum/midpoint/task/api/TaskManager.java
    M repo/task-quartz-impl/pom.xml
    M repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/TaskManagerConfiguration.java
    M repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/TaskManagerQuartzImpl.java
    M repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/cluster/ClusterStatusInformation.java
    M repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/cluster/NodeRegistrar.java
    A repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/cluster/RemoteExecutionHelperImpl.java
    M repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/execution/ExecutionManager.java
    M repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/execution/LocalNodeManager.java
    M repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/execution/RemoteNodesManager.java
    A repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/execution/remote/JmxConnector.java
    A repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/execution/remote/RestConnector.java
    M samples/tasks/task-scheduling.xml
    M testing/sanity/src/test/java/com/evolveum/midpoint/testing/sanity/TestSanity.java

  Log Message:
  -----------
  Add REST support for task manager communication

This is a preliminary implementation of MID-5058.

Major changes:
1) task manager communication can be switched between JMX and REST
2) intra-cluster authentication is now protected by a node-level secret
3) RemoteExecutor is a helper class to enable making REST intra-cluster
calls

Major TODOs:
- separate internally used functionality from the main REST service
- reduce amount of information sent between nodes

(cherry picked from commit 4c453ad952040768466a1c75a659143e541d336e)

  Commit: 74a836213401a8d9a7a84640c85a1b5a811b1bfd
      https://github.com/Evolveum/midpoint/commit/74a836213401a8d9a7a84640c85a1b5a811b1bfd
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2019-02-11 (Mon, 11 Feb 2019)

  Changed paths:
    R gui/admin-gui/src/main/java/com/evolveum/midpoint/gui/impl/util/ReportPeerQueryInterceptor.java
    M gui/admin-gui/src/main/java/com/evolveum/midpoint/web/boot/MidPointSpringApplication.java
    M model/model-api/src/main/java/com/evolveum/midpoint/model/api/TaskService.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/ClusterCacheListener.java
    A model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/ClusterRestService.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/ModelRestService.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/controller/ModelController.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/util/RestServiceUtil.java
    M model/model-impl/src/main/resources/ctx-model.xml
    M model/report-impl/src/main/java/com/evolveum/midpoint/report/impl/ReportManagerImpl.java
    R model/report-impl/src/main/java/com/evolveum/midpoint/report/impl/ReportNodeUtils.java
    A repo/task-api/src/main/java/com/evolveum/midpoint/task/api/ClusterExecutionHelper.java
    R repo/task-api/src/main/java/com/evolveum/midpoint/task/api/RemoteExecutionHelper.java
    M repo/task-api/src/main/java/com/evolveum/midpoint/task/api/TaskConstants.java
    M repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/TaskManagerQuartzImpl.java
    A repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/cluster/ClusterExecutionHelperImpl.java
    R repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/cluster/RemoteExecutionHelperImpl.java
    M repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/execution/remote/RestConnector.java

  Log Message:
  -----------
  Polish intra-cluster REST communication

Continuing implementation of MID-5058 here we:
1) move intra-cluster methods from ModelRestService to ClusterRestService
2) unify report files handling with the other intra-cluster calls

(cherry picked from commit f0fdea1e6e8ed8c8c1a874810e65d103a4c4a3c9)

  Commit: d022332c203818f219e540d2ff149d71fdd6461f
      https://github.com/Evolveum/midpoint/commit/d022332c203818f219e540d2ff149d71fdd6461f
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2019-02-11 (Mon, 11 Feb 2019)

  Changed paths:
    M model/report-impl/pom.xml

  Log Message:
  -----------
  Fix report-impl dependencies

(cherry picked from commit 033d47c786bdc13b18297e895eaeda058831a15c)

  Commit: 0fda9568496a9cad427eaeecd2ee8c6dedf4eb7c
      https://github.com/Evolveum/midpoint/commit/0fda9568496a9cad427eaeecd2ee8c6dedf4eb7c
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2019-02-11 (Mon, 11 Feb 2019)

  Changed paths:
    M infra/schema/src/main/resources/xml/ns/public/common/common-core-3.xsd
    M repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/execution/ExecutionManager.java
    M repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/execution/LocalNodeManager.java

  Log Message:
  -----------
  Optimize clusterwide querying of scheduler status

Not important and security-sensitive information were left out.
This is part of MID-5058.

(cherry picked from commit 7951452f2d784807454856db9a7e2f819d9c04dc)

  Commit: 295d4ffda3f1cdfd27101514afc3885a5471537a
      https://github.com/Evolveum/midpoint/commit/295d4ffda3f1cdfd27101514afc3885a5471537a
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2019-02-11 (Mon, 11 Feb 2019)

  Changed paths:
    M gui/admin-gui/src/main/java/com/evolveum/midpoint/web/page/admin/server/PageTasks.java
    M gui/admin-gui/src/main/java/com/evolveum/midpoint/web/page/admin/server/dto/NodeDto.java
    M gui/admin-gui/src/main/java/com/evolveum/midpoint/web/security/MidPointApplication.java
    M gui/admin-gui/src/main/resources/localization/Midpoint.properties
    M infra/common/src/main/java/com/evolveum/midpoint/common/configuration/api/MidpointConfiguration.java
    M infra/schema/src/main/resources/xml/ns/public/common/common-core-3.xsd
    M repo/task-api/src/main/java/com/evolveum/midpoint/task/api/TaskManager.java
    M repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/TaskManagerConfiguration.java
    M repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/TaskManagerQuartzImpl.java
    M repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/cluster/ClusterExecutionHelperImpl.java
    M repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/cluster/NodeRegistrar.java

  Log Message:
  -----------
  Cleanup of JMX->REST replacement (MID-5058)

All components are in now place and finished. Implemented auto-detection
of intra-cluster HTTP URL. Remaining traces of JMX were hidden.

(cherry picked from commit d2f43acedb4386166950644d8f31320e50956617)

  Commit: e732bd4d87595aba0dd8b421d3d5c1ec2e9b3a97
      https://github.com/Evolveum/midpoint/commit/e732bd4d87595aba0dd8b421d3d5c1ec2e9b3a97
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2019-02-11 (Mon, 11 Feb 2019)

  Changed paths:
    M testing/story/src/test/java/com/evolveum/midpoint/testing/story/TestConsistencyMechanism.java

  Log Message:
  -----------
  Adapt TestConsistencyMechanism story test

(cherry picked from commit 0a1820c1a20346ce428c89555d708d7963c5186d)

  Commit: 1988f84f924afdf1a28cc9898e111018f9e89107
      https://github.com/Evolveum/midpoint/commit/1988f84f924afdf1a28cc9898e111018f9e89107
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2019-02-11 (Mon, 11 Feb 2019)

  Changed paths:
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/util/DeleteTaskHandler.java

  Log Message:
  -----------
  Make DeleteTaskHandler stoppable (MID-5134)

Originally this task handler did not watch for task.canRun()
as it should.

(cherry picked from commit df6b34aedd77341c4f59f2f0947f530fa466c4eb)

  Commit: bffbd35f03f26870b43231f6a9541439accec0b1
      https://github.com/Evolveum/midpoint/commit/bffbd35f03f26870b43231f6a9541439accec0b1
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2019-02-11 (Mon, 11 Feb 2019)

  Changed paths:
    A gui/admin-gui/src/main/java/com/evolveum/midpoint/web/page/admin/configuration/InternalsThreadsPanel.html
    A gui/admin-gui/src/main/java/com/evolveum/midpoint/web/page/admin/configuration/InternalsThreadsPanel.java
    M gui/admin-gui/src/main/java/com/evolveum/midpoint/web/page/admin/configuration/PageInternals.java
    M gui/admin-gui/src/main/resources/localization/Midpoint.properties
    M infra/schema/src/main/java/com/evolveum/midpoint/schema/constants/SchemaConstants.java
    M infra/schema/src/main/resources/xml/ns/public/common/common-core-3.xsd
    M infra/util/src/main/java/com/evolveum/midpoint/util/MiscUtil.java
    M model/model-api/src/main/java/com/evolveum/midpoint/model/api/ModelAuthorizationAction.java
    M model/model-api/src/main/java/com/evolveum/midpoint/model/api/TaskService.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/ModelRestService.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/controller/ModelController.java
    M repo/repo-api/src/main/java/com/evolveum/midpoint/repo/api/RepositoryService.java
    M repo/repo-cache/src/main/java/com/evolveum/midpoint/repo/cache/RepositoryCache.java
    M repo/repo-sql-impl/src/main/java/com/evolveum/midpoint/repo/sql/SqlRepositoryServiceImpl.java
    M repo/task-api/src/main/java/com/evolveum/midpoint/task/api/TaskManager.java
    M repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/TaskManagerQuartzImpl.java
    M repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/TaskQuartzImpl.java
    M repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/execution/ExecutionManager.java
    M repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/execution/JobExecutor.java
    M repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/execution/LocalNodeManager.java
    M repo/task-quartz-impl/src/main/java/com/evolveum/midpoint/task/quartzimpl/execution/StalledTasksWatcher.java
    A samples/tasks/bulk-actions/script-delay-for-testing-thread-dumps.xml

  Log Message:
  -----------
  Add "thread dump" functionality (GUI, REST)

Thread dumps now can be requested via GUI or via REST. They can
be global (all threads) or related to running tasks only. Dumps
can be displayed or attached to respective tasks as diagnostic
information.

Compare: https://github.com/Evolveum/midpoint/compare/56767a2f9bd9%5E...bffbd35f03f2