[midPoint-git] [Evolveum/midpoint] fea577: LegacyValidator: added support for Containerable

Thu Dec 9 19:48:30 CET 2021

  Branch: refs/heads/master
  Home:   https://github.com/Evolveum/midpoint
  Commit: fea57785092e7fb8813c4d25916f7f65656e669f
      https://github.com/Evolveum/midpoint/commit/fea57785092e7fb8813c4d25916f7f65656e669f
  Author: Richard Richter <richard.richter at evolveum.com>
  Date:   2021-12-06 (Mon, 06 Dec 2021)

  Changed paths:
    M gui/admin-gui/src/main/java/com/evolveum/midpoint/gui/api/page/PageBase.java
    M infra/common/src/main/java/com/evolveum/midpoint/common/validator/EventHandler.java
    M infra/common/src/main/java/com/evolveum/midpoint/common/validator/LegacyValidator.java
    M infra/common/src/test/java/com/evolveum/midpoint/validator/test/BasicValidatorTest.java
    M infra/common/src/test/java/com/evolveum/midpoint/validator/test/UnknownNodeValidationTest.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/importer/ObjectImporter.java
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/TestResources.java
    M tools/ninja/src/main/java/com/evolveum/midpoint/ninja/action/worker/ImportProducerWorker.java

  Log Message:
  -----------
  LegacyValidator: added support for Containerable

EventHandler parameter migrated from PrismContainer to Containerable.
It's very messy to work with PrismContainer vs its values (which is
needed in case of AuditEventRecordType import in Ninja), on the other
hand it's easy to switch back to prism world from Containerable
or Objectable if needed.

  Commit: 1cd12d08e77a8ed69981574accfd4dbb788d9270
      https://github.com/Evolveum/midpoint/commit/1cd12d08e77a8ed69981574accfd4dbb788d9270
  Author: Richard Richter <richard.richter at evolveum.com>
  Date:   2021-12-07 (Tue, 07 Dec 2021)

  Changed paths:
    M config/sql/native-new/postgres-new.sql

  Log Message:
  -----------
  new repo SQL: create trigger EXECUTE PROCEDURE -> FUNCTION

This is no change in function, only making the trigger declarations
more PG explicit, triggers are always functions.

  Commit: 3a8baaf759b8093ccdc14686843055a25fb43627
      https://github.com/Evolveum/midpoint/commit/3a8baaf759b8093ccdc14686843055a25fb43627
  Author: Richard Richter <richard.richter at evolveum.com>
  Date:   2021-12-07 (Tue, 07 Dec 2021)

  Changed paths:
    M config/sql/native-new/postgres-new-audit.sql
    M config/sql/native-new/postgres-new-upgrade-audit.sql
    M config/sql/native-new/postgres-new-upgrade.sql

  Log Message:
  -----------
  new repo audit: added support for partition creation in the past

  Commit: 2e99dc72fbdf24e202b8df832868ed21fb5d2f9e
      https://github.com/Evolveum/midpoint/commit/2e99dc72fbdf24e202b8df832868ed21fb5d2f9e
  Author: Richard Richter <richard.richter at evolveum.com>
  Date:   2021-12-07 (Tue, 07 Dec 2021)

  Changed paths:
    M config/sql/native-new/postgres-new-audit.sql
    M config/sql/native-new/postgres-new-upgrade-audit.sql

  Log Message:
  -----------
  new repo audit: ID is always generated and MUST NOT be provided by app

  Commit: 3dd15b587132e0abcc9adb98b19dcbbfa7fdf60a
      https://github.com/Evolveum/midpoint/commit/3dd15b587132e0abcc9adb98b19dcbbfa7fdf60a
  Author: Richard Richter <richard.richter at evolveum.com>
  Date:   2021-12-07 (Tue, 07 Dec 2021)

  Changed paths:
    M repo/repo-sqale/src/main/java/com/evolveum/midpoint/repo/sqale/audit/SqaleAuditService.java
    M repo/repo-sqale/src/test/java/com/evolveum/midpoint/repo/sqale/SqaleRepoBaseTest.java
    M repo/repo-sqale/src/test/java/com/evolveum/midpoint/repo/sqale/func/AuditCleanupTest.java
    M repo/repo-sqale/src/test/java/com/evolveum/midpoint/repo/sqale/func/AuditDeltaOperationResultTest.java
    M repo/repo-sqale/src/test/java/com/evolveum/midpoint/repo/sqale/func/AuditSearchTest.java
    M repo/repo-sqale/src/test/java/com/evolveum/midpoint/repo/sqale/func/SqaleAuditSearchIterativeTest.java
    M repo/repo-sqale/src/test/java/com/evolveum/midpoint/repo/sqale/func/SqaleRepoSmokeTest.java

  Log Message:
  -----------
  SqaleAuditService#audit() ignores provided ID and returns assigned by DB

Tests of simple + reused audit ID were added to SqaleRepoSmokeTest.

  Commit: e43acbe04e050b4d2b5c7481d6158957141ea690
      https://github.com/Evolveum/midpoint/commit/e43acbe04e050b4d2b5c7481d6158957141ea690
  Author: Richard Richter <richard.richter at evolveum.com>
  Date:   2021-12-07 (Tue, 07 Dec 2021)

  Changed paths:
    R tools/ninja/src/main/java/com/evolveum/midpoint/ninja/action/audit/AuditExportProducerWorker.java
    M tools/ninja/src/main/java/com/evolveum/midpoint/ninja/action/audit/ExportAuditConsumerWorker.java
    A tools/ninja/src/main/java/com/evolveum/midpoint/ninja/action/audit/ExportAuditProducerWorker.java
    M tools/ninja/src/main/java/com/evolveum/midpoint/ninja/action/audit/ExportAuditRepositoryAction.java

  Log Message:
  -----------
  ninja: ExportAudit* code cleanup and class rename for consistency

  Commit: 17cb34d368ee8a40e70c5561e55ccbf19de4abc6
      https://github.com/Evolveum/midpoint/commit/17cb34d368ee8a40e70c5561e55ccbf19de4abc6
  Author: Richard Richter <richard.richter at evolveum.com>
  Date:   2021-12-07 (Tue, 07 Dec 2021)

  Changed paths:
    M config/sql/native-new/postgres-new-audit.sql
    M config/sql/native-new/postgres-new-upgrade-audit.sql
    M config/sql/native-new/postgres-new-upgrade.sql
    M repo/repo-sqale/src/main/java/com/evolveum/midpoint/repo/sqale/audit/SqaleAuditService.java
    M repo/repo-sqale/src/test/java/com/evolveum/midpoint/repo/sqale/func/SqaleRepoSmokeTest.java
    M repo/repo-sql-impl/src/main/java/com/evolveum/midpoint/repo/sql/SqlAuditServiceImpl.java

  Log Message:
  -----------
  new audit ID generation rethought, we want to use SERIAL after all

Import must respect existing ID, because there is no other unique key
that prevents importing duplicates.

  Commit: 5c68e82cdb3d022e463a115b81867b4a3f9941cb
      https://github.com/Evolveum/midpoint/commit/5c68e82cdb3d022e463a115b81867b4a3f9941cb
  Author: Richard Richter <richard.richter at evolveum.com>
  Date:   2021-12-07 (Tue, 07 Dec 2021)

  Changed paths:
    M repo/audit-api/src/main/java/com/evolveum/midpoint/audit/api/AuditEventRecord.java
    A tools/ninja/src/main/java/com/evolveum/midpoint/ninja/action/audit/ImportAuditConsumerWorker.java
    A tools/ninja/src/main/java/com/evolveum/midpoint/ninja/action/audit/ImportAuditRepositoryAction.java
    M tools/ninja/src/main/java/com/evolveum/midpoint/ninja/impl/Command.java

  Log Message:
  -----------
  first version of audit import; it works, but rework is on the way...

...we will try to use AERType in new audit() method directly, which
should be more straightforward than going from AERType to AER and back.

  Commit: 5a6b216fce124ec15d1547745281d01d2a0c4f3b
      https://github.com/Evolveum/midpoint/commit/5a6b216fce124ec15d1547745281d01d2a0c4f3b
  Author: Richard Richter <richard.richter at evolveum.com>
  Date:   2021-12-07 (Tue, 07 Dec 2021)

  Changed paths:
    M infra/schema/src/main/java/com/evolveum/midpoint/schema/DeltaConvertor.java
    M repo/audit-api/src/main/java/com/evolveum/midpoint/audit/api/AuditService.java
    M repo/audit-log-impl/src/main/java/com/evolveum/midpoint/audit/impl/LoggerAuditServiceImpl.java
    M repo/repo-sqale/src/main/java/com/evolveum/midpoint/repo/sqale/audit/SqaleAuditService.java
    M repo/repo-sql-impl/src/main/java/com/evolveum/midpoint/repo/sql/SqlAuditServiceImpl.java
    M repo/repo-sql-impl/src/main/java/com/evolveum/midpoint/repo/sql/audit/beans/MAuditEventRecord.java
    M repo/repo-sql-impl/src/main/java/com/evolveum/midpoint/repo/sql/audit/mapping/QAuditEventRecordMapping.java
    M repo/repo-test-util/src/main/java/com/evolveum/midpoint/test/DummyAuditService.java
    M repo/system-init/src/main/java/com/evolveum/midpoint/init/AuditServiceProxy.java
    M tools/ninja/src/main/java/com/evolveum/midpoint/ninja/action/audit/ImportAuditConsumerWorker.java

  Log Message:
  -----------
  ninja importAudit: reworked to new AuditService.audit(AERType)

Implemented for old repo first, mostly for testing purposes.

  Commit: b35435e88dda15e1c0b0effacbc617038a037eb5
      https://github.com/Evolveum/midpoint/commit/b35435e88dda15e1c0b0effacbc617038a037eb5
  Author: Richard Richter <richard.richter at evolveum.com>
  Date:   2021-12-08 (Wed, 08 Dec 2021)

  Changed paths:
    M repo/repo-sqale/src/main/java/com/evolveum/midpoint/repo/sqale/SqaleRepoContext.java
    M repo/repo-sqale/src/main/java/com/evolveum/midpoint/repo/sqale/audit/SqaleAuditService.java
    M repo/repo-sqale/src/main/java/com/evolveum/midpoint/repo/sqale/audit/qmodel/MAuditDelta.java
    M repo/repo-sqale/src/main/java/com/evolveum/midpoint/repo/sqale/audit/qmodel/QAuditDelta.java

  Log Message:
  -----------
  new repo: MAuditDelta.deltaType migrated to ChangeTypeType

Previously used ChangeType is not "XML" bean, all other enums are.
The values are the same, no changes in the DB are needed.

  Commit: 635851149142839d2a170f470cc9f7e165242a19
      https://github.com/Evolveum/midpoint/commit/635851149142839d2a170f470cc9f7e165242a19
  Author: Richard Richter <richard.richter at evolveum.com>
  Date:   2021-12-08 (Wed, 08 Dec 2021)

  Changed paths:
    M repo/repo-sqale/src/test/resources/schema/extension.xsd

  Log Message:
  -----------
  sqale tests extension.xsd: items are marked as non-required

This makes it easier for copy/paste into experimental deployments and
actually run midpoint with it.

  Commit: 5b396ca5fc4ef5f4a436e8e1fdf0cb85cd292317
      https://github.com/Evolveum/midpoint/commit/5b396ca5fc4ef5f4a436e8e1fdf0cb85cd292317
  Author: Richard Richter <richard.richter at evolveum.com>
  Date:   2021-12-09 (Thu, 09 Dec 2021)

  Changed paths:
    M repo/audit-api/src/main/java/com/evolveum/midpoint/audit/api/AuditEventRecord.java
    M repo/audit-api/src/main/java/com/evolveum/midpoint/audit/api/AuditService.java
    A repo/repo-sqale/src/main/java/com/evolveum/midpoint/repo/sqale/audit/AuditInsertion.java
    M repo/repo-sqale/src/main/java/com/evolveum/midpoint/repo/sqale/audit/SqaleAuditService.java
    M repo/repo-sqale/src/main/java/com/evolveum/midpoint/repo/sqale/audit/qmodel/QAuditEventRecordMapping.java

  Log Message:
  -----------
  new audit: implemented audit(AERType), most of it in new AuditInsertion

  Commit: 7e9f860f6cbfc88e2c53a196a6ea0c31d2359c6e
      https://github.com/Evolveum/midpoint/commit/7e9f860f6cbfc88e2c53a196a6ea0c31d2359c6e
  Author: Richard Richter <richard.richter at evolveum.com>
  Date:   2021-12-09 (Thu, 09 Dec 2021)

  Changed paths:
    M tools/ninja/src/main/java/com/evolveum/midpoint/ninja/action/audit/ExportAuditConsumerWorker.java

  Log Message:
  -----------
  ninja exportAudit fixes, reference names are serialized

But there is a problem for RawType refs inside deltas which still put
names only to comments ignored on the import side!

  Commit: d007b9fa485c3e8321e32df63f5acb4a3f7c2302
      https://github.com/Evolveum/midpoint/commit/d007b9fa485c3e8321e32df63f5acb4a3f7c2302
  Author: Richard Richter <richard.richter at evolveum.com>
  Date:   2021-12-09 (Thu, 09 Dec 2021)

  Changed paths:
    M infra/schema/src/main/java/com/evolveum/midpoint/schema/util/ExceptionUtil.java
    M tools/ninja/src/main/java/com/evolveum/midpoint/ninja/action/audit/ImportAuditConsumerWorker.java

  Log Message:
  -----------
  ninja importAudit tweaks for new repo, shorter message if PK exists

  Commit: 625c3f21d13d61e5e7a00dacc95b6f1e8a9e7786
      https://github.com/Evolveum/midpoint/commit/625c3f21d13d61e5e7a00dacc95b6f1e8a9e7786
  Author: Richard Richter <richard.richter at evolveum.com>
  Date:   2021-12-09 (Thu, 09 Dec 2021)

  Changed paths:
    M tools/ninja/src/main/java/com/evolveum/midpoint/ninja/impl/NinjaContext.java
    M tools/ninja/src/main/java/com/evolveum/midpoint/ninja/opts/ConnectionOptions.java
    R tools/ninja/src/main/java/com/evolveum/midpoint/ninja/util/InitializationBeanPostprocessor.java

  Log Message:
  -----------
  ninja: fix for ignored -U, -u, -p params

InitializationBeanPostprocessor does not process MidpointConfiguration
(probably because some MP init changes), but the same can be achieved
by System.setProperty(...), so it's simpler now.

  Commit: 9162105d1318d913310262d3d42e15ddc4b006d6
      https://github.com/Evolveum/midpoint/commit/9162105d1318d913310262d3d42e15ddc4b006d6
  Author: Richard Richter <richard.richter at evolveum.com>
  Date:   2021-12-09 (Thu, 09 Dec 2021)

  Changed paths:
    M tools/ninja/pom.xml

  Log Message:
  -----------
  ninja: removed unused deps after gone InitializationBeanPostprocessor

  Commit: e2f1771bb31d8268553885c92362767a6195f803
      https://github.com/Evolveum/midpoint/commit/e2f1771bb31d8268553885c92362767a6195f803
  Author: Richard Richter <richard.richter at evolveum.com>
  Date:   2021-12-09 (Thu, 09 Dec 2021)

  Changed paths:
    M config/sql/native-new/postgres-new-audit.sql
    M config/sql/native-new/postgres-new-upgrade-audit.sql
    M config/sql/native-new/postgres-new-upgrade.sql
    M config/sql/native-new/postgres-new.sql
    M gui/admin-gui/src/main/java/com/evolveum/midpoint/gui/api/page/PageBase.java
    M infra/common/src/main/java/com/evolveum/midpoint/common/validator/EventHandler.java
    M infra/common/src/main/java/com/evolveum/midpoint/common/validator/LegacyValidator.java
    M infra/common/src/test/java/com/evolveum/midpoint/validator/test/BasicValidatorTest.java
    M infra/common/src/test/java/com/evolveum/midpoint/validator/test/UnknownNodeValidationTest.java
    M infra/schema/src/main/java/com/evolveum/midpoint/schema/DeltaConvertor.java
    M infra/schema/src/main/java/com/evolveum/midpoint/schema/util/ExceptionUtil.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/importer/ObjectImporter.java
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/TestResources.java
    M repo/audit-api/src/main/java/com/evolveum/midpoint/audit/api/AuditEventRecord.java
    M repo/audit-api/src/main/java/com/evolveum/midpoint/audit/api/AuditService.java
    M repo/audit-log-impl/src/main/java/com/evolveum/midpoint/audit/impl/LoggerAuditServiceImpl.java
    M repo/repo-sqale/src/main/java/com/evolveum/midpoint/repo/sqale/SqaleRepoContext.java
    A repo/repo-sqale/src/main/java/com/evolveum/midpoint/repo/sqale/audit/AuditInsertion.java
    M repo/repo-sqale/src/main/java/com/evolveum/midpoint/repo/sqale/audit/SqaleAuditService.java
    M repo/repo-sqale/src/main/java/com/evolveum/midpoint/repo/sqale/audit/qmodel/MAuditDelta.java
    M repo/repo-sqale/src/main/java/com/evolveum/midpoint/repo/sqale/audit/qmodel/QAuditDelta.java
    M repo/repo-sqale/src/main/java/com/evolveum/midpoint/repo/sqale/audit/qmodel/QAuditEventRecordMapping.java
    M repo/repo-sqale/src/test/java/com/evolveum/midpoint/repo/sqale/SqaleRepoBaseTest.java
    M repo/repo-sqale/src/test/java/com/evolveum/midpoint/repo/sqale/func/AuditCleanupTest.java
    M repo/repo-sqale/src/test/java/com/evolveum/midpoint/repo/sqale/func/AuditDeltaOperationResultTest.java
    M repo/repo-sqale/src/test/java/com/evolveum/midpoint/repo/sqale/func/AuditSearchTest.java
    M repo/repo-sqale/src/test/java/com/evolveum/midpoint/repo/sqale/func/SqaleAuditSearchIterativeTest.java
    M repo/repo-sqale/src/test/java/com/evolveum/midpoint/repo/sqale/func/SqaleRepoSmokeTest.java
    M repo/repo-sqale/src/test/resources/schema/extension.xsd
    M repo/repo-sql-impl/src/main/java/com/evolveum/midpoint/repo/sql/SqlAuditServiceImpl.java
    M repo/repo-sql-impl/src/main/java/com/evolveum/midpoint/repo/sql/audit/beans/MAuditEventRecord.java
    M repo/repo-sql-impl/src/main/java/com/evolveum/midpoint/repo/sql/audit/mapping/QAuditEventRecordMapping.java
    M repo/repo-test-util/src/main/java/com/evolveum/midpoint/test/DummyAuditService.java
    M repo/system-init/src/main/java/com/evolveum/midpoint/init/AuditServiceProxy.java
    M tools/ninja/pom.xml
    R tools/ninja/src/main/java/com/evolveum/midpoint/ninja/action/audit/AuditExportProducerWorker.java
    M tools/ninja/src/main/java/com/evolveum/midpoint/ninja/action/audit/ExportAuditConsumerWorker.java
    A tools/ninja/src/main/java/com/evolveum/midpoint/ninja/action/audit/ExportAuditProducerWorker.java
    M tools/ninja/src/main/java/com/evolveum/midpoint/ninja/action/audit/ExportAuditRepositoryAction.java
    A tools/ninja/src/main/java/com/evolveum/midpoint/ninja/action/audit/ImportAuditConsumerWorker.java
    A tools/ninja/src/main/java/com/evolveum/midpoint/ninja/action/audit/ImportAuditRepositoryAction.java
    M tools/ninja/src/main/java/com/evolveum/midpoint/ninja/action/worker/ImportProducerWorker.java
    M tools/ninja/src/main/java/com/evolveum/midpoint/ninja/impl/Command.java
    M tools/ninja/src/main/java/com/evolveum/midpoint/ninja/impl/NinjaContext.java
    M tools/ninja/src/main/java/com/evolveum/midpoint/ninja/opts/ConnectionOptions.java
    R tools/ninja/src/main/java/com/evolveum/midpoint/ninja/util/InitializationBeanPostprocessor.java

  Log Message:
  -----------
  Merge branch 'feature/ninja-audit'

Compare: https://github.com/Evolveum/midpoint/compare/600c1566787b...e2f1771bb31d