[midPoint-git] [Evolveum/midpoint] f19ae9: Add suggestMappings and suggestCorrelation API

mederly noreply at github.com
Fri Aug 8 17:13:41 CEST 2025


  Branch: refs/heads/midpilot
  Home:   https://github.com/Evolveum/midpoint
  Commit: f19ae93fcd8d5d6eb3fdaa5cc70d751939345c0e
      https://github.com/Evolveum/midpoint/commit/f19ae93fcd8d5d6eb3fdaa5cc70d751939345c0e
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2025-07-22 (Tue, 22 Jul 2025)

  Changed paths:
    A gui/admin-gui/src/main/java/com/evolveum/midpoint/gui/impl/page/admin/resource/component/wizard/smart/DefinedResource.java
    A gui/admin-gui/src/main/java/com/evolveum/midpoint/gui/impl/page/admin/resource/component/wizard/smart/PageSmartIntegrationDefiningType.html
    A gui/admin-gui/src/main/java/com/evolveum/midpoint/gui/impl/page/admin/resource/component/wizard/smart/PageSmartIntegrationDefiningType.java
    M gui/admin-gui/src/main/java/com/evolveum/midpoint/gui/impl/page/admin/resource/component/wizard/smart/PageSmartIntegrationTypesSuggestion.html
    M gui/admin-gui/src/main/java/com/evolveum/midpoint/gui/impl/page/admin/resource/component/wizard/smart/PageSmartIntegrationTypesSuggestion.java
    A gui/admin-gui/src/main/java/com/evolveum/midpoint/gui/impl/page/admin/resource/component/wizard/smart/Util.java
    M infra/schema/src/main/resources/xml/ns/public/common/common-smart-integration-3.xsd
    M model/smart-api/src/main/java/com/evolveum/midpoint/smart/api/ServiceClient.java
    M model/smart-api/src/main/java/com/evolveum/midpoint/smart/api/SmartIntegrationService.java
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/DefaultServiceClientImpl.java
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/ServiceAdapter.java
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/SmartIntegrationServiceImpl.java
    M model/smart-impl/src/test/java/com/evolveum/midpoint/smart/impl/TestSmartIntegrationServiceImpl.java
    A model/smart-impl/src/test/resources/smart/resource-dummy-for-suggest-mappings-and-correlation.xml
    M model/smart-impl/src/test/resources/smart/test-110-expected-request.json

  Log Message:
  -----------
  Add suggestMappings and suggestCorrelation API

1. Added Python structures for matchSchema method.
2. Added Java API for suggestMappings and suggestCorrelation methods.
3. Added (very incomplete) parts of suggestMappings implementation.
4. Added (incomplete) naive UI page for these methods.
5. Added (incomplete) tests.

Other changes:

- SiObjectClassSchemaType generalized to SiObjectSchemaType
(because it now provides midPoint schemas as well)
- SiObjectSchemaType.name changed from string to QName

Work in progress.


  Commit: 0d410975c4dbb68f766af1a3a82ce44f049f3034
      https://github.com/Evolveum/midpoint/commit/0d410975c4dbb68f766af1a3a82ce44f049f3034
  Author: Michal Zelencik <michal.zelencik at evolveum.com>
  Date:   2025-07-23 (Wed, 23 Jul 2025)

  Changed paths:
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/activities/StatisticsComputer.java

  Log Message:
  -----------
  Bug fix for removing large value counts attributes

Signed-off-by: Michal Zelencik <michal.zelencik at evolveum.com>


  Commit: e8b0744963596aad9543150c7fc928081e1303d6
      https://github.com/Evolveum/midpoint/commit/e8b0744963596aad9543150c7fc928081e1303d6
  Author: Michal Zelencik <michal.zelencik at evolveum.com>
  Date:   2025-07-23 (Wed, 23 Jul 2025)

  Changed paths:
    M model/smart-impl/src/test/java/com/evolveum/midpoint/smart/impl/TestSmartIntegrationServiceImpl.java

  Log Message:
  -----------
  Add attribute tests

Signed-off-by: Michal Zelencik <michal.zelencik at evolveum.com>

# Conflicts:
#	model/smart-impl/src/test/java/com/evolveum/midpoint/smart/impl/TestSmartIntegrationServiceImpl.java


  Commit: 6d93b4bf03cc400e453cc58d223903eaa8afd0e8
      https://github.com/Evolveum/midpoint/commit/6d93b4bf03cc400e453cc58d223903eaa8afd0e8
  Author: Michal Zelencik <michal.zelencik at evolveum.com>
  Date:   2025-07-23 (Wed, 23 Jul 2025)

  Changed paths:
    M model/smart-impl/src/test/java/com/evolveum/midpoint/smart/impl/TestSmartIntegrationServiceImpl.java

  Log Message:
  -----------
  Revert "Add attribute tests"

This reverts commit e8b0744963596aad9543150c7fc928081e1303d6.


  Commit: 5e9412a282f3b031109185ab6b410ea08cdddc09
      https://github.com/Evolveum/midpoint/commit/5e9412a282f3b031109185ab6b410ea08cdddc09
  Author: Michal Zelencik <michal.zelencik at evolveum.com>
  Date:   2025-07-23 (Wed, 23 Jul 2025)

  Changed paths:
    M model/smart-impl/src/test/java/com/evolveum/midpoint/smart/impl/TestSmartIntegrationServiceImpl.java

  Log Message:
  -----------
  Add attribute statistics tests

Signed-off-by: Michal Zelencik <michal.zelencik at evolveum.com>


  Commit: 72f27ca815b64b8073656a4dc2edf36f4f607a79
      https://github.com/Evolveum/midpoint/commit/72f27ca815b64b8073656a4dc2edf36f4f607a79
  Author: Michal Zelencik <michal.zelencik at evolveum.com>
  Date:   2025-07-24 (Thu, 24 Jul 2025)

  Changed paths:
    M model/smart-impl/src/test/java/com/evolveum/midpoint/smart/impl/TestSmartIntegrationServiceImpl.java

  Log Message:
  -----------
  Add tests for exceeding percentage limit


  Commit: bbc49a71d4792e13b2269edb2412124ad675cecc
      https://github.com/Evolveum/midpoint/commit/bbc49a71d4792e13b2269edb2412124ad675cecc
  Author: Michal Zelencik <michal.zelencik at evolveum.com>
  Date:   2025-07-24 (Thu, 24 Jul 2025)

  Changed paths:
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/activities/StatisticsComputer.java
    M model/smart-impl/src/test/java/com/evolveum/midpoint/smart/impl/TestSmartIntegrationServiceImpl.java

  Log Message:
  -----------
  Add tests exceeding hard limit

Signed-off-by: Michal Zelencik <michal.zelencik at evolveum.com>


  Commit: b20f62ed9819f74de3701cd447540b2feea134df
      https://github.com/Evolveum/midpoint/commit/b20f62ed9819f74de3701cd447540b2feea134df
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2025-07-24 (Thu, 24 Jul 2025)

  Changed paths:
    M gui/admin-gui/src/main/java/com/evolveum/midpoint/gui/impl/page/admin/resource/component/wizard/smart/PageSmartIntegrationDefiningType.java
    M infra/schema/src/main/resources/xml/ns/public/common/common-smart-integration-3.xsd
    M model/smart-api/src/main/java/com/evolveum/midpoint/smart/api/SmartIntegrationService.java
    A model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/Operation.java
    A model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/PrismComplexTypeDefinitionSerializer.java
    A model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/ResourceObjectClassSchemaSerializer.java
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/ServiceAdapter.java
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/SmartIntegrationBeans.java
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/SmartIntegrationServiceImpl.java
    A model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/TypeOperation.java
    M model/smart-impl/src/test/java/com/evolveum/midpoint/smart/impl/TestSmartIntegrationServiceImpl.java
    M repo/repo-test-util/src/main/java/com/evolveum/midpoint/test/AbstractIntegrationTest.java

  Log Message:
  -----------
  Improve schema serialization for python service

Now we support attributes of embedded types like activation,
credentials, and so on.

- SiAttributeDefinitionType#name was changed from QName
to ItemPathType.
- We recursively crawl through prism items and put the whole
paths there. (There is a list of ignored attributes like assignment,
adminGuiConfiguration, etc.)

Other changes:

- SiSuggestFocusTypeResponseType.focusTypeName is now QName
(was string); to be consistent with other QNames in the API.
- Internal organization of SmartIntegrationServiceImpl was improved.


  Commit: eb72dcb57404c8fcaee853bc95ebe00e3bde5c2e
      https://github.com/Evolveum/midpoint/commit/eb72dcb57404c8fcaee853bc95ebe00e3bde5c2e
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2025-07-24 (Thu, 24 Jul 2025)

  Changed paths:
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/smart/TestSmartIntegrationService.java
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/smart/TestSmartIntegrationServiceStory.java

  Log Message:
  -----------
  Fix compilation errors


  Commit: b8db7cfdae559afd72420602edd4bf36661c31fa
      https://github.com/Evolveum/midpoint/commit/b8db7cfdae559afd72420602edd4bf36661c31fa
  Author: Michal Zelencik <michal.zelencik at evolveum.com>
  Date:   2025-07-24 (Thu, 24 Jul 2025)

  Changed paths:
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/activities/StatisticsComputer.java
    M model/smart-impl/src/test/java/com/evolveum/midpoint/smart/impl/TestSmartIntegrationServiceImpl.java

  Log Message:
  -----------
  Remake StatisticsComputer to topN value counts insted of low cardinality value counts.

Signed-off-by: Michal Zelencik <michal.zelencik at evolveum.com>


  Commit: e58d96f69ba0cf15196f870a8c14befe3fab423c
      https://github.com/Evolveum/midpoint/commit/e58d96f69ba0cf15196f870a8c14befe3fab423c
  Author: Michal Zelencik <michal.zelencik at evolveum.com>
  Date:   2025-07-25 (Fri, 25 Jul 2025)

  Changed paths:
    M model/smart-impl/src/test/java/com/evolveum/midpoint/smart/impl/TestSmartIntegrationServiceImpl.java

  Log Message:
  -----------
  Add unit tests for picking top N values according to cardinality.

Signed-off-by: Michal Zelencik <michal.zelencik at evolveum.com>


  Commit: 2166ff412991af471752ae4e9bd741857e161447
      https://github.com/Evolveum/midpoint/commit/2166ff412991af471752ae4e9bd741857e161447
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2025-07-25 (Fri, 25 Jul 2025)

  Changed paths:
    M infra/schema/src/main/resources/xml/ns/public/common/common-smart-integration-3.xsd
    A model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/KnownCorrelator.java
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/ServiceAdapter.java
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/TypeOperation.java
    M model/smart-impl/src/test/java/com/evolveum/midpoint/smart/impl/TestSmartIntegrationServiceImpl.java

  Log Message:
  -----------
  Suggest as-is mappings and correlation

Work in progress.


  Commit: a2e7a95f32983840aec267c943e293a573487ca5
      https://github.com/Evolveum/midpoint/commit/a2e7a95f32983840aec267c943e293a573487ca5
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2025-07-25 (Fri, 25 Jul 2025)

  Changed paths:
    M model/smart-impl/src/test/java/com/evolveum/midpoint/smart/impl/TestSmartIntegrationServiceImpl.java

  Log Message:
  -----------
  Merge remote-tracking branch 'origin/feature/smart-integration-service' into feature/smart-integration-service


  Commit: cfc4038a7febea5baa5c8ceddaa8f77e178424ba
      https://github.com/Evolveum/midpoint/commit/cfc4038a7febea5baa5c8ceddaa8f77e178424ba
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2025-07-25 (Fri, 25 Jul 2025)

  Changed paths:
    M model/smart-impl/pom.xml
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/DefaultServiceClientImpl.java

  Log Message:
  -----------
  Increase recv timeout for smart int python service


  Commit: 82c6e7a678b497da9d38d6a25380e357c057ac2e
      https://github.com/Evolveum/midpoint/commit/82c6e7a678b497da9d38d6a25380e357c057ac2e
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2025-07-25 (Fri, 25 Jul 2025)

  Changed paths:
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/ServiceAdapter.java
    M model/smart-impl/src/test/java/com/evolveum/midpoint/smart/impl/TestSmartIntegrationServiceImpl.java
    R model/smart-impl/src/test/resources/smart/test-110-statistics.xml
    A model/smart-impl/src/test/resources/smart/test-140-expected-object-types.xml
    A model/smart-impl/src/test/resources/smart/test-1xx-statistics.xml

  Log Message:
  -----------
  Merge object type suggestions

Python microservice can suggest multiple object types with
the same identification (like account/default). The Java service
now tries to merge these when possible, and suggest unique
intents otherwise.


  Commit: c5817086daf328eba1d9c73ce2037797405d2b19
      https://github.com/Evolveum/midpoint/commit/c5817086daf328eba1d9c73ce2037797405d2b19
  Author: Michal Zelencik <michal.zelencik at evolveum.com>
  Date:   2025-07-28 (Mon, 28 Jul 2025)

  Changed paths:
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/activities/StatisticsComputer.java
    M model/smart-impl/src/test/java/com/evolveum/midpoint/smart/impl/TestSmartIntegrationServiceImpl.java

  Log Message:
  -----------
  Fix updating unique value counts

Signed-off-by: Michal Zelencik <michal.zelencik at evolveum.com>


  Commit: 671815926d3371367d91e7966713433b3ff1d837
      https://github.com/Evolveum/midpoint/commit/671815926d3371367d91e7966713433b3ff1d837
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2025-07-28 (Mon, 28 Jul 2025)

  Changed paths:
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/ServiceAdapter.java

  Log Message:
  -----------
  Fix unique type id generator (midPilot)

This is a temporary commit. We agreed today that midPoint won't try to
fix LLM outputs.


  Commit: 38d172a59d1cbcea8e2ba05e9f3aa688a6e56fa9
      https://github.com/Evolveum/midpoint/commit/38d172a59d1cbcea8e2ba05e9f3aa688a6e56fa9
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2025-07-28 (Mon, 28 Jul 2025)

  Changed paths:
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/ServiceAdapter.java
    M model/smart-impl/src/test/resources/smart/test-140-expected-object-types.xml

  Log Message:
  -----------
  Remove merging suggested object types

We now simply take the first one.


  Commit: 531e66528de92ea316695be33831793f25caa68e
      https://github.com/Evolveum/midpoint/commit/531e66528de92ea316695be33831793f25caa68e
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2025-07-28 (Mon, 28 Jul 2025)

  Changed paths:
    M gui/admin-gui/src/main/java/com/evolveum/midpoint/gui/impl/page/admin/resource/component/wizard/smart/PageSmartIntegrationDefiningTypes.html
    M gui/admin-gui/src/main/java/com/evolveum/midpoint/gui/impl/page/admin/resource/component/wizard/smart/PageSmartIntegrationDefiningTypes.java
    M gui/admin-gui/src/main/java/com/evolveum/midpoint/gui/impl/page/admin/resource/component/wizard/smart/PageSmartIntegrationTypesSuggestion.html
    M gui/admin-gui/src/main/java/com/evolveum/midpoint/gui/impl/page/admin/resource/component/wizard/smart/PageSmartIntegrationTypesSuggestion.java
    M gui/admin-gui/src/main/java/com/evolveum/midpoint/gui/impl/page/admin/resource/component/wizard/smart/RealResourceStatus.java
    M gui/admin-gui/src/main/java/com/evolveum/midpoint/gui/impl/page/admin/resource/component/wizard/smart/ResourceStatus.java

  Log Message:
  -----------
  Improve smart integration proto UI a bit


  Commit: cbc9ca2f7b43d15e4177e4505b56b3848655c6e7
      https://github.com/Evolveum/midpoint/commit/cbc9ca2f7b43d15e4177e4505b56b3848655c6e7
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2025-07-29 (Tue, 29 Jul 2025)

  Changed paths:
    M infra/schema/src/main/resources/xml/ns/public/common/common-smart-integration-3.xsd

  Log Message:
  -----------
  Add microservice schema for suggestMappings


  Commit: 3052dd6f84d5af7c5366119210d6ecee69bcecca
      https://github.com/Evolveum/midpoint/commit/3052dd6f84d5af7c5366119210d6ecee69bcecca
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2025-07-29 (Tue, 29 Jul 2025)

  Changed paths:
    M infra/schema/src/main/java/com/evolveum/midpoint/schema/result/OperationResult.java
    M infra/schema/src/main/java/com/evolveum/midpoint/schema/result/OperationResultBuilder.java
    M infra/schema/src/main/java/com/evolveum/midpoint/schema/util/task/work/WorkDefinitionUtil.java
    M infra/schema/src/main/resources/xml/ns/public/common/common-tasks-3.xsd
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/smart/DummyHrScenario.java
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/smart/TestSmartIntegrationService.java
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/smart/TestSmartIntegrationServiceStory.java
    A model/model-intest/src/test/resources/smart/resource-dummy-for-suggest-correlation-and-mappings.xml
    M model/smart-api/src/main/java/com/evolveum/midpoint/smart/api/SmartIntegrationService.java
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/DefaultServiceClientImpl.java
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/SmartIntegrationServiceImpl.java
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/TypeOperation.java
    A model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/activities/CorrelationSuggestionActivityHandler.java
    A model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/activities/MappingsSuggestionActivityHandler.java
    A model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/activities/ObjectTypeRelatedSuggestionWorkDefinition.java
    M repo/repo-common/src/main/java/com/evolveum/midpoint/repo/common/activity/handlers/ActivityHandlerRegistry.java

  Log Message:
  -----------
  Add background correlation and mapping suggestions

- correlationSuggestion and mappingsSuggestion activities were created
- SmartIntegrationService API was adapted to handle asynchronicity
- new tests were added, existing ones were improved

Work in progress: GUI was not adapted yet; only "as-is" mappings
are suggested for now.


  Commit: 7118e7f3214b2c4fe7a748101bd0302f002347a8
      https://github.com/Evolveum/midpoint/commit/7118e7f3214b2c4fe7a748101bd0302f002347a8
  Author: Michal Zelencik <michal.zelencik at evolveum.com>
  Date:   2025-07-29 (Tue, 29 Jul 2025)

  Changed paths:
    M model/smart-impl/src/test/java/com/evolveum/midpoint/smart/impl/TestSmartIntegrationServiceImpl.java

  Log Message:
  -----------
  Change attribute tests to private

Signed-off-by: Michal Zelencik <michal.zelencik at evolveum.com>


  Commit: 6f55f12863805d1977b292ee35da7c5d17e1304b
      https://github.com/Evolveum/midpoint/commit/6f55f12863805d1977b292ee35da7c5d17e1304b
  Author: Michal Zelencik <michal.zelencik at evolveum.com>
  Date:   2025-07-29 (Tue, 29 Jul 2025)

  Changed paths:
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/activities/StatisticsComputer.java
    M model/smart-impl/src/test/java/com/evolveum/midpoint/smart/impl/TestSmartIntegrationServiceImpl.java

  Log Message:
  -----------
  Add value counts of pairs.

Signed-off-by: Michal Zelencik <michal.zelencik at evolveum.com>


  Commit: 411ead08edb7190d852d609269e0271c6ba13103
      https://github.com/Evolveum/midpoint/commit/411ead08edb7190d852d609269e0271c6ba13103
  Author: Michal Zelencik <michal.zelencik at evolveum.com>
  Date:   2025-07-29 (Tue, 29 Jul 2025)

  Changed paths:
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/activities/StatisticsComputer.java

  Log Message:
  -----------
  Put valuePairs under attributes structure

Signed-off-by: Michal Zelencik <michal.zelencik at evolveum.com>


  Commit: c877e312ddb17b130e0e48762a9a0018550b23a4
      https://github.com/Evolveum/midpoint/commit/c877e312ddb17b130e0e48762a9a0018550b23a4
  Author: Michal Zelencik <michal.zelencik at evolveum.com>
  Date:   2025-07-30 (Wed, 30 Jul 2025)

  Changed paths:
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/activities/StatisticsComputer.java
    M model/smart-impl/src/test/java/com/evolveum/midpoint/smart/impl/TestSmartIntegrationServiceImpl.java

  Log Message:
  -----------
  Add test for value count pairs

Signed-off-by: Michal Zelencik <michal.zelencik at evolveum.com>


  Commit: e347b3c01b7d5a97ae98e1bfa89a100ad178920f
      https://github.com/Evolveum/midpoint/commit/e347b3c01b7d5a97ae98e1bfa89a100ad178920f
  Author: tchrapovic <chrapovic.tadeas at gmail.com>
  Date:   2025-07-31 (Thu, 31 Jul 2025)

  Changed paths:
    A model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/smart/DummyAdSmartAssociationsScenario.java
    A model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/smart/TestSmartAssociation.java
    A model/model-intest/src/test/resources/smart/resource-dummy-smart-association-types.xml
    M model/smart-impl/pom.xml
    A model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/SmartAssociationImpl.java
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/SmartIntegrationServiceImpl.java

  Log Message:
  -----------
  Add implementation of smart association suggestion (simple type)


  Commit: 8d3850d5e09808c6bee1210eb68ff0c2e7e8edc7
      https://github.com/Evolveum/midpoint/commit/8d3850d5e09808c6bee1210eb68ff0c2e7e8edc7
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2025-08-04 (Mon, 04 Aug 2025)

  Changed paths:
    M infra/schema/src/main/resources/xml/ns/public/common/common-smart-integration-3.xsd
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/smart/TestSmartIntegrationService.java
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/smart/TestSmartIntegrationServiceStory.java
    M model/model-test/src/main/java/com/evolveum/midpoint/model/test/smart/MockServiceClientImpl.java
    M model/smart-api/src/main/java/com/evolveum/midpoint/smart/api/ServiceClient.java
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/DefaultServiceClientImpl.java
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/ServiceAdapter.java
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/SmartIntegrationServiceImpl.java
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/TypeOperation.java
    M model/smart-impl/src/test/java/com/evolveum/midpoint/smart/impl/TestSmartIntegrationServiceImpl.java
    A model/smart-impl/src/test/resources/smart/user-alice.xml
    A model/smart-impl/src/test/resources/smart/user-bob.xml
    A model/smart-impl/src/test/resources/smart/user-jack.xml
    A model/smart-impl/src/test/resources/smart/user-jim.xml

  Log Message:
  -----------
  Add support for suggesting Groovy mappings

Now we call the Python microservice with a couple of example
data pairs to derive Groovy/as-is mappings.

Work in progress: inbounds only; no progress reporting.

Related change:

The serialization of values for Python microservice is switched
to xsd:string, with the specification of expected type. It is
because the midPoint-ish encoding of xsd:anyType is unnecessarily
complex for now (@type, @value).


  Commit: 931ea18e632c28acf92e92eb9fa64f694b8ac00c
      https://github.com/Evolveum/midpoint/commit/931ea18e632c28acf92e92eb9fa64f694b8ac00c
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2025-08-04 (Mon, 04 Aug 2025)

  Changed paths:
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/ServiceAdapter.java
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/TypeOperation.java

  Log Message:
  -----------
  Support enums when suggesting mappings

They are treated as strings, for now.


  Commit: 3bff8c25af5b4df599d34ba898a11089c49de842
      https://github.com/Evolveum/midpoint/commit/3bff8c25af5b4df599d34ba898a11089c49de842
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2025-08-04 (Mon, 04 Aug 2025)

  Changed paths:
    M infra/schema/src/main/resources/xml/ns/public/common/common-smart-integration-3.xsd
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/ServiceAdapter.java

  Log Message:
  -----------
  Generalize "suggestMapping" interface

- This will allow multiple properties at midPoint side,
useful for outbound mappings.
- Instead of simple "multivalued" flag we provide complete
minOccurs/maxOccurs information.


  Commit: 3fa7ecbb2088629eca2f476d8e0bff3ce3485e04
      https://github.com/Evolveum/midpoint/commit/3fa7ecbb2088629eca2f476d8e0bff3ce3485e04
  Author: Michal Zelencik <michal.zelencik at evolveum.com>
  Date:   2025-08-05 (Tue, 05 Aug 2025)

  Changed paths:
    M infra/schema/src/main/java/com/evolveum/midpoint/schema/util/task/work/WorkDefinitionUtil.java
    M infra/schema/src/main/resources/xml/ns/public/common/common-tasks-3.xsd
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/smart/TestSmartIntegrationService.java
    M model/smart-api/src/main/java/com/evolveum/midpoint/smart/api/SmartIntegrationService.java
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/SmartIntegrationServiceImpl.java
    A model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/activities/FocusTypeSuggestionActivityHandler.java
    A model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/activities/FocusTypeSuggestionWorkDefinition.java

  Log Message:
  -----------
  Change suggestFocusType to Async


  Commit: 7acc9d97679f43d1b79b74d9be6d62e623a407ae
      https://github.com/Evolveum/midpoint/commit/7acc9d97679f43d1b79b74d9be6d62e623a407ae
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2025-08-05 (Tue, 05 Aug 2025)

  Changed paths:
    M infra/schema/src/main/resources/xml/ns/public/common/common-smart-integration-3.xsd
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/smart/TestSmartIntegrationService.java
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/Operation.java
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/ResourceObjectClassSchemaSerializer.java
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/ServiceAdapter.java
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/TypeOperation.java
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/activities/StatisticsComputer.java
    M model/smart-impl/src/test/java/com/evolveum/midpoint/smart/impl/TestSmartIntegrationServiceImpl.java
    M model/smart-impl/src/test/resources/logback-test.xml
    M model/smart-impl/src/test/resources/smart/test-100-statistics.xml
    M model/smart-impl/src/test/resources/smart/test-110-expected-request.json
    M model/smart-impl/src/test/resources/smart/test-1xx-statistics.xml

  Log Message:
  -----------
  Improve communication with Python microservice

- All attributes are now full paths, like c:attributes/ri:login,
c:activation/c:administrativeStatus, etc.
- The suggestMapping method now supports multiple resource attributes
and multiple focus items.

The code in midPoint is not fully adapted yet, e.g. mapping
suggestions for non-attribute items do not work yet.


  Commit: 3ee49beb533faef5a52ca09f6214ee986941085d
      https://github.com/Evolveum/midpoint/commit/3ee49beb533faef5a52ca09f6214ee986941085d
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2025-08-05 (Tue, 05 Aug 2025)

  Changed paths:
    M infra/schema/src/main/java/com/evolveum/midpoint/schema/util/task/work/WorkDefinitionUtil.java
    M infra/schema/src/main/resources/xml/ns/public/common/common-tasks-3.xsd
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/smart/TestSmartIntegrationService.java
    M model/smart-api/src/main/java/com/evolveum/midpoint/smart/api/SmartIntegrationService.java
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/SmartIntegrationServiceImpl.java
    A model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/activities/FocusTypeSuggestionActivityHandler.java
    A model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/activities/FocusTypeSuggestionWorkDefinition.java

  Log Message:
  -----------
  Merge remote-tracking branch 'origin/feature/smart-integration-service' into feature/smart-integration-service


  Commit: 08b11e83b91bf49cf671aebea29606384cd930f2
      https://github.com/Evolveum/midpoint/commit/08b11e83b91bf49cf671aebea29606384cd930f2
  Author: Michal Zelencik <michal.zelencik at evolveum.com>
  Date:   2025-08-07 (Thu, 07 Aug 2025)

  Changed paths:
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/activities/StatisticsComputer.java

  Log Message:
  -----------
  Statistics computer refactor

Signed-off-by: Michal Zelencik <michal.zelencik at evolveum.com>


  Commit: f6e41d670533a98dbeb2396305139144cabec50e
      https://github.com/Evolveum/midpoint/commit/f6e41d670533a98dbeb2396305139144cabec50e
  Author: Michal Zelencik <michal.zelencik at evolveum.com>
  Date:   2025-08-08 (Fri, 08 Aug 2025)

  Changed paths:
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/activities/StatisticsComputer.java

  Log Message:
  -----------
  StatisticsComputer refactor.

Remove value counts counter, as we have all shadows in memory. Value counts are computed in the end.

Signed-off-by: Michal Zelencik <michal.zelencik at evolveum.com>


  Commit: 0a1effa30dbb6388e7c49429fe69254551fc31e2
      https://github.com/Evolveum/midpoint/commit/0a1effa30dbb6388e7c49429fe69254551fc31e2
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2025-08-08 (Fri, 08 Aug 2025)

  Changed paths:
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/smart/TestSmartIntegrationService.java

  Log Message:
  -----------
  Increase timeout in TestSmartIntegrationService

This is to make tests with the real LLM-based service working.


  Commit: 1c10a64767381f0a97c184329ea3830250101e4a
      https://github.com/Evolveum/midpoint/commit/1c10a64767381f0a97c184329ea3830250101e4a
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2025-08-08 (Fri, 08 Aug 2025)

  Changed paths:
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/PrismComplexTypeDefinitionSerializer.java

  Log Message:
  -----------
  Skip extension from being sent to microservice

Custom XML namespaces break the simplicity of JSON encoding
for data being sent to the Python microservice: they introduce
@context and @value elements which are obviously not recognized
by Python.

Until this is resolved (see MID-10802), we exclude extension
container schema from being sent to the microservice.


  Commit: 9ed81618866b7137be357ca8f0884bbf1574c7c0
      https://github.com/Evolveum/midpoint/commit/9ed81618866b7137be357ca8f0884bbf1574c7c0
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2025-08-08 (Fri, 08 Aug 2025)

  Changed paths:
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/activities/StatisticsComputer.java

  Log Message:
  -----------
  Merge remote-tracking branch 'origin/feature/smart-integration-service' into feature/smart-integration-service


  Commit: db52428b9c25fedaa93fdc96a619ff5cca5d0931
      https://github.com/Evolveum/midpoint/commit/db52428b9c25fedaa93fdc96a619ff5cca5d0931
  Author: Michal Zelencik <michal.zelencik at evolveum.com>
  Date:   2025-08-08 (Fri, 08 Aug 2025)

  Changed paths:
    M model/smart-impl/src/main/java/com/evolveum/midpoint/smart/impl/activities/StatisticsComputer.java
    M model/smart-impl/src/test/java/com/evolveum/midpoint/smart/impl/TestSmartIntegrationServiceImpl.java

  Log Message:
  -----------
  Add prefix/suffix value counts to the delineation statistics

Signed-off-by: Michal Zelencik <michal.zelencik at evolveum.com>


Compare: https://github.com/Evolveum/midpoint/compare/6cc1c368cfe1...db52428b9c25

To unsubscribe from these emails, change your notification settings at https://github.com/Evolveum/midpoint/settings/notifications


More information about the midPoint-svn mailing list