[midPoint-git] [Evolveum/midpoint] c3fe82: Improve prism performance tests a bit

mederly noreply at github.com
Fri Jun 14 17:14:37 CEST 2019 

  Branch: refs/heads/master
  Home:   https://github.com/Evolveum/midpoint
  Commit: c3fe825471dbaef2a0a1703bea8206a60f65c4a2
      https://github.com/Evolveum/midpoint/commit/c3fe825471dbaef2a0a1703bea8206a60f65c4a2
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2019-05-08 (Wed, 08 May 2019)

  Changed paths:
    M infra/schema/src/test/java/com/evolveum/midpoint/schema/performance/AbstractSchemaPerformanceTest.java
    M infra/schema/src/test/java/com/evolveum/midpoint/schema/performance/TestBasicPerformance.java

  Log Message:
  -----------
  Improve prism performance tests a bit


  Commit: a6ad76e573353c54b6caebf1075370450c0aa38e
      https://github.com/Evolveum/midpoint/commit/a6ad76e573353c54b6caebf1075370450c0aa38e
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2019-05-08 (Wed, 08 May 2019)

  Changed paths:
    M infra/prism-impl/src/main/java/com/evolveum/midpoint/prism/impl/schema/PrismSchemaImpl.java

  Log Message:
  -----------
  Optimize XNode->prism parsing part 1

Introduced 2 fast lookups in PrismSchemaImpl:
- lookup of type by its name
- lookup of item by its type name

Parsing of XNode derived from 11K XML file went down
from 385 to 72 ms per parse operation.


  Commit: adeeac1d9089b830952ed5d86c87cb6c5ca90681
      https://github.com/Evolveum/midpoint/commit/adeeac1d9089b830952ed5d86c87cb6c5ca90681
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2019-05-09 (Thu, 09 May 2019)

  Changed paths:
    M gui/admin-gui/src/main/java/com/evolveum/midpoint/web/component/assignment/AssignmentEditorDto.java
    M gui/admin-gui/src/main/java/com/evolveum/midpoint/web/component/prism/ObjectWrapper.java
    M gui/admin-gui/src/main/java/com/evolveum/midpoint/web/component/wizard/resource/NameStep.java
    M gui/admin-gui/src/test/java/com/evolveum/midpoint/web/TestIntegrationObjectWrapperFactory.java
    M infra/prism-api/src/main/java/com/evolveum/midpoint/prism/PrismContainer.java
    M infra/prism-api/src/main/java/com/evolveum/midpoint/prism/PrismContainerValue.java
    M infra/prism-api/src/main/java/com/evolveum/midpoint/prism/util/PrismAsserts.java
    M infra/prism-impl/src/main/java/com/evolveum/midpoint/prism/impl/PrismContainerImpl.java
    M infra/prism-impl/src/main/java/com/evolveum/midpoint/prism/impl/PrismContainerValueImpl.java
    M infra/prism-impl/src/main/java/com/evolveum/midpoint/prism/impl/delta/ItemDeltaImpl.java
    M infra/prism-impl/src/main/java/com/evolveum/midpoint/prism/impl/marshaller/PrismMarshaller.java
    M infra/prism-impl/src/test/java/com/evolveum/midpoint/prism/TestPrismParsing.java
    M infra/schema/src/main/java/com/evolveum/midpoint/schema/processor/ResourceAttributeContainerImpl.java
    M infra/schema/src/test/java/com/evolveum/midpoint/schema/TestEmptyItems.java
    M infra/schema/src/test/java/com/evolveum/midpoint/schema/TestParseGenericObject.java
    M infra/schema/src/test/java/com/evolveum/midpoint/schema/parser/TestParseResource.java
    M infra/schema/src/test/java/com/evolveum/midpoint/schema/parser/TestParseUser.java
    M infra/schema/src/test/java/com/evolveum/midpoint/schema/performance/AbstractSchemaPerformanceTest.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/ModelRestService.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/controller/SchemaTransformer.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/projector/ReconciliationProcessor.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/scripting/expressions/FilterContentEvaluator.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/sync/SynchronizationServiceImpl.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/visualizer/Visualizer.java
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/TestModelServiceContractCaching.java
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/security/TestSecurityAdvanced.java
    M model/model-test/src/main/java/com/evolveum/midpoint/model/test/AbstractModelIntegrationTest.java
    M model/notifications-impl/src/main/java/com/evolveum/midpoint/notifications/impl/formatters/TextFormatter.java
    M model/report-impl/src/main/java/com/evolveum/midpoint/report/impl/ReportJasperCreateTaskHandler.java
    M provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/ShadowCaretaker.java
    M provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/ShadowManager.java
    M provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/util/ProvisioningUtil.java
    M provisioning/provisioning-impl/src/test/java/com/evolveum/midpoint/provisioning/impl/ProvisioningTestUtil.java
    M provisioning/provisioning-impl/src/test/java/com/evolveum/midpoint/provisioning/impl/dummy/AbstractBasicDummyTest.java
    M provisioning/provisioning-impl/src/test/java/com/evolveum/midpoint/provisioning/impl/dummy/TestDummyCaching.java
    M provisioning/ucf-impl-builtin/src/main/java/com/evolveum/midpoint/provisioning/ucf/impl/builtin/async/TransformationalAsyncUpdateMessageListener.java
    M provisioning/ucf-impl-connid/src/test/java/com/evolveum/midpoint/provisioning/ucf/impl/connid/TestUcfDummy.java
    M repo/repo-sql-impl-test/src/test/java/com/evolveum/midpoint/repo/sql/AddGetObjectTest.java
    M repo/repo-sql-impl/src/main/java/com/evolveum/midpoint/repo/sql/data/common/RObject.java
    M repo/repo-sql-impl/src/main/java/com/evolveum/midpoint/repo/sql/data/common/any/RAssignmentExtension.java
    M repo/repo-sql-impl/src/main/java/com/evolveum/midpoint/repo/sql/helpers/ObjectDeltaUpdater.java
    M repo/repo-test-util/src/main/java/com/evolveum/midpoint/test/AbstractHigherUnitTest.java
    M repo/repo-test-util/src/main/java/com/evolveum/midpoint/test/AbstractIntegrationTest.java
    M repo/security-enforcer-impl/src/main/java/com/evolveum/midpoint/security/enforcer/impl/SecurityEnforcerImpl.java
    M testing/sanity/src/test/java/com/evolveum/midpoint/testing/sanity/TestSanity.java
    M testing/story/src/test/java/com/evolveum/midpoint/testing/story/TestConsistencyMechanism.java

  Log Message:
  -----------
  Optimize finding items in PCV

Simple list of items is replaced by LinkedHashMap; with some auxiliary
structure for unqualified item names. This is a preliminary (PoC)
implementation only.


  Commit: 6d927bb89893cec251507d3d210bd553dc33a2ab
      https://github.com/Evolveum/midpoint/commit/6d927bb89893cec251507d3d210bd553dc33a2ab
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2019-05-09 (Thu, 09 May 2019)

  Changed paths:
    M repo/repo-sql-impl/src/main/java/com/evolveum/midpoint/repo/sql/helpers/ObjectUpdater.java

  Log Message:
  -----------
  Replace serialization/parsing in repo by cloning


  Commit: 63694ece8975dfe2f10bc826a2af9c9ff6096d12
      https://github.com/Evolveum/midpoint/commit/63694ece8975dfe2f10bc826a2af9c9ff6096d12
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2019-05-09 (Thu, 09 May 2019)

  Changed paths:
    M testing/story/src/test/resources/ldap/recon-perf/resource-opendj.xml

  Log Message:
  -----------
  Optimize configuration to make recon faster


  Commit: 5720cce882c08bddcd934ebc8d12750b6f4adea1
      https://github.com/Evolveum/midpoint/commit/5720cce882c08bddcd934ebc8d12750b6f4adea1
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2019-06-14 (Fri, 14 Jun 2019)

  Changed paths:
    M infra/prism-impl/src/main/java/com/evolveum/midpoint/prism/impl/PrismContainerValueImpl.java

  Log Message:
  -----------
  Fix CME in PCV.keepPaths/removePaths methods


  Commit: 00c4d50e880e297b216c07299deecc56dcbc4070
      https://github.com/Evolveum/midpoint/commit/00c4d50e880e297b216c07299deecc56dcbc4070
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2019-06-14 (Fri, 14 Jun 2019)

  Changed paths:
    M infra/prism-api/src/main/java/com/evolveum/midpoint/prism/PrismSerializer.java
    M infra/prism-api/src/main/java/com/evolveum/midpoint/prism/xnode/MapXNode.java
    M infra/prism-api/src/main/java/com/evolveum/midpoint/prism/xnode/XNode.java
    M infra/prism-impl/src/main/java/com/evolveum/midpoint/prism/impl/PrismContextImpl.java
    M infra/prism-impl/src/main/java/com/evolveum/midpoint/prism/impl/marshaller/PrismMarshaller.java
    M infra/prism-impl/src/main/java/com/evolveum/midpoint/prism/impl/marshaller/PrismSerializerImpl.java
    M infra/prism-impl/src/main/java/com/evolveum/midpoint/prism/impl/xnode/MapXNodeImpl.java
    M infra/prism-impl/src/main/java/com/evolveum/midpoint/prism/impl/xnode/XNodeImpl.java
    M infra/schema/src/test/java/com/evolveum/midpoint/schema/parser/TestParseUser.java
    M infra/util/src/main/java/com/evolveum/midpoint/util/QNameUtil.java
    M repo/repo-sql-impl/src/main/java/com/evolveum/midpoint/repo/sql/helpers/ObjectUpdater.java

  Log Message:
  -----------
  Eliminate cloning in repo updateFullObject method

Now we simply skip selected items (like photo or task result) when
serializing the object.


  Commit: aa16230452eecce07f07f8708dfa46382d86686c
      https://github.com/Evolveum/midpoint/commit/aa16230452eecce07f07f8708dfa46382d86686c
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2019-06-14 (Fri, 14 Jun 2019)

  Changed paths:
    M gui/admin-gui/src/main/java/com/evolveum/midpoint/web/component/assignment/AssignmentEditorDto.java
    M gui/admin-gui/src/main/java/com/evolveum/midpoint/web/component/prism/ObjectWrapper.java
    M gui/admin-gui/src/main/java/com/evolveum/midpoint/web/component/wizard/resource/NameStep.java
    M gui/admin-gui/src/test/java/com/evolveum/midpoint/web/TestIntegrationObjectWrapperFactory.java
    M infra/prism-api/src/main/java/com/evolveum/midpoint/prism/PrismContainer.java
    M infra/prism-api/src/main/java/com/evolveum/midpoint/prism/PrismContainerValue.java
    M infra/prism-api/src/main/java/com/evolveum/midpoint/prism/PrismSerializer.java
    M infra/prism-api/src/main/java/com/evolveum/midpoint/prism/util/PrismAsserts.java
    M infra/prism-api/src/main/java/com/evolveum/midpoint/prism/xnode/MapXNode.java
    M infra/prism-api/src/main/java/com/evolveum/midpoint/prism/xnode/XNode.java
    M infra/prism-impl/src/main/java/com/evolveum/midpoint/prism/impl/PrismContainerImpl.java
    M infra/prism-impl/src/main/java/com/evolveum/midpoint/prism/impl/PrismContainerValueImpl.java
    M infra/prism-impl/src/main/java/com/evolveum/midpoint/prism/impl/PrismContextImpl.java
    M infra/prism-impl/src/main/java/com/evolveum/midpoint/prism/impl/delta/ItemDeltaImpl.java
    M infra/prism-impl/src/main/java/com/evolveum/midpoint/prism/impl/marshaller/PrismMarshaller.java
    M infra/prism-impl/src/main/java/com/evolveum/midpoint/prism/impl/marshaller/PrismSerializerImpl.java
    M infra/prism-impl/src/main/java/com/evolveum/midpoint/prism/impl/schema/PrismSchemaImpl.java
    M infra/prism-impl/src/main/java/com/evolveum/midpoint/prism/impl/xnode/MapXNodeImpl.java
    M infra/prism-impl/src/main/java/com/evolveum/midpoint/prism/impl/xnode/XNodeImpl.java
    M infra/prism-impl/src/test/java/com/evolveum/midpoint/prism/TestPrismParsing.java
    M infra/schema/src/main/java/com/evolveum/midpoint/schema/processor/ResourceAttributeContainerImpl.java
    M infra/schema/src/test/java/com/evolveum/midpoint/schema/TestEmptyItems.java
    M infra/schema/src/test/java/com/evolveum/midpoint/schema/TestParseGenericObject.java
    M infra/schema/src/test/java/com/evolveum/midpoint/schema/parser/TestParseResource.java
    M infra/schema/src/test/java/com/evolveum/midpoint/schema/parser/TestParseUser.java
    M infra/schema/src/test/java/com/evolveum/midpoint/schema/performance/AbstractSchemaPerformanceTest.java
    M infra/schema/src/test/java/com/evolveum/midpoint/schema/performance/TestBasicPerformance.java
    M infra/util/src/main/java/com/evolveum/midpoint/util/QNameUtil.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/ModelRestService.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/controller/SchemaTransformer.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/lens/projector/ReconciliationProcessor.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/scripting/expressions/FilterContentEvaluator.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/sync/SynchronizationServiceImpl.java
    M model/model-impl/src/main/java/com/evolveum/midpoint/model/impl/visualizer/Visualizer.java
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/TestModelServiceContractCaching.java
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/security/TestSecurityAdvanced.java
    M model/model-test/src/main/java/com/evolveum/midpoint/model/test/AbstractModelIntegrationTest.java
    M model/notifications-impl/src/main/java/com/evolveum/midpoint/notifications/impl/formatters/TextFormatter.java
    M model/report-impl/src/main/java/com/evolveum/midpoint/report/impl/ReportJasperCreateTaskHandler.java
    M provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/ShadowCaretaker.java
    M provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/impl/ShadowManager.java
    M provisioning/provisioning-impl/src/main/java/com/evolveum/midpoint/provisioning/util/ProvisioningUtil.java
    M provisioning/provisioning-impl/src/test/java/com/evolveum/midpoint/provisioning/impl/ProvisioningTestUtil.java
    M provisioning/provisioning-impl/src/test/java/com/evolveum/midpoint/provisioning/impl/dummy/AbstractBasicDummyTest.java
    M provisioning/provisioning-impl/src/test/java/com/evolveum/midpoint/provisioning/impl/dummy/TestDummyCaching.java
    M provisioning/ucf-impl-builtin/src/main/java/com/evolveum/midpoint/provisioning/ucf/impl/builtin/async/TransformationalAsyncUpdateMessageListener.java
    M provisioning/ucf-impl-connid/src/test/java/com/evolveum/midpoint/provisioning/ucf/impl/connid/TestUcfDummy.java
    M repo/repo-sql-impl-test/src/test/java/com/evolveum/midpoint/repo/sql/AddGetObjectTest.java
    M repo/repo-sql-impl/src/main/java/com/evolveum/midpoint/repo/sql/data/common/RObject.java
    M repo/repo-sql-impl/src/main/java/com/evolveum/midpoint/repo/sql/data/common/any/RAssignmentExtension.java
    M repo/repo-sql-impl/src/main/java/com/evolveum/midpoint/repo/sql/helpers/ObjectDeltaUpdater.java
    M repo/repo-sql-impl/src/main/java/com/evolveum/midpoint/repo/sql/helpers/ObjectUpdater.java
    M repo/repo-test-util/src/main/java/com/evolveum/midpoint/test/AbstractHigherUnitTest.java
    M repo/repo-test-util/src/main/java/com/evolveum/midpoint/test/AbstractIntegrationTest.java
    M repo/security-enforcer-impl/src/main/java/com/evolveum/midpoint/security/enforcer/impl/SecurityEnforcerImpl.java
    M testing/sanity/src/test/java/com/evolveum/midpoint/testing/sanity/TestSanity.java
    M testing/story/src/test/java/com/evolveum/midpoint/testing/story/TestConsistencyMechanism.java
    M testing/story/src/test/resources/ldap/recon-perf/resource-opendj.xml

  Log Message:
  -----------
  Merge branch 'feature/prism-perf-improvements'

# Conflicts:
#	repo/repo-sql-impl/src/main/java/com/evolveum/midpoint/repo/sql/helpers/ObjectUpdater.java


  Commit: a2280b2eadf0495be7c82cc0933cc538fd219c0a
      https://github.com/Evolveum/midpoint/commit/a2280b2eadf0495be7c82cc0933cc538fd219c0a
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2019-06-14 (Fri, 14 Jun 2019)

  Changed paths:
    M model/model-impl/src/test/java/com/evolveum/midpoint/model/impl/AbstractInternalModelIntegrationTest.java
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/AbstractConfiguredModelIntegrationTest.java
    M model/model-intest/src/test/java/com/evolveum/midpoint/model/intest/password/AbstractPasswordTest.java
    M model/model-test/src/main/java/com/evolveum/midpoint/model/test/AbstractModelIntegrationTest.java
    M testing/story/pom.xml
    A testing/story/src/test/java/com/evolveum/midpoint/testing/story/perf/Generate.java
    A testing/story/src/test/java/com/evolveum/midpoint/testing/story/perf/TestImport.java
    A testing/story/src/test/resources/perf/import/org-basic.xml
    A testing/story/src/test/resources/perf/import/resource-source.xml
    A testing/story/src/test/resources/perf/import/source.sql
    A testing/story/src/test/resources/perf/import/system-configuration.xml
    A testing/story/src/test/resources/perf/import/task-import.xml
    A testing/story/src/test/resources/perf/import/template-import.xml
    A testing/story/src/test/resources/schema/perf-import.xsd

  Log Message:
  -----------
  Add bulk import performance test (MID-5368)


  Commit: 6bbe6dcfd237fcd0489859ff8b3457b3d12a0a5d
      https://github.com/Evolveum/midpoint/commit/6bbe6dcfd237fcd0489859ff8b3457b3d12a0a5d
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2019-06-14 (Fri, 14 Jun 2019)

  Changed paths:
    M infra/util/src/main/java/com/evolveum/midpoint/util/aspect/MidpointInterceptor.java
    M repo/repo-sql-impl-test/src/main/java/com/evolveum/midpoint/repo/sql/testing/TestSqlRepositoryFactory.java
    M repo/repo-sql-impl-test/src/main/java/com/evolveum/midpoint/repo/sql/testing/TestSqlRepositoryServiceImpl.java
    M repo/repo-test-util/src/main/java/com/evolveum/midpoint/test/DummyAuditService.java
    M testing/story/src/test/java/com/evolveum/midpoint/testing/story/perf/TestImport.java
    M testing/story/src/test/resources/perf/import/system-configuration.xml

  Log Message:
  -----------
  Adapt bulk import test

1. Disabled dummy audit service to avoid memory leak (audit records)
2. Configured regular profiling intervals to observe performance

Temporarily disabled TestSqlRepositoryServiceImpl - but the class
currently does nothing, so nothing changed by this.


  Commit: f6a6a7620629f44def6828ffa33ef9c85a520667
      https://github.com/Evolveum/midpoint/commit/f6a6a7620629f44def6828ffa33ef9c85a520667
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2019-06-14 (Fri, 14 Jun 2019)

  Changed paths:
    M infra/prism-impl/src/main/java/com/evolveum/midpoint/prism/impl/marshaller/PrismMarshaller.java

  Log Message:
  -----------
  Fix erroneous "Trying to skip ..." messages


  Commit: ca907c0ee1fd03012ecb38a48a3198ce58b75c99
      https://github.com/Evolveum/midpoint/commit/ca907c0ee1fd03012ecb38a48a3198ce58b75c99
  Author: Pavol Mederly <mederly at evolveum.com>
  Date:   2019-06-14 (Fri, 14 Jun 2019)

  Changed paths:
    M gui/admin-gui/src/main/java/com/evolveum/midpoint/web/component/objectdetails/FocusTasksTabPanel.java
    M gui/admin-gui/src/main/java/com/evolveum/midpoint/web/page/admin/server/PageTasks.html
    M gui/admin-gui/src/main/java/com/evolveum/midpoint/web/page/admin/server/PageTasks.java
    A gui/admin-gui/src/main/java/com/evolveum/midpoint/web/page/admin/server/TaskDtoTablePanel.html
    A gui/admin-gui/src/main/java/com/evolveum/midpoint/web/page/admin/server/TaskDtoTablePanel.java
    M gui/admin-gui/src/main/java/com/evolveum/midpoint/web/page/admin/server/dto/TaskDtoProvider.java
    M gui/admin-gui/src/main/java/com/evolveum/midpoint/web/page/admin/server/subtasks/SubtasksPanel.java
    M gui/admin-gui/src/main/java/com/evolveum/midpoint/web/session/SessionStorage.java
    M gui/admin-gui/src/main/resources/localization/Midpoint_cs.properties
    M gui/admin-gui/src/main/resources/localization/Midpoint_de.properties
    M gui/admin-gui/src/main/resources/localization/Midpoint_en.properties
    M gui/admin-gui/src/main/resources/localization/Midpoint_es.properties
    M gui/admin-gui/src/main/resources/localization/Midpoint_et.properties
    M gui/admin-gui/src/main/resources/localization/Midpoint_fi.properties
    M gui/admin-gui/src/main/resources/localization/Midpoint_fr.properties
    M gui/admin-gui/src/main/resources/localization/Midpoint_hu.properties
    M gui/admin-gui/src/main/resources/localization/Midpoint_it.properties
    M gui/admin-gui/src/main/resources/localization/Midpoint_ja.properties
    M gui/admin-gui/src/main/resources/localization/Midpoint_lt.properties
    M gui/admin-gui/src/main/resources/localization/Midpoint_pl.properties
    M gui/admin-gui/src/main/resources/localization/Midpoint_pt_BR.properties
    M gui/admin-gui/src/main/resources/localization/Midpoint_ru.properties
    M gui/admin-gui/src/main/resources/localization/Midpoint_sk.properties
    M gui/admin-gui/src/main/resources/localization/Midpoint_tr.properties
    M gui/admin-gui/src/main/resources/localization/Midpoint_zh_CN.properties

  Log Message:
  -----------
  Merge remote-tracking branch 'origin/master'


Compare: https://github.com/Evolveum/midpoint/compare/997c47dffdb7...ca907c0ee1fd

More information about the midPoint-svn mailing list