v2.9.0

What's Changed

📘 Ldio:RepositoryMaterialiser ➡️ Ldio:RepositorySink

Due to the reposink not actually materialising the object passed through it, the name was very confusing.
This has been updated.
For more details, check out the documentation.

📈 Performance tweaks

• We fixed a memory issue inside the RepoSink. This should normally result in a smoother experience
• Additionally, we tweaked the LDES Client database interactions. This results in an overall 15% performance increase.

Change Notes

• chore: restructure ldio application by @Yalz in #659
• fix: #660: Repository Sink: performance degradation by @Yalz in #666
• docs: Add note for exactly once filter by @MPParsley in #665
• feat: RepoSink: delete skolem uris by @Yalz in #670
• chore: improve ci pipeline by @jobulcke in #672
• fix: optimize ldes client by @jobulcke in #681
• ci: finalise 2.9.0 by @Yalz in #683

New Contributors

• @MPParsley made their first contribution in #665

Full Changelog: v2.5.1...v2.9.0

📬 We eagerly await your feedback!

v2.8.0-alpha

What's Changed

• Feat: ldes client status by @Yalz in #654
• Feat: create version object processor accepts list of member types by @pj-cegeka in #656
• Fix: expand empty check on member types by @pj-cegeka in #657

Full Changelog: v2.7.0-alpha...v2.8.0-alpha

v2.7.0-alpha

What's Changed

Features

• A NiFi processor has been added, that makes it possible to make RML mappings in NiFi in #636
• The LdioLdesClient can now better handle LDES'es that has ended in #645
• Javadoc has been added to most of the codebase, which should make this open source code more accessible in #643 and #646

Fixes

• non-string datatype literals were converted to their fully quallified name instead of the containing value in the RDF4JRepositoryMaterialiser, which has been fixed in #644

Full Changelog: v2.6.0-alpha...v2.7.0-alpha

v2.6.0-alpha

What's Changed

Features

Latest State Filter
A new filter is added into the Ldes Client that keeps track whether a member is a representation of the latest state or not
Change Detection Filter
A new transformer component is added that acts like a filter that keeps track whether the state of a state object has changed or not

Fixes

RML mapper concurrency issues
There were some issues detected resulting in two members transformed through the RML mapper were sent twice and others not al all. This has been fixed now
NiFi property names streamlined
Some of the NiFi property names were not consistent, or some were incorrect duplicates. This has been fixed now

Full Changelog: v2.5.1...v2.6.0-alpha

v2.5.1

What's Changed

A bug was detected when a pipeline was deleted that was not using Ldio:LdesClientConnector as input, a NullPointerException was thrown, which is resolved via a hotfix in #604

What's Changed

• ci: finalise 2.1.0 release by @Yalz in #520
• Feat/graphdb performance inc by @jobulcke in #508
• fix: unexpected behaviour when no url list was provided for the LdesClient by @jobulcke in #518
• feat: LDIO noop by @Yalz in #512
• fix: blocked client connector by @Yalz in #523
• fix: unexpected empty url list behavior by @jobulcke in #522
• fix: remove file based retention for client by @Tomvbe in #519
• feat: binary ldes client by @jobulcke in #529
• fix: remove body from delete request by @Tomvbe in #533
• fix: unexpected behavior when no adapter was configured by @jobulcke in #535
• fix: make memory state consistent by @Tomvbe in #528
• fix: gh 501 by @jobulcke in #536
• ci: finalise release 2.2.0 by @jobulcke in #537
• Feat: use exactly once filter by @pj-cegeka in #532
• fix: #473: support Json-LD 1.1 framing + create LdiRdfWriter once per pipeline. by @Yalz in #541
• feat: Add swagger to the management API by @Tomvbe in #544
• fix: Json-To-JsonLD Adapter: support context objects by @Yalz in #547
• Fix: client tests by @pj-cegeka in #543
• fix: document how to config swagger by @Tomvbe in #550
• feat: improve client performance by @Tomvbe in #548
• fix: materialiser not starting by @Tomvbe in #553
• fix: support arrays in FlattenDeserializer by @Tomvbe in #554
• fix: fix broken link by @jeflaenen in #555
• Develop by @Tomvbe in #556
• fix: #539 #540: Pick up failing Request Executor IT + fixed. by @Yalz in #558
• fix: repository materialiser deletion bugs by @jobulcke in #557
• fix: #539 #540 : pick up ITs + fix broken Request Executor IT by @Yalz in #560
• fix: repo materialiser lang tag bug by @jobulcke in #559
• fix: improve logging of HttpPoller by @Tomvbe in #564
• feat: implement redirect logic by @Tomvbe in #563
• fix: make example less strict to deal with invalid source data by @Tomvbe in #567
• fix: use generic example in docs by @Tomvbe in #568
• fix: separate ldio status from triggers by @Tomvbe in #569
• fix: broken pipeline status event handler by @jobulcke in #570
• fix: deletion outside named graph by @jobulcke in #571
• fix: change default format to support relative uris by default by @jobulcke in #572
• fea: java 21 upgrade by @jobulcke in #573
• fix: error message by @pj-cegeka in #575
• fix ldes discoverer bad error logging by @jobulcke in #576
• fix: add missing tests by @Tomvbe in #577
• Feat: expand status docs by @pj-cegeka in #578
• chore: update codeowners by @jobulcke in #579
• feat: upgrade NiFi base image by @jobulcke in #583
• ci: finalize release 2.4.0 by @jobulcke in #581
• ci: prepare release 2.5.0 by @jobulcke in #584
• fix: improve log messages when statements cannot be found in model by @ferre-vaes in #587
• chore: retire LDIO File-In, File Out, Azure Blob Out components by @Yalz in #585
• feat: extend the functionality of the request executor in the discoverer by @jobulcke in #586
• feat: VSDSPUB-1296: document how to start up LDIO container by @ferre-vaes in #592
• fix: clean up ldi inputs ctors by @jobulcke in #590
• docs: embed ldio-core pages + merge ldi-core pages with ldio by @Yalz in #594
• fix: LDIO Adapter: Use InputStream to support protobuf by @Yalz in #596
• docs: VSDSPUB-1293 - LDIO LDES Client Config by @jeflaenen in #589
• Docs: VSDSPUB-1299 - Update LDIO Adapters by @jeflaenen in #593
• feat: nar bundle by @jobulcke in #597
• ci: finalize release 2.5.0 by @ferre-vaes in #598
• hotfix: nullpointer exception on pipeline deletion by @jobulcke in #604
• [ci] Promote snapshot 2.5.1 by @github-actions in #611

Full Changelog: v2.0.0...v2.5.1

v2.5.0-alpha

What's Changed

Features

• feat: extend the functionality of the request executor in the discoverer in #586
• feat: VSDSPUB-1296: document how to start up LDIO container in #592
• feat: nar bundle in #597

Fixes

• fix: improve log messages when statements cannot be found in model in #587
• fix: clean up ldi inputs ctors in #590
• fix: LDIO Adapter: Use InputStream to support protobuf in #596

Documentation

• docs: embed ldio-core pages + merge ldi-core pages with ldio in #594
• docs: VSDSPUB-1293 - LDIO LDES Client Config in #589
• docs: VSDSPUB-1299 - Update LDIO Adapters in #593

Others

• chore: retire LDIO File-In, File Out, Azure Blob Out components in #585

New Contributors

• @ferre-vaes made their first contribution in #587

Full Changelog: v2.4.0-alpha...v2.5.0-alpha

v2.4.0-alpha

In this release, no new features are implemented, but only bug fixes are provided and stability has been increased.

What's Changed

Repository materialiser bugs

• fix: repository materialiser deletion bugs by @jobulcke in #557
• fix: repo materialiser lang tag bug by @jobulcke in #559
• fix: deletion outside named graph by @jobulcke in #571

Testing bugs and improvements

• fix: pick up ITs + fix broken Request Executor IT by @Yalz in #558 and #560
• fix: add missing tests by @Tomvbe in #577

Logging improvements

• fix: improve logging of HttpPoller by @Tomvbe in #564
• fix ldes discoverer bad error logging by @jobulcke in #576
• fix: error message by @pj-cegeka in #575

Documentation improvements

• fix: make example less strict to deal with invalid source data by @Tomvbe in #567
• fix: use generic example in docs by @Tomvbe in #568
• fix: expand status docs by @pj-cegeka in #578

Others
*feat: implement redirect logic by @Tomvbe in #563

• fix: separate ldio status from triggers by @Tomvbe in #569
• fix: broken pipeline status event handler by @jobulcke in #570
• fix: change default format to support relative uris by default by @jobulcke in #572
• chore: java 21 upgrade by @jobulcke in #573

Full Changelog: v2.3.0-alpha...v2.4.0-alpha

v2.3.0-alpha

What's Changed

Features

• feat: improve graphdb performance inc in #508
• feat: add LDIO noop out component in #512
• feat: add binary support for ldes client in #529
• feat: implement exactly once filter in #532
• feat: improve client performance in #548
• feat: Add swagger to the management API in #544

Fixes

• fix: unexpected behaviour when no url list was provided for the LdesClient in #518
• fix: blocked client connector in #523
• fix: unexpected empty url list behavior in #522
• fix: remove file based retention for client in #519
• fix: remove body from delete request in #533
• fix: unexpected behavior when no adapter was configured in #535
• fix: make memory state consistent in #528
• fix: fix repository materialiser in #536
• fix: support Json-LD 1.1 framing + create LdiRdfWriter once per pipeline. in #541
• fix: Json-To-JsonLD Adapter: support context objects in #547
• fix: materialiser not starting in #553
• fix: support arrays in FlattenDeserializer in #554
• fix: improve documentation in #555, #550

Full Changelog: v2.0.0...v2.3.0-alpha

v2.2.0-alpha

What's Changed

The default source-format used by the ldio-ldes-client has been changed from application/ld+json to text/turlte, as this is the most performant to be parsed by the Jena library that also supports relative uri's

Features

• feat: LDIO noop output in #521
• feat: binary ldes client #529

Fixes

• Increase performance when writing to the graph db and fix missing logging when the materialiser crashed in
  #508 and #536
• fix: make memory state consistent in #528
• fix: unexpected behavior when no adapter was configured in #535
• fix: remove body from delete request in #533
• fix: remove file based retention for client #519
• fix: unexpected empty url list behavior #522
• fix: unexpected behaviour when no url list was provided for the LdesClient #518
• fix: init phase of client connector prevented pipeline to be registered in #523

Full Changelog: v2.1.0-alpha...v2.2.0-alpha

v2.1.0 alpha

What's Changed

Features

• feat: AMQP Out as LDIO Output in #498
• feat: Dynamic pipelines (add pipelines on the fly) + related status updates in #503 & #510
  → For more details on this feature, visit the documentation page
• feat: Request Executor: Allow usage of form encoded credentials in #502