opendc.git/opendc-trace/opendc-trace-wtf/src/main/kotlin/org/opendc/trace/wtf, branch master

Revamped the trace system. All TraceFormat files are now in the api m… (#216)

2024-04-16T07:29:53+00:00

* Revamped the trace system. All TraceFormat files are now in the api module. This fixes some problems with not being able to use types of traces

* applied spotless

Updated package versions, updated web server tests. (#207)

2024-03-05T12:23:57+00:00

* Updated all package versions including kotlin. Updated all web-server tests to run.

* Changed the java version of the tests. OpenDC now only supports java 19.

* small update

* test update

* new update

* updated docker version to 19

* updated docker version to 19

fix(trace/wtf): Disable Parquet strict typing

2022-12-14T00:24:24+00:00

This change fixes an issue where some of the traces from the Workflow
Trace Archive would fail to load with the trace format in OpenDC. This
was caused by one of the fields being stored as a double, while the
formats expects it to be a long.

Parquet does not support unioning primitive types. Therefore, we have to
disable strict type checking when reading the file. Furthermore, we need
to support double entries for storing the workflow ids.

build: Switch to Spotless for formatting

2022-10-06T12:46:56+00:00

This change updates the build configuration to use Spotless for code
formating of both Kotlin and Java.

style: Eliminate use of wildcard imports

2022-10-06T10:51:27+00:00

This change updates the repository to remove the use of wildcard imports
everywhere. Wildcard imports are not allowed by default by Ktlint as
well as Google's Java style guide.

test(trace): Add conformance suite for OpenDC trace API

2022-06-08T13:06:14+00:00

This change adds a re-usable test suite for the interface of the OpenDC
trace API, so implementors can verify whether they match the
specification of the interfaces.

refactor(trace/api): Introduce type system for trace API

2022-06-07T13:46:53+00:00

This change updates the trace API by introducing a limited type system
for the table columns. Previously, the table columns could have any
possible type representable by the JVM. With this change, we limit the
available types to a small type system.

feat(trace/api): Add support for projecting tables

2022-05-02T13:37:04+00:00

This change adds support for projecting certain columns of a table. This
enables faster reading for tables with high number of columns.
Currently, we support projection in the Parquet-based workload formats.
Other formats are text-based and will probably not benefit much from
projection.

refactor(trace/parquet): Drop dependency on Avro

2022-05-02T13:37:03+00:00

This change updates the Parquet support library in OpenDC to not rely on
Avro, but instead interface directly with Parquet's reading and writing
functionality, providing less overhead.

refactor(trace/wtf): Do not use Avro when reading WTF trace

2022-05-02T13:37:03+00:00

This change updates the Workflow Trace format implementation in OpenDC to
not use the `parquet-avro` library for exporting experiment data, but
instead to use the low-level APIs to directly read the data from Parquet.

This reduces the amount of conversions necessary before reaching the
OpenDC trace API.