diff options
| author | Fabian Mastenbroek <mail.fabianm@gmail.com> | 2021-06-09 14:16:10 +0200 |
|---|---|---|
| committer | GitHub <noreply@github.com> | 2021-06-09 14:16:10 +0200 |
| commit | e2f6cd904ccd8018b65ff897181388ae3f02ae6f (patch) | |
| tree | 96efef3c0aa511093c793dae6ea648448510bb68 /gradle/libs.versions.toml | |
| parent | 38ef2cabbecf694f66fa3bd5e69b9431c56a3f8d (diff) | |
| parent | 0eb4fa604efe4e0b84d69749f688a79c2249c8b3 (diff) | |
Remove dependency on Hadoop
This pull request attempts to remove the dependency of the simulator on Apache Hadoop
which is pulled in as a consequence of using parquet-mr.
The reason for removal is that Apache Hadoop does not work natively on Windows
without user intervention, which makes adoption on this platform more difficult.
* Add Windows as CI target for the OpenDC simulator
* Use `LocalInputFile` for Parquet reader usages
* Use `LocalOutputFile` for Parquet writer usages
* Remove Apache Hadoop as dependency of OpenDC.
Diffstat (limited to 'gradle/libs.versions.toml')
| -rw-r--r-- | gradle/libs.versions.toml | 4 |
1 files changed, 3 insertions, 1 deletions
diff --git a/gradle/libs.versions.toml b/gradle/libs.versions.toml index 1d7fdd3e..22f713f6 100644 --- a/gradle/libs.versions.toml +++ b/gradle/libs.versions.toml @@ -5,6 +5,7 @@ slf4j = "1.7.30" log4j = "2.14.1" opentelemetry-main = "1.2.0" opentelemetry-metrics = "1.2.0-alpha" +hadoop = "3.3.0" [libraries] kotlinx-coroutines = { module = "org.jetbrains.kotlinx:kotlinx-coroutines-core", version = "1.5.0" } @@ -45,4 +46,5 @@ kotlinx-benchmark-runtime-jvm = { module = "org.jetbrains.kotlinx:kotlinx-benchm # Other mongodb = { module = "org.mongodb:mongodb-driver-sync", version = "4.2.3" } classgraph = { module = "io.github.classgraph:classgraph", version = "4.8.105" } -hadoop-client = { module = "org.apache.hadoop:hadoop-client", version = "3.3.0" } +hadoop-common = { module = "org.apache.hadoop:hadoop-common", version.ref = "hadoop" } +hadoop-mapreduce-client-core = { module = "org.apache.hadoop:hadoop-mapreduce-client-core", version.ref = "hadoop" } |