summaryrefslogtreecommitdiff
path: root/simulator
AgeCommit message (Collapse)Author
2021-04-25build: Migrate to flat project structureFabian Mastenbroek
This change updates the project structure to become flattened. Previously, the simulator, frontend and API each lived into their own directory. With this change, all modules of the project live in the top-level directory of the repository. This should improve discoverability of modules of the project.
2021-04-23simulator: Add the MSE power model (#121)Hongyu
This change adds a power model for optimizing the mean squared error to the available power models in OpenDC.
2021-04-21simulator: Introduce SimulationCoroutineDispatcher (#120)Fabian Mastenbroek
This change introduces the SimulationCoroutineDispatcher implementation which replaces the TestCoroutineDispatcher for running single-threaded simulations.
2021-04-21simulator: Migrate to SimulationCoroutineDispatcherFabian Mastenbroek
This change migrates the remainder of the codebase to the SimulationCoroutineDispatcher implementation.
2021-04-21simulator: Introduce SimulationCoroutineDispatcherFabian Mastenbroek
This change introduces the SimulationCoroutineDispatcher implementation which replaces the TestCoroutineDispatcher for running single-threaded simulations. Previously, we used the TestCoroutineDispatcher from the kotlinx-coroutines-test modules for running simulations. However, this module is aimed at coroutine tests and not at simulations. In particular, having to construct a Clock object each time for the TestCoroutineDispatcher caused a lot of unnecessary lines. With the new approach, the SimulationCoroutineDispatcher automatically exposes a usable Clock object. In addition to ergonomic benefits, the SimulationCoroutineDispatcher is much faster than the TestCoroutineDispatcher due to the assumption that simulations run in only a single thread. As a result, the dispatcher does not need to perform synchronization and can use the fast PriorityQueue implementation.
2021-04-20build: Add workaround for kotlinx-benchmark with Gradle 7Fabian Mastenbroek
This change adds a quick workaround for getting kotlinx-benchmark to work again with Gradle 7. See https://github.com/Kotlin/kotlinx-benchmark/issues/39.
2021-04-15exp: Prevent re-use of SimWorkload in experimentFabian Mastenbroek
This change fixes and issue where a SimWorkload was being re-used across simulation runs. Given that SimWorkload is stateless, this may cause strange issues.
2021-04-15exp: Re-use topology across repeatsFabian Mastenbroek
This change modifies the web runner to construct the topology only once per repeat, given that the construction does not depend on the repeat number.
2021-04-14exp: Fix incorrect filter scheduler weightsFabian Mastenbroek
This change fixes an issue where incorrect scheduling weights were applied to the filter scheduler.
2021-04-14simulator: Introduce SimProcessingUnitFabian Mastenbroek
This change introduces the SimProcessingUnit which represents a simulated processing unit which the user can control during the workload execution.
2021-04-14exp: Simplify power usage calculationFabian Mastenbroek
This change simplifies the conversion from power to energy consumption used in the web runner. Now, we convert straight from J to Wh.
2021-04-14harness: Enable failures only on requestFabian Mastenbroek
This changes fixes a bug where the simulator obtained the incorrect failure frequency causing failures to be enabled even when the user disabled it.
2021-04-12Migrate to Gradle 7.0 (#115)Fabian Mastenbroek
This pull request updates the Kotlin project to build with Gradle 7.0. This is necessary to support building the project with Java 16.
2021-04-12simulator: Add the asymptotic power model from GreenCloud (#114)Hongyu
This change adds the asymptotic power model that is used in GreenCloud to the available power models in OpenDC.
2021-04-08compute: Implement filter schedulerFabian Mastenbroek
This pull request implements the filter scheduler modeled after the scheduler from [OpenStack](https://docs.openstack.org/nova/latest/user/filter-scheduler.html). The scheduler is functionally equivalent to the old allocation policies, but is more flexible and allows policies to be combined. * A new interface, `ComputeScheduler` is introduced, which is used by the `ComputeServiceImpl` to pick hosts to schedule on. * `FilterScheduler` is implemented, which works by filtering and weighing the available hosts. **Breaking API Changes** * Removal of the `AllocationPolicy` interface and its implementations. Users should migrate to the filter scheduler which offers the same functionality and more.
2021-04-08serverless: Model cold start delaysFabian Mastenbroek
2021-04-08serverless: Track metrics per functionFabian Mastenbroek
This change adds metrics that are tracked per function instance, which includes the runtime of the invocations, the number of invocations (total, warm, cold, failed).
2021-04-08exp: Add experiment testing the serverless moduleFabian Mastenbroek
This change adds an experiments testing the OpenDC Serverless module.
2021-04-08exp: Add trace reader for Serverless experimentsFabian Mastenbroek
This change adds the trace reader for the serverless experiments as described in #48.
2021-04-08serverless: Add possibility to specify function memory requirementsFabian Mastenbroek
2021-04-08serverless: Expose metrics from Serverless serviceFabian Mastenbroek
This change exposes several metrics from the Serverless service, which are needed for the experiments.
2021-04-08compute: Migrate to new FilterSchedulerFabian Mastenbroek
This change migrates the OpenDC codebase to use the new FilterScheduler for scheduling virtual machines. This removes the old allocation policies as well.
2021-04-08compute: Implement filter schedulerFabian Mastenbroek
This change adds an implementation of the filter scheduler to the OpenDC Compute module. This is modeled after the filter scheduler implementation in OpenStack and should allow for more flexible scheduling policies. See: https://docs.openstack.org/nova/latest/user/filter-scheduler.html
2021-04-08exp: Add experiment for OpenDC Energy projectFabian Mastenbroek
This change adds an experiment for the OpenDC Energy project, which tests various energy models that have been implemented in OpenDC.
2021-04-08exp: Fix metric recording of summary dataFabian Mastenbroek
This change fixes an issue in the metric exporter for summary metrics, where instead of some average value, the sum value was reported.
2021-04-08compute: Use BatchRecorder to emit metricsFabian Mastenbroek
This change updates the SimHost implementation to use BatchRecorder to batch record multiple metrics at once.
2021-04-08simulator: Divide CPU usage over all coresFabian Mastenbroek
This change fixes an issue in SimTraceWorkload where the CPU usage was not divided across the cores, but was instead requested for all cores.
2021-04-08compute: Fix random allocation policyFabian Mastenbroek
This change fixes an issue in the RandomAllocationPolicy where it would incorrectly obtain the required memory for the server.
2021-04-08exp: Simplify metric reporting via monitorFabian Mastenbroek
This change simplifies the way metrics are reported to the monitor. Previously, power draw was collected separately from the other metrics. However, with the migration to OpenTelemetry, we collect all metrics every 5 minutes, which drastically simplifies the metric gathering logic.
2021-04-08simulator: Perform usage propagation only on changeFabian Mastenbroek
This change updates the logic in SimAbstractMachine to only propagate usages when the value has changed.
2021-04-07utils: Prevent use of Intrinsics.areEqual in scheduler hot pathFabian Mastenbroek
This change changes the TimerScheduler implementation to prevent calling Intrinsics.areEqual in the hot path. Profiling shows that especially this call has a high overhead.
2021-04-07simulator: Move away from StateFlow for low-level monitoringFabian Mastenbroek
This change removes the StateFlow speed property on the SimResourceSource, as the overhead of emitting changes to the StateFlow is too high in a single-thread context. Our new approach is to use direct callbacks and counters.
2021-04-07utils: Cache variables in TimerScheduler's hot pathsFabian Mastenbroek
This change updates the TimerScheduler implementation to cache several variables in the hot paths of the implementation.
2021-04-07simulator: Add tests for CPUFreq subsystemFabian Mastenbroek
2021-04-07simulator: Polish power modelsHongyu
This change updates the power models by fixing some of the documentation and adding toString() methods.
2021-04-07simulator: Add initial design of CPUFreq modelFabian Mastenbroek
This change adds a model implementing Dynamic Voltage Frequency Scaling (DVFS) to OpenDC.
2021-03-27Integrate OpenTelemetry into OpenDCFabian Mastenbroek
This pull request resolves issue #91 by adopting the industry-standard OpenTelemetry standard for collecting traces and metrics in OpenDC simulations: * Metrics will now be exposed through OpenTelemetry's metrics API * `opendc-telemetry` provides complementary code to support gathering telemetry in OpenDC. **Breaking API Changes** * `opendc-tracer` has been removed. * `EventFlow` and all usages of it have been removed. * `opendc-experiments-sc18` has been removed for now, but a suitable replacement will follow soon.
2021-03-27compute: Migrate compute service simulator to OpenTelemetryFabian Mastenbroek
This change updates the compute service simulator to use OpenTelemetry for reporting metrics of the (simulated) hosts as opposed to using custom event flows. This approach is more generic, flexible and possibly offers better performance as we can collect metrics of all services in a single sweep, as opposed to listening to several services and each invoking the handlers.
2021-03-26simulator: Cache remaining workFabian Mastenbroek
This change updates the resource model implementation to cache the remaining work field, which was being computed multiple times during the same cycle.
2021-03-26simulator: Extract hardware power values to a separate file (#105)Hongyu
This change enables the use of the interpolation model testing on the results of the SPEC benchmark.
2021-03-26tracer: Remove event tracer from repositoryFabian Mastenbroek
This change removes the event tracer from the repository as we migrate to the industry standard OpenTelemetry.
2021-03-26workflow: Remove event tracer from workflow serviceFabian Mastenbroek
This change removes the event tracer from the OpenDC Workflow service as we start migrating to the industry standard OpenTelemetry.
2021-03-26compute: Integrate OpenTelemetry Metrics in OpenDC WorkflowFabian Mastenbroek
This change integrates the OpenTelemetry Metrics API in the OpenDC Workflow Service implementation. This replaces the old infrastructure for gathering metrics.
2021-03-26compute: Integrate OpenTelemetry Metrics in OpenDC ComputeFabian Mastenbroek
This change integrates the OpenTelemetry Metrics API in the OpenDC Compute Service implementation. This replaces the old infrastructure for gathering metrics.
2021-03-26compute: Remove dependency on event tracerFabian Mastenbroek
This change removes the dependency on the event tracer in `opendc-trace`, since we are in the process of migrating OpenDC to use OpenTelemetry for distributed tracing and metrics.
2021-03-26compute: Hide internals of compute service implementationFabian Mastenbroek
This change changes the compute service and users of the compute service to not rely on the internals of `ComputeServiceImpl` and instead use its public API.
2021-03-26compute: Add test suite for ComputeServiceFabian Mastenbroek
This change adds a test suite for the OpenDC compute service.
2021-03-24simulator: Move power models to simulator moduleFabian Mastenbroek
This change moves the power models from the `opendc-compute-simulator` to the `opendc-simulator-compute` module, since it better fits the scope of the models and allows them to be re-used for other purposes.
2021-03-23simulator: Add support for transforming resource consumersFabian Mastenbroek
This change adds support for transforming the resource commands emitted by the resource consumers. The SimResourceForwarder is modified to also support transforming the resource commands.
2021-03-23simulator: Add benchmarks for opendc-simulator-computeFabian Mastenbroek
This change adds benchmarks to the opendc-simulator-compute module in order to quantify effect of changes on the performance of this module.