summaryrefslogtreecommitdiff
AgeCommit message (Collapse)Author
2024-11-01Updated computeService to force the simulation to stop when all tasks are ↵Dante Niewenhuis
finished (#259)
2024-10-30Added power sources to OpenDC (#258)Dante Niewenhuis
* Added power sources to OpenDC. In the current form each Cluster has a single power source that is connected to all hosts in that cluster * Added power sources to OpenDC. In the current form each Cluster has a single power source that is connected to all hosts in that cluster * Ran spotless Kotlin and Java
2024-10-29Updated all floats to Doubles (#257)Dante Niewenhuis
* Updated tests Changed all floats into doubles to have consistency over the whole framework Made a small update to the multiplexer to better push through supply and demand Fixed small typo Updated M3SA paths. fixed merge conflicts Removed unused components. Updated tests. Improved checkpointing model Improved model, started with SimPowerSource implemented FailureModels and Checkpointing First working version midway commit first update All simulation are now run with a single CPU and single MemoryUnit. multi CPUs are combined into one. This is for performance and explainability. * Updated test memory
2024-10-25Rewrote the FlowEngine (#256)Dante Niewenhuis
* Removed unused components. Updated tests. Improved checkpointing model Improved model, started with SimPowerSource implemented FailureModels and Checkpointing First working version midway commit first update All simulation are now run with a single CPU and single MemoryUnit. multi CPUs are combined into one. This is for performance and explainability. * fixed merge conflicts * Updated M3SA paths. * Fixed small typo
2024-10-25M3SA - Multi-Meta-Model Simulation Analyzer (#251)Radu Nicolae
* (feat) demo files are now ignored * integrating m3sa changes with opendc * gitignore ignores demo * m3sa linked, tested, works šŸŽ‰šŸŽ† * linting & checks fully pass * m3sa documentation (re...)added * package.json added, a potentail solution for Build Docker Images workflow * (fix) opendc-m3sa renamed to opendc-experiments-m3sa * (feat) Model is now a dataclass * (fix) package and package-lock reverted as before the PR, now they mirror the opendc master branch * (fix) Experiments renamed to experiment * branch updated with changes from master branch * trying to fix the build docker image failed workflow * trying to fix the build docker image failed workflow * All simulation are now run with a single CPU and single MemoryUnit. multi CPUs are combined into one. This is for performance and explainability. (#255) (#37) Co-authored-by: Dante Niewenhuis <d.niewenhuis@hotmail.com> * All simulation are now run with a single CPU and single MemoryUnit. multi CPUs are combined into one. This is for performance and explainability. (#255) (#38) Co-authored-by: Dante Niewenhuis <d.niewenhuis@hotmail.com> * All simulation are now run with a single CPU and single MemoryUnit. multi CPUs are combined into one. This is for performance and explainability. (#255) (#39) Co-authored-by: Dante Niewenhuis <d.niewenhuis@hotmail.com> * [TEMP](feat) m3saCli decoupled from experimentCli * spotless and minor refactoring * (feat)[TEMP] decoupling m3sa from experiment * spotless applied * documentation resolved * requirements.txt added * path to M3SA is now provided as a parameter to M3SACLI * spotless applied * (fix) python environment variables solved, output analysis folder solved * documentation changed and matching the master branch doc * package-lock reverted * package-lock reverted --------- Co-authored-by: Dante Niewenhuis <d.niewenhuis@hotmail.com>
2024-09-16All simulation are now run with a single CPU and single MemoryUnit. multi ↵Dante Niewenhuis
CPUs are combined into one. This is for performance and explainability. (#255)
2024-09-12Added max number of failures (#254)Dante Niewenhuis
* Added a max failure for tasks. If tasks fail more times, they get cancelled * Added maxNumFailures to the frontend * Updated tests
2024-09-10rewritten the checkpointing model (#250)Dante Niewenhuis
* Updated the checkpointing system to use SimTrace. The checkpoint model can now also scale, which means the interval between checkpoints can increase or decrease over time. * spotless kotlin * Fixed tests * spotless apply
2024-09-05Sim trace update (#249)Dante Niewenhuis
* Started on reimplementing the SimTrace implementation * updated trace format. Fragments now do not have a deadline, but a duration. The Fragments are executed in order.
2024-08-29Renamed Scenario to Experiment. A Scenario is now defined as a single setup. ↵Dante Niewenhuis
An experiment is a set of Scenarios. (#247)
2024-08-27Renamed input files and internally server is changed to task (#246)Dante Niewenhuis
* Updated SimTrace to use a single ArrayDeque instead of three separate lists for deadline, cpuUsage, and coreCount * Renamed input files to tasks.parquet and fragments.parquet. Renamed server to task. OpenDC nows exports tasks.parquet instead of server.parquet
2024-08-27Updated SimTrace to use a single ArrayDeque instead of three separate lists ↵Dante Niewenhuis
for deadline, cpuUsage, and coreCount (#245)
2024-08-22Refactored exporters. Allows output column selection in scenario (#241) (#241)Alessio Leonardo Tomei
2024-08-22Added Unit of measurament system with new deserialization (#242)Alessio Leonardo Tomei
2024-07-31updated ScenarioFactory and ScenarioSpec (#239)Dante Niewenhuis
* Initial Push * Refactored the cartesian implementation of ScenariosSpec.kt * Fixed typo * Some small updates * ran spotless
2024-07-19Fixed typo in gradle build file that caused the distribution to not run. (#237)Dante Niewenhuis
2024-07-12Merged experiment-scenario and experiment-base by moving ScenarioCli.kt to ↵Dante Niewenhuis
experiment-base. Renamed the distribution of experiment-base to OpenDCScenarioRunner (#236)
2024-06-17Fixed CPU limit problem (#234)Dante Niewenhuis
* Fixed a problem which caused the CPU limit to be much lower than it should be. AllocationPolicy is now properly exposed to the user * Fixed tests * spotless kotlin
2024-05-31Addded host_name and boot_time_absolute to the output files (#233)Dante Niewenhuis
Added host_name to the host output file. Added boot_time_absolute to the server output file. renamed absolute_timestamp to timestamp_absolute in all output files
2024-05-07Revamped failure models (#228)Dante Niewenhuis
2024-05-01Output folder structure (#225)Radu Nicolae
* unversioned demo - removed from git history unversioned filed pushed spotless applied code cleaned up commit before pr spotless applied setupOutputFolder moved before getting the scenarios specific topology added pretty tracking given scenarios are kept track by id code runnable output name for scenario updated python folder and src document connected simulationOutputFolder structure prepared base for python script integration in simulations output contents into a folder defined by the simulation name output contents into a folder defined by the simulation name * bugs with trackr.json (id not showing) solved. outputting bug also solved (now we use the output folder indicated in scenario.json input file) * spotless applied, ready for PR * var -> val in Scenario * ScenarioWriter package naming repaired
2024-04-29Reworked Scenario.kt to consist of only specifications. The Specs are turned ↵Dante Niewenhuis
into objects when the scenario is being executed by ScenarioRunner.kt (#227)
2024-04-29Fixed several cpu related bugs, changed input topology (#226)Dante Niewenhuis
2024-04-24Documentation update (#224)Radu Nicolae
2024-04-22returned the carbon traces to the scenarioSpec (#223)Dante Niewenhuis
2024-04-22Updated the power models and added tests (#222)Dante Niewenhuis
* Updated the power models and added tests * Updated test topologies
2024-04-22Merged scenario and portfolio (#220)Radu Nicolae
* sync with the master branch * rebase * multimodel - simulation is currently run as many times as you can see a model * factory method - handles models without given params * removed redundant flags * modelType * flags removed * implemented output into a folder * multimodel ipynb setup - to be implemented and also ran as a python script, when the simulation occurs * towards a mutimodel python implementation - issue observed - the saved files have same data? * json parsing handles now lists for topology, workloads, allocaitonPolicies, powerModels * scenarioFile inputs lists, and creates multiple combinations of scenarios * multi-model prediction repaired, now we predict using multiple models * commit before removing powerModel from scenario * commit after removing powerModel from scenario * commit after removing powerModel from scenario (and actually running) * powermodels now can output their name and full name (with min and max) * now we can select where to output (seed or output folder) * input files - clear naming + output naming improved * minimal changes * all tests passing + json files from tests updated to the new json format * json files from topology now accept only one power model (instead of list) * json files from topology now accept only one power model (instead of list) * multi and single input from tests updated to match the format * tests passed locally * spotless applies * demo folder removed
2024-04-17Added support for carbon traces (#218)Dante Niewenhuis
* Started with the carbon trace implementation * Moved the carbon trace system to the proper folders
2024-04-16Revamped the trace system. All TraceFormat files are now in the api m… (#216)Dante Niewenhuis
* Revamped the trace system. All TraceFormat files are now in the api module. This fixes some problems with not being able to use types of traces * applied spotless
2024-04-11Added absolute timestamp based on the given workload to the output files (#215)Dante Niewenhuis
2024-04-04Fixed scenario and portfolio experiment (#211)Dante Niewenhuis
* Fixed the scenario canBeFile problem * Fixed the scenario canBeFile problem
2024-03-19Scenario and Portfolio update (#209)Dante Niewenhuis
* Initial commit * Implemented a new systems of defining and running scenarios / portfolios. Scenarios and Portfolios can now be defined using JSON files similar to topologies. This allows user to define experiments without changing any KotLin code. * Ran spotlessApply
2024-03-05Cpu fix (#208)Dante Niewenhuis
* Updated the topology format to JSON. Updated TopologyReader.kt to handle JSON filed. Added documentation for the new format. * applied spotless kotlin * small update * Updated for spotless apply * Updated for spotless apply
2024-03-05Updated package versions, updated web server tests. (#207)Dante Niewenhuis
* Updated all package versions including kotlin. Updated all web-server tests to run. * Changed the java version of the tests. OpenDC now only supports java 19. * small update * test update * new update * updated docker version to 19 * updated docker version to 19
2024-02-16Metric update (#205)Dante Niewenhuis
* Updated metrics to consistently be ms * Updated metrics to consistently be ms * Updated metric documentation on the site * Updated some tests to work with the updated metrics
2024-02-16Added documentation for input and output (#203)Dante Niewenhuis
* Started with a documentation page * Started with a documentation page * Added documentation of the input required to run OpenDC, and the output returned by OpenDC to the website.
2024-02-14Updated metrics and parquet output (#195)Dante Niewenhuis
* Updated metrics and parquet output * fixed typos
2024-01-08refactored opendc-experiment-compute (#190)Dante Niewenhuis
* removed experiment-compute and integrated all components into opendc-compute * updated workflow gradle file * removed unneeded code
2023-12-14Updated tests to run successfully (#187)Dante Niewenhuis
* made sure all tests run * fixed typo * executed spotlessApply * added back web-server tests * updated SimTraceWorkloadTest * commented CapelinRunneer and GreenifierRunner tests * commented one SimTraceWorkloadTest * altered codecov execution * changed codecov
2023-11-21Merge pull request #170 from DanteNiewenhuis/export-formatDante Niewenhuis
updaded output format of parquet exporter
2023-11-21updaded output format of parquet exporterDante Niewenhuis
2023-11-15Merge pull request #168 from DanteNiewenhuis/greenifier-demoDante Niewenhuis
Updated the simulation to let servers run until they are finished.
2023-11-15fixed a problem with the Loggers by copying the dataDante Niewenhuis
2023-11-14Updated TraceReader, Simulation now continues until all tasks are doneDante Niewenhuis
2023-11-14added locks to spawned serversDante Niewenhuis
2023-11-13Merge pull request #167 from DanteNiewenhuis/greenifier-demoDante Niewenhuis
added greenifier demo, fixed HostTableReader
2023-11-10removed unneeded filesDante Niewenhuis
2023-11-10added greenifier demo, fixed HostTableReaderDante Niewenhuis
2023-10-29build: Update to Gradle 8.4 (#164)Fabian Mastenbroek
This diff updates the version of the Gradle wrapper embedded in the OpenDC repository to 8.4.
2023-10-29ci: Bump actions/setup-node from 3 to 4 (#160)dependabot[bot]
Bumps [actions/setup-node](https://github.com/actions/setup-node) from 3 to 4. - [Release notes](https://github.com/actions/setup-node/releases) - [Commits](https://github.com/actions/setup-node/compare/v3...v4) --- updated-dependencies: - dependency-name: actions/setup-node dependency-type: direct:production update-type: version-update:semver-major ... Signed-off-by: dependabot[bot] <support@github.com> Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>