Skip to content

Commit

Permalink
adding the poster link
Browse files Browse the repository at this point in the history
  • Loading branch information
A-acuto committed Oct 18, 2023
1 parent 659a3d8 commit c534617
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
Python implementation of project exploring reinforcement algorithms using YAWNING TITAN software for network cyber defence.

## About The Project
We employed [YAWNING-TITAN](https://github.com/dstl/YAWNING-TITAN) (**YT**), an abstract, graph based cyber-security simulation environment to train intelligent agents for autonomous cyber operations. We have use model-free reinforcement learning algorithms from [Stable Baselines3](https://github.com/DLR-RM/stable-baselines3) for training and deploying in a set of different networks with increased complexity, status change and challenge. The main focus lies in the deployment of realistic agents in unseen networks. This work was presented at [CAMLIS](https://www.camlis.org/) conference in October 2023, this repository is publicly available but the project will not be updated with new development. You can see the poster presented at CAMLIS here (add link to research gate)
We employed [YAWNING-TITAN](https://github.com/dstl/YAWNING-TITAN) (**YT**), an abstract, graph based cyber-security simulation environment to train intelligent agents for autonomous cyber operations. We have use model-free reinforcement learning algorithms from [Stable Baselines3](https://github.com/DLR-RM/stable-baselines3) for training and deploying in a set of different networks with increased complexity, status change and challenge. The main focus lies in the deployment of realistic agents in unseen networks. This work was presented at [CAMLIS](https://www.camlis.org/) conference in October 2023, this repository is publicly available but the project will not be updated with new development. You can see the poster presented at [CAMLIS here](https://www.researchgate.net/publication/374783421_Defending_the_unknown_Exploring_reinforcement_learning_agents'_deployment_in_realistic_unseen_networks)

## Abstract
The increasing number of network simulators has opened opportunities to explore and apply state-of-the-art algorithms to understand and measure the capabilities of such techniques in numerous sectors. In this regard, the recently released Yawning Titan is one example of a simplistic, but not less detailed, representation of a cyber network scenario where it is possible to train agents guided by reinforcement learning algorithms and measure their effectiveness in trying to stop an infection. In this paper, we explore how different reinforcement learning algorithms lead the training of various agents in different examples and realistic networks. We assess how we can deploy such agents in a set of networks, focusing in particular on the resilience of the agents in exploring networks with complex starting states, increased number of routes connecting the nodes and different levels of challenge, aiming to evaluate the deployment performances in realistic networks never seen before.
Expand Down Expand Up @@ -33,7 +33,7 @@ with nodes compromised or isolated, performances against a weaker or stronger re
by a random agent and the same trained RL on the synthetic networks used for training.
- [RL_plottings.py](https://github.com/A-acuto/RLYawningTitan/blob/main/RL_plottings.py) : code containing the plotting routines used to generate the plots on the project.
- [RL_utils.py](https://github.com/A-acuto/RLYawningTitan/blob/main/RL_utils.py) : code containing some ad-hoc functions used in the project for data management and handling.
-

Directories:
- Networks: directory containing the examples networks to run the codes present in the repository;
- logs_dir: directory containing the trained models, information about the training performances;
Expand Down

0 comments on commit c534617

Please sign in to comment.