FRLlibTrainingSettings

struct FRLlibTrainingSettings : public FTrainingSettings

A struct to hold all the settings for an RLlib training script.

Dependencies

This type depends on:

• FRLlibAPPOSettings
• FRLlibCheckpointSettings
• FRLlibIMPALASettings
• FRLlibLoggingSettings
• FRLlibNetworkArchSettings
• FRLlibPPOSettings
• FRLlibResourceSettings
• FRLlibResumeSettings
• FScriptArgBuilder
• FTrainingSettings

Inherits from: public FTrainingSettings

Public Interface

Destructor:

~FRLlibTrainingSettings

virtual ~FRLlibTrainingSettings()

Attributes: virtual

Source: Schola/Source/Schola/Public/Subsystem/SubsystemSettings/Ray/RLlibTrainingSettings.h (line 95, column 9)

Implementation: Schola/Source/Schola/Private/Subsystem/SubsystemSettings/Ray/RLlibTrainingSettings.cpp (lines 39-41)

Public Functions:

GenerateTrainingArgs

virtual void GenerateTrainingArgs(int Port, FScriptArgBuilder &ArgBuilder) const const

Generate the training arguments for the script using the ArgBuilder.

Note: port is supplied as it is a common argument to pass to scripts, and is set at a high level but might be needed by specific subsettings

Parameters:

• Port (int) – [in] The port to use for the script
• ArgBuilder (FScriptArgBuilder &) – [in] The builder to use to generate the arguments

Attributes: const, virtual

Source: Schola/Source/Schola/Public/Subsystem/SubsystemSettings/Ray/RLlibTrainingSettings.h (line 93, column 6)

Implementation: Schola/Source/Schola/Private/Subsystem/SubsystemSettings/Ray/RLlibTrainingSettings.cpp (lines 6-37)

Public Members:

int Timesteps

int Timesteps = = 8000

The number of timesteps to train for.

Source: Schola/Source/Schola/Public/Subsystem/SubsystemSettings/Ray/RLlibTrainingSettings.h (line 40, column 5)

float LearningRate

float LearningRate = = 0.0003

Source: Schola/Source/Schola/Public/Subsystem/SubsystemSettings/Ray/RLlibTrainingSettings.h (line 43, column 7)

int MinibatchSize

int MinibatchSize = = 128

Source: Schola/Source/Schola/Public/Subsystem/SubsystemSettings/Ray/RLlibTrainingSettings.h (line 46, column 5)

int TrainBatchSizePerLearner

int TrainBatchSizePerLearner = = 256

Source: Schola/Source/Schola/Public/Subsystem/SubsystemSettings/Ray/RLlibTrainingSettings.h (line 49, column 5)

int NumSGDIter

int NumSGDIter = = 5

Source: Schola/Source/Schola/Public/Subsystem/SubsystemSettings/Ray/RLlibTrainingSettings.h (line 52, column 5)

float Gamma

float Gamma = = 0.99

Source: Schola/Source/Schola/Public/Subsystem/SubsystemSettings/Ray/RLlibTrainingSettings.h (line 55, column 7)

FRLlibLoggingSettings LoggingSettings

FRLlibLoggingSettings LoggingSettings

The logging settings for the training script.

Source: Schola/Source/Schola/Public/Subsystem/SubsystemSettings/Ray/RLlibTrainingSettings.h (line 59, column 23)

FRLlibCheckpointSettings CheckpointSettings

FRLlibCheckpointSettings CheckpointSettings

The checkpoint settings for the training script.

Source: Schola/Source/Schola/Public/Subsystem/SubsystemSettings/Ray/RLlibTrainingSettings.h (line 63, column 26)

FRLlibResumeSettings ResumeSettings

FRLlibResumeSettings ResumeSettings

The resume settings for the training script.

Source: Schola/Source/Schola/Public/Subsystem/SubsystemSettings/Ray/RLlibTrainingSettings.h (line 67, column 22)

FRLlibNetworkArchSettings NetworkArchitectureSettings

FRLlibNetworkArchSettings NetworkArchitectureSettings

The network architecture settings for the training script.

Source: Schola/Source/Schola/Public/Subsystem/SubsystemSettings/Ray/RLlibTrainingSettings.h (line 71, column 27)

FRLlibResourceSettings ResourceSettings

FRLlibResourceSettings ResourceSettings

The resource settings for the training script.

Source: Schola/Source/Schola/Public/Subsystem/SubsystemSettings/Ray/RLlibTrainingSettings.h (line 75, column 24)

ERLlibTrainingAlgorithm Algorithm

ERLlibTrainingAlgorithm Algorithm = = ERLlibTrainingAlgorithm::PPO

The algorithm to use during training (e.g.

SAC, PPO)

Source: Schola/Source/Schola/Public/Subsystem/SubsystemSettings/Ray/RLlibTrainingSettings.h (line 79, column 25)

FRLlibPPOSettings PPOSettings

FRLlibPPOSettings PPOSettings

PPO specific settings.

Source: Schola/Source/Schola/Public/Subsystem/SubsystemSettings/Ray/RLlibTrainingSettings.h (line 83, column 19)

FRLlibAPPOSettings APPOSettings

FRLlibAPPOSettings APPOSettings

APPO specific settings.

Source: Schola/Source/Schola/Public/Subsystem/SubsystemSettings/Ray/RLlibTrainingSettings.h (line 87, column 20)

FRLlibIMPALASettings IMPALASettings

FRLlibIMPALASettings IMPALASettings

IMPALA specific settings.

Source: Schola/Source/Schola/Public/Subsystem/SubsystemSettings/Ray/RLlibTrainingSettings.h (line 91, column 22)

Used By: FScriptSettings

Source: Schola/Source/Schola/Public/Subsystem/SubsystemSettings/Ray/RLlibTrainingSettings.h (line 33, column 1)