FSB3SACSettings

A struct to hold SAC settings for an SB3 training script.

struct FSB3SACSettings : public FTrainingSettings

Methods

virtual void GenerateTrainingArgs(FScriptArgBuilder &ArgBuilder) const

Generate the training arguments for the script using the ArgBuilder.

virtual ~FSB3SACSettings()

float LearningRate = 0.0003

The learning rate for the SAC algorithm.

int BufferSize = 1000000

The buffer size for the SAC algorithm.

int LearningStarts = 100

The number of steps to take before learning starts.

int BatchSize = 256

The batch size to use during gradient descent.

float Tau = 0.005

The Tau value for the SAC algorithm.

float Gamma = 0.99

The gamma value for the SAC algorithm.

int TrainFreq = 1

The frequency to update the target network, in steps.

int GradientSteps = 1

The number of gradient steps to take during training.

bool OptimizeMemoryUsage = false

Optimize memory usage.

bool LearnEntCoef = true

Should we learn the entropy coefficient during training.

float InitialEntCoef = 1.0

The initial entropy coefficient for the SAC algorithm.

int TargetUpdateInterval = 1

The interval at which we update the target network.

FString TargetEntropy = "auto"

The target entropy for the SAC algorithm.

bool UseSDE = false

Use state dependent entropy noise.

int SDESampleFreq = -1

The frequency to sample the state dependent entropy noise.

Source: Source/ScholaTraining/Public/TrainingSettings/StableBaselines/Algorithms/SB3SACSettings.h