Skip to content

UManualGymConnector

Manual gym connector for testing and debugging without external training processes.

Provides a gym connector interface that can be controlled directly from C++ or Blueprint. Useful for testing environment implementations or creating custom training loops in Unreal.

class UManualGymConnector : public UAbstractGymConnector

Methods

UManualGymConnector

inline UManualGymConnector()

Constructor for the manual gym connector.

Init

inline virtual void Init(const FTrainingDefinition &AgentDefinitions)

Initialize the connector (no-op for manual connector).

Parameters

  • AgentDefinitions (const FTrainingDefinition)

SubmitState

inline virtual void SubmitState(const FTrainingState &InTrainingState)

Submit state (no-op for manual connector).

Parameters

  • InTrainingState (const FTrainingState)

SubmitStateWithInitialState

inline virtual void
SubmitStateWithInitialState(const FTrainingState &InTrainingState,
                            const FInitialState &InInitialAgentStates)

Submit state with initial state (no-op for manual connector).

Parameters

  • InTrainingState (const FTrainingState)

  • InInitialAgentStates (const FInitialState)

SubmitInitialState

inline virtual void
SubmitInitialState(const FInitialState &InInitialAgentStates)

Submit initial state (no-op for manual connector).

Parameters

  • InInitialAgentStates (const FInitialState)

ResolveEnvironmentStateUpdate

inline virtual FTrainingStateUpdate *ResolveEnvironmentStateUpdate()

Resolve the next environment state update.

CheckForStart

inline virtual bool CheckForStart()

Check if the connector is ready to start.

ManualStep

inline void
ManualStep(const TArray<TMap<FString, TInstancedStruct<FPoint>>> &InActions,
           FInitialState &OutInitialState, FTrainingState &OutTrainingState)

Manually execute a step with the given actions.

Parameters

  • InActions (const TArray<TMap<FString, TInstancedStruct<FPoint>>>)

  • OutInitialState (FInitialState)

  • OutTrainingState (FTrainingState)

ManualReset

inline void ManualReset(const TMap<int, int> &Seeds,
                        const TMap<int, TMap<FString, FString>> &OutEnvOptions,
                        FInitialState &OutInitialState)

Manually reset specified environments with optional seeds and options.

Parameters

  • Seeds (const TMap<int, int>)

  • OutEnvOptions (const TMap<int, TMap<FString, FString>>)

  • OutInitialState (FInitialState)

Close

inline void Close()

Close the connector and stop processing.

GetAutoResetType

inline virtual EAutoResetType GetAutoResetType()

Get the auto-reset behavior for this connector.

Attributes

AutoResetType

EAutoResetType AutoResetType = EAutoResetType::SameStep

The auto-reset behavior for this connector.

FTrainingStateUpdate

FTrainingStateUpdate NextUpdate = FTrainingStateUpdate()

The next update to be applied (set via ManualStep or ManualReset).

Source: Source/ScholaTraining/Public/GymConnectors/ManualGymConnector.h