Class UExternalGymConnector

class UExternalGymConnector : public UAbstractGymConnector

An abstract class for connectors that communicate with gym using futures.

Subclassed by UPythonGymConnector

Public Functions

UExternalGymConnector()

inline virtual TFuture<FTrainingStateUpdate*> RequestStateUpdate()

Request a decision from gym using the current state of the agents from environments.

Note

This function is asynchronous and will return immediately

Note

This function should be implemented by any derived classes

Returns:

A future that will eventually contain decision for all agents in all environments

inline virtual void SendState(const FTrainingState &Value)

Send the state of the environment to gym.

Note

This function should be implemented by any derived classes

Parameters:

Value – [in] The state of the environment

virtual void SubmitEnvironmentStates() override

Submit environment states to the other end of the connector.

Note

This function should be implemented by a derived class

virtual FTrainingStateUpdate *ResolveEnvironmentStateUpdate() override

Resolve the environment state update.

Useful for connections that operate off of futures, or otherwise require synchronization.

Note

This function should be implemented by a derived class

Returns:

The resolved environment state update

Public Members

int Timeout = 30

How long should we wait before assuming decision request has failed.

bool bUseTimeout = true

Should we use a timeout for decision requests.