Class UInferencePolicy

class UInferencePolicy : public UAbstractPolicy

Policy that uses a trained NNE model to make decisions.

Public Functions

UInferencePolicy()

TArray<FString> GetRuntimeNames() const

Function that grabs all availabe runtime names.

Returns:

An Array of available runtime names

IRuntimeInterface *GetRuntime(const FString &SelectedRuntimeName) const

Function that gets the singleton instance of the runtime with the given name.

Parameters:

SelectedRuntimeName – [in] The name of the runtime to get

Returns:

A ptr to the runtime with the given name

virtual TFuture<FPolicyDecision*> RequestDecision(const FDictPoint &Observations) override

Request that the policy decide on action.

May take some time to occur

Parameters:

Observations – [in] The current state of the agent used to inform the policies choice of action

Returns:

A future that will eventually contain the policy’s next decision

virtual void Init(const FInteractionDefinition &PolicyDefinition)

Initialize an instance of a policy object from an interaction definition.

Parameters:

PolicyDefinition – [in] An object defining the policy’s I/O shapes and other parameters

Public Members

int Step = 0

Number of inference calls to the policy.

FDictSpace ActionSpaceDefn

The Action Space of the Agent.

FDictSpace ObservationSpaceDefn

The Observation Space of the Agent.

TObjectPtr<UNNEModelData> ModelData

The Model Data for the NNE Model.

FString RuntimeName

The Name of the Runtime to use for Inference.

If no Runtimes are available, enable NNE plugins (e.g. NNERuntimeORT)

bool bNetworkLoaded = false

Variable tracking if the network loaded correctly?

TArray<float> ActionBuffer

TArray<float> ObservationBuffer