- Schola Documentation
- Examples
- API Documentation
- Overview
- Python API
- Generated (gRPC)
- C++ API (Unreal)
- Classes
- Overview
- Class AGymConnectorManager
- Class ConstPointVisitor
- Class ConstSpaceVisitor
- Template Class ExchangeRPCWorker
- Class FCPUModelWrapper
- Class FCPURuntimeWrapper
- Class FGPUModelWrapper
- Class FGPURuntimeWrapper
- Class FSource/Schola/Editor/Module
- Class FSource/Schola/Imitation/Module
- Class FSource/Schola/InferenceUtils/Module
- Class FSource/Schola/Interactors/Module
- Class FScholaModule
- Class FSource/Schola/NNE/Module
- Class FSource/Schola/Protobuf/Module
- Class FSource/Schola/Training/Module
- Class IAgent
- Class IBaseImitationScholaEnvironment
- Class IBaseScholaEnvironment
- Template Class IConsumerBackend
- Template Class IExchangeBackend
- Class IGymConnector
- Class IImitationScholaEnvironment
- Class IModelInstanceInterface
- Class IModelInterface
- Class IMultiAgentImitationScholaEnvironment
- Class IMultiAgentScholaEnvironment
- Class IPolicy
- Template Class IProducerBackend
- Class IProtobufBackend
- Class IRuntimeInterface
- Class IScholaActuator
- Class IScholaEnvironment
- Class IScholaSensor
- Class ISingleAgentImitationScholaEnvironment
- Class ISingleAgentScholaEnvironment
- Class IStepper
- Class PointAllocator
- Class PointVisitor
- Template Class ProducerRPCWorker
- Class ProtobufPointDeserializer
- Class ProtobufPointSerializer
- Class ProtobufSpaceDeserializer
- Class ProtobufSpaceSerializer
- Template Class SpaceTransmuter
- Class SpaceVisitor
- Template Class TCallData
- Template Class TConsumerRPCBackend
- Template Class TConsumerRPCWorker
- Template Class TExchangeCallData
- Template Class TExchangeRPCBackend
- Template Class TImitationScholaEnvironment
- Template Class TProducerRPCBackend
- Template Class TRPCBackend
- Template Class TScholaEnvironment
- Class UAbstractGymConnector
- Class UAbstractImitationConnector
- Class UActionDebugLibrary
- Class UAgent
- Class UBaseImitationScholaEnvironment
- Class UBaseScholaEnvironment
- Class UBlueprintPolicy
- Class UBoxPointBlueprintLibrary
- Class UBoxSpaceBlueprintLibrary
- Class UCameraSensor
- Class UCommunicationManager
- Class UDictPointBlueprintLibrary
- Class UDictSpaceBlueprintLibrary
- Class UDiscretePointBlueprintLibrary
- Class UDiscreteSpaceBlueprintLibrary
- Class UExternalGymConnector
- Class UGymConnector
- Class ULaunchableScriptFunctionLibrary
- Class UManualGymConnector
- Class UMovementInputActuator
- Class UMultiAgentImitationScholaEnvironment
- Class UMultiAgentScholaEnvironment
- Class UMultiBinaryPointBlueprintLibrary
- Class UMultiBinarySpaceBlueprintLibrary
- Class UMultiDiscretePointBlueprintLibrary
- Class UMultiDiscreteSpaceBlueprintLibrary
- Class UNNEPolicy
- Class UPipelinedStepper
- Class UPointBlueprintLibrary
- Class UPolicy
- Class URPCGymConnector
- Class URPCImitationConnector
- Class URayCastSensor
- Class URotationActuator
- Class UScholaActuator
- Class UScholaSensor
- Class USimpleStepper
- Class USingleAgentImitationScholaEnvironment
- Class USingleAgentScholaEnvironment
- Class USpaceBlueprintLibrary
- Class UStepper
- Class UTeleportActuator
- Structs
- Overview
- Struct FAgentState
- Struct FBoxPoint
- Struct FBoxSpace
- Struct FBoxSpaceDimension
- Struct FCustomTrainingSettings
- Struct FDictPoint
- Struct FDictSpace
- Struct FDiscretePoint
- Struct FDiscreteSpace
- Struct FEnvReset
- Struct FEnvStep
- Struct FEnvironmentDefinition
- Struct FEnvironmentState
- Struct FExternalGymConnectorSettings
- Struct FImitationAgentState
- Struct FImitationEnvironmentState
- Struct FImitationState
- Struct FImitationTrainingState
- Struct FInitialAgentState
- Struct FInitialEnvironmentState
- Struct FInitialState
- Struct FInteractionDefinition
- Struct FLaunchableScript
- Struct FLaunchableScriptRunnable
- Struct FMultiBinaryPoint
- Struct FMultiBinarySpace
- Struct FMultiDiscretePoint
- Struct FMultiDiscreteSpace
- Struct FNNEBindingCreator
- Struct FNNEBoxBuffer
- Struct FNNEBufferAllocator
- Struct FNNEBufferVisitor
- Struct FNNEDictBuffer
- Struct FNNEDiscreteBuffer
- Struct FNNEMultiBinaryBuffer
- Struct FNNEMultiDiscreteBuffer
- Struct FNNEPointBuffer
- Struct FNNEPointCreator
- Struct FNNEPointToBufferConverter
- Struct FNNEStateBuffer
- Struct FPoint
- Struct FRLlibAPPOSettings
- Struct FRLlibCheckpointSettings
- Struct FRLlibIMPALASettings
- Struct FRLlibLoggingSettings
- Struct FRLlibNetworkArchSettings
- Struct FRLlibPPOSettings
- Struct FRLlibResourceSettings
- Struct FRLlibResumeSettings
- Struct FRLlibTrainingSettings
- Struct FRPCServerSettings
- Struct FSB3CheckpointSettings
- Struct FSB3LoggingSettings
- Struct FSB3NetworkArchSettings
- Struct FSB3PPOSettings
- Struct FSB3ResumeSettings
- Struct FSB3SACSettings
- Struct FSB3TrainingSettings
- Struct FScriptArgBuilder
- Struct FScriptSettings
- Struct FSpace
- Struct FStartRequest
- Struct FTrainingDefinition
- Struct FTrainingReset
- Struct FTrainingSettings
- Struct FTrainingState
- Struct FTrainingStateUpdate
- Struct FTrainingStep
- Template Struct TBaseStructure< FPoint >
- Template Struct TBaseStructure< FSpace >
- UPipelinedStepper::FPipelinedStepperFrame
-
train.impala
Full path:
schola.scripts.rllib.train.impala
schola.scripts.rllib.train.impala
impala
impala(args=RLlibScriptArgs(training_settings=TrainingSettings(timesteps=3000, learning_rate=0.0003, minibatch_size=128, train_batch_size_per_learner=256, num_sgd_iter=5, gamma=0.99), algorithm_settings=PPOSettings(gae_lambda=0.95, clip_param=0.2, use_gae=True), logging_settings=LoggingSettings(schola_verbosity=0, rllib_verbosity=1), resume_settings=ResumeSettings(resume_from=None), network_architecture_settings=NetworkArchitectureSettings(fcnet_hiddens=[512, 512], activation=<ActivationFunctionEnum.ReLU: 'relu'>, use_attention=False, attention_dim=64), resource_settings=ResourceSettings(num_gpus=0, num_cpus=1, num_learners=0, num_cpus_for_main_process=1, num_cpus_per_learner=1, num_gpus_per_learner=0, using_cluster=False), checkpoint_settings=CheckpointArgs(enable_checkpoints=False, checkpoint_dir=WindowsPath('ckpt'), save_freq=100000, name_prefix_override=None, export_onnx=False, save_final_policy=False), environment_settings=EnvironmentArgs(simulator=UnrealEditorSimulatorArgs(), protocol=gRPCProtocolArgs(port=None, url='localhost', environment_start_timeout=45))), simulator_type='editor', executable=UnrealExecutableCommandLinePlaceholder(executable_path=None, disable_script=True, headless=False, map=None, fps=None, display_logs=True), impala=IMPALASettings(vtrace=True, vtrace_clip_rho_threshold=1.0, vtrace_clip_pg_rho_threshold=1.0), editor=UnrealEditorSimulatorArgs())Parameters
args (Annotated[RLlibScriptArgs, Parameter(name=('*',))])
simulator_type (Annotated[Literal['editor', 'executable'], Parameter(group=('Simulator (Choose One)',))])
executable (Annotated[UnrealExecutableSimulatorArgs, Parameter(name=('*',), group=('Executable Parameters',))])
impala (Annotated[IMPALASettings, Parameter(name=('*',), group=('IMPALA Parameters',))])
editor (Annotated[UnrealEditorSimulatorArgs, Parameter(show=False)])