LAV2_base_moe

SKRL configuration for the LAV2 base MoE task.

类：

名称	描述
PPO_MoE	PPO variant with MoE bias updates.
MoELayer	Mixture-of-experts layer with top-k routing.
Shared	Shared actor-critic model with MoE trunk.

函数：

名称	描述
get_agent_cfg	Return the PPO agent configuration.
get_model_class	Return the model class for the agent.
get_agent_class	Return the agent class.
get_memory_class	Return the memory class.
get_memory_cfg	Return the memory configuration.
get_trainer_class	Return the trainer class.
get_trainer_cfg	Return the trainer configuration.

PPO_MoE

Bases: PPO

PPO variant with MoE bias updates.

方法：

名称	描述
update	Run PPO update and then update MoE biases.

update

update(*args: Any, **kwargs: Any) -> None

Run PPO update and then update MoE biases.

MoELayer

MoELayer(input_size, output_size, num_experts, k)

Bases: Module

Mixture-of-experts layer with top-k routing.

Initialize experts, gate network, and load-balancing bias.

方法：

名称	描述
forward	Compute routed expert outputs.

forward

forward(x: Tensor) -> torch.Tensor

Compute routed expert outputs.

返回：

类型	描述
Tensor	torch.Tensor: Weighted combination of top-k expert outputs.

Shared

Shared(observation_space, state_space, action_space, device, clip_actions=False, clip_log_std=True, min_log_std=-20, max_log_std=2, reduction='sum')

Bases: GaussianMixin, DeterministicMixin, Model

Shared actor-critic model with MoE trunk.

Initialize the shared MoE actor-critic model.

方法：

名称	描述
act	Compute actions or values depending on role.
compute	Compute policy/value outputs depending on role.

act

act(inputs: Any, role: str) -> Any

Compute actions or values depending on role.

返回：

类型	描述
Any	tuple | None: Action outputs for the given role, or None if role is unknown.

compute

compute(inputs: Any, role: str) -> Any

Compute policy/value outputs depending on role.

返回：

类型	描述
Any	tuple | None: (output_tensor, extras_dict) for policy/value roles, or None.

get_agent_cfg

get_agent_cfg() -> Any

Return the PPO agent configuration.

get_model_class

get_model_class() -> Any

Return the model class for the agent.

get_agent_class

get_agent_class() -> Any

Return the agent class.

get_memory_class

get_memory_class() -> Any

Return the memory class.

get_memory_cfg

get_memory_cfg() -> Any

Return the memory configuration.

get_trainer_class

get_trainer_class() -> Any

Return the trainer class.

get_trainer_cfg

get_trainer_cfg() -> Any

Return the trainer configuration.