vss::simulation::AutomaticBatching Struct Reference
Last update: 16.07.2025Automatic batching: the number of batches on rays and on rx channels is computed by the system, taking into account the specified constraints. More...
Public Attributes | |
| int32 | max_number_of_ray_batches = 1 |
| double | gpu_memory_quota = 2 |
| map< string, double > | gpu_quotas = 3 |
Detailed Description
Automatic batching: the number of batches on rays and on rx channels is computed by the system, taking into account the specified constraints.
Member Data Documentation
◆ gpu_memory_quota
| double vss::simulation::AutomaticBatching::gpu_memory_quota = 2 |
Constraint 2: max fraction (quota) of the total GPU memory that can be used. Default GPU with index 0 will be used.
◆ gpu_quotas
| map<string, double> vss::simulation::AutomaticBatching::gpu_quotas = 3 |
Constraint 2: max fraction (quota) of the total memory of the specified GPU that can be used.
Key [string]: The GPU name. Value [double]: The max fraction of the GPU memory that can be used.
- Note
- The GPU names must correspond to the GPU identifier names specified in the deploy parameters.
◆ max_number_of_ray_batches
| int32 vss::simulation::AutomaticBatching::max_number_of_ray_batches = 1 |
Constraint 1: upper bound on the automatically computed number of ray batches.
The documentation for this struct was generated from the following file:
- simulation_parameters.proto
