Hugging Face's logo

mbreuss
/
flower_libero_spatial

Robotics
Safetensors
English
VLA
LIBERO
Robotics
Flow
Model card Files Community
mbreuss commited on
Commit
92cd212
·
verified ·
1 Parent(s): e6971fb

Update training.log

Browse files
Files changed (1) hide show
  1. training.log +140 -1
training.log CHANGED
@@ -1,3 +1,105 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  [2025-03-16 20:32:39,478][flower.rollout.libero_rollout][INFO] - eval_lh/avg_seq_len success rate 0.9681089520454407
2
  [2025-03-16 20:32:39,479][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_between_the_plate_and_the_ramekin_and_place_it_on_the_plate with success 0.9791666666666666
3
  [2025-03-16 20:32:39,480][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_next_to_the_ramekin_and_place_it_on_the_plate with success 0.9807692307692308
@@ -8,4 +110,41 @@
8
  [2025-03-16 20:32:39,482][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_next_to_the_cookie_box_and_place_it_on_the_plate with success 1.0
9
  [2025-03-16 20:32:39,482][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_stove_and_place_it_on_the_plate with success 1.0
10
  [2025-03-16 20:32:39,482][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_next_to_the_plate_and_place_it_on_the_plate with success 0.9166666666666666
11
- [2025-03-16 20:32:39,483][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_wooden_cabinet_and_place_it_on_the_plate with success 0.9615384615384616
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [2025-03-16 18:00:19,576][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
2
+ [2025-03-16 18:00:19,577][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
3
+ [2025-03-16 18:00:19,577][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
4
+ [2025-03-16 18:00:19,577][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB
5
+ [2025-03-16 18:00:19,578][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
6
+ [2025-03-16 18:00:19,578][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
7
+ [2025-03-16 18:00:19,578][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
8
+ [2025-03-16 18:00:19,578][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB
9
+ [2025-03-16 18:00:19,578][__main__][INFO] -
10
+ Initializing training for seed 42
11
+ [2025-03-16 18:00:19,584][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
12
+ [2025-03-16 18:00:19,584][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
13
+ [2025-03-16 18:00:19,584][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
14
+ [2025-03-16 18:00:19,584][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB
15
+ [2025-03-16 18:00:19,585][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
16
+ [2025-03-16 18:00:19,585][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
17
+ [2025-03-16 18:00:19,585][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
18
+ [2025-03-16 18:00:19,585][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB
19
+ [2025-03-16 18:00:32,402][robosuite_logs][WARNING] - No private macro file found!
20
+ [2025-03-16 18:00:32,403][robosuite_logs][WARNING] - It is recommended to use a private macro file
21
+ [2025-03-16 18:00:32,403][robosuite_logs][WARNING] - To setup, run: python /home/hk-project-robolear/ft4740/miniconda3/envs/flower_cal/lib/python3.9/site-packages/robosuite/scripts/setup_macros.py
22
+ [2025-03-16 18:00:32,403][robosuite_logs][WARNING] - No private macro file found!
23
+ [2025-03-16 18:00:32,403][robosuite_logs][WARNING] - No private macro file found!
24
+ [2025-03-16 18:00:32,403][robosuite_logs][WARNING] - It is recommended to use a private macro file
25
+ [2025-03-16 18:00:32,403][robosuite_logs][WARNING] - It is recommended to use a private macro file
26
+ [2025-03-16 18:00:32,403][robosuite_logs][WARNING] - To setup, run: python /home/hk-project-robolear/ft4740/miniconda3/envs/flower_cal/lib/python3.9/site-packages/robosuite/scripts/setup_macros.py
27
+ [2025-03-16 18:00:32,403][robosuite_logs][WARNING] - To setup, run: python /home/hk-project-robolear/ft4740/miniconda3/envs/flower_cal/lib/python3.9/site-packages/robosuite/scripts/setup_macros.py
28
+ [2025-03-16 18:00:32,634][OpenGL.acceleratesupport][INFO] - No OpenGL_accelerate module loaded: No module named 'OpenGL_accelerate'
29
+ [2025-03-16 18:00:32,634][OpenGL.acceleratesupport][INFO] - No OpenGL_accelerate module loaded: No module named 'OpenGL_accelerate'
30
+ [2025-03-16 18:00:32,634][OpenGL.acceleratesupport][INFO] - No OpenGL_accelerate module loaded: No module named 'OpenGL_accelerate'
31
+ [2025-03-16 18:00:39,347][robosuite_logs][WARNING] - No private macro file found!
32
+ [2025-03-16 18:00:39,348][robosuite_logs][WARNING] - It is recommended to use a private macro file
33
+ [2025-03-16 18:00:39,348][robosuite_logs][WARNING] - To setup, run: python /home/hk-project-robolear/ft4740/miniconda3/envs/flower_cal/lib/python3.9/site-packages/robosuite/scripts/setup_macros.py
34
+ [2025-03-16 18:00:39,489][OpenGL.acceleratesupport][INFO] - No OpenGL_accelerate module loaded: No module named 'OpenGL_accelerate'
35
+ [2025-03-16 18:00:46,857][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
36
+ [2025-03-16 18:00:46,858][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
37
+ [2025-03-16 18:00:46,858][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
38
+ [2025-03-16 18:00:46,858][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB
39
+ [2025-03-16 18:00:46,866][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
40
+ [2025-03-16 18:00:46,866][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
41
+ [2025-03-16 18:00:46,866][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
42
+ [2025-03-16 18:00:46,866][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB
43
+ [2025-03-16 18:00:46,885][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
44
+ [2025-03-16 18:00:46,885][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
45
+ [2025-03-16 18:00:46,885][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
46
+ [2025-03-16 18:00:46,886][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB
47
+ [2025-03-16 18:00:49,078][__main__][INFO] - Training config for seed 42:
48
+ {'callbacks': {'ema': {'_target_': 'flower.callbacks.ema.EMA', 'decay': 0.999, 'start_step': 0, 'save_ema_weights_in_callback_state': True, 'evaluate_ema_weights_instead': True, 'power': 0.6666666666666666, 'inv_gamma': 1.0, 'min_value': 0.0, 'max_value': 0.9999}, 'rollout_lh': {'_target_': 'flower.rollout.libero_rollout.RolloutLibero', '_recursive_': False, 'env_cfg': {'_target_': 'flower.wrappers.hulc_wrapper.HulcWrapper'}, 'skip_epochs': '${rollout_lh_skip_epochs}', 'benchmark_name': '${libero_benchmark}', 'rollout_freq': 10, 'num_videos': 0, 'num_sequences': 50, 'max_steps': 520, 'empty_cache': False, 'debug': False, 'n_eval': 50, 'num_procs': 10, 'use_mp': False, 'task_embedding_format': 'clip', 'device': '${device}'}, 'checkpoint': {'_target_': 'pytorch_lightning.callbacks.ModelCheckpoint', 'save_top_k': 1, 'verbose': True, 'monitor': 'eval_lh/avg_seq_len', 'mode': 'max', 'dirpath': 'saved_models', 'filename': '{epoch:02d}_{eval_lh/avg_seq_len:.2f}', 'every_n_epochs': '${callbacks.rollout_lh.rollout_freq}'}}, 'datamodule': {'transforms': {'train': {'rgb_static': [{'_target_': 'torchvision.transforms.Resize', 'size': 112, 'antialias': True}, {'_target_': 'flower.utils.transforms.RandomShiftsAug', 'pad': 10}, {'_target_': 'flower.utils.transforms.ScaleImageTensor'}, {'_target_': 'torchvision.transforms.Normalize', 'mean': [0.48145466, 0.4578275, 0.40821073], 'std': [0.26862954, 0.26130258, 0.27577711]}], 'rgb_gripper': [{'_target_': 'torchvision.transforms.Resize', 'size': 112, 'antialias': True}, {'_target_': 'flower.utils.transforms.RandomShiftsAug', 'pad': 4}, {'_target_': 'flower.utils.transforms.ScaleImageTensor'}, {'_target_': 'torchvision.transforms.Normalize', 'mean': [0.48145466, 0.4578275, 0.40821073], 'std': [0.26862954, 0.26130258, 0.27577711]}]}, 'val': {'rgb_static': [{'_target_': 'torchvision.transforms.Resize', 'size': 112, 'antialias': True}, {'_target_': 'flower.utils.transforms.ScaleImageTensor'}, {'_target_': 'torchvision.transforms.Normalize', 'mean': [0.48145466, 0.4578275, 0.40821073], 'std': [0.26862954, 0.26130258, 0.27577711]}], 'rgb_gripper': [{'_target_': 'torchvision.transforms.Resize', 'size': 112, 'antialias': True}, {'_target_': 'flower.utils.transforms.ScaleImageTensor'}, {'_target_': 'torchvision.transforms.Normalize', 'mean': [0.48145466, 0.4578275, 0.40821073], 'std': [0.26862954, 0.26130258, 0.27577711]}]}}, '_target_': 'flower.datasets.libero_data_module.LiberoDataModule', '_recursive_': False, 'root_data_dir': '${root_data_dir}', 'action_space': 7, 'shuffle_val': False, 'benchmark_name': '${libero_benchmark}', 'observation_space': {'rgb_obs': ['agentview_rgb', 'eye_in_hand_rgb'], 'depth_obs': [], 'state_obs': ['gripper_states', 'joint_states'], 'actions': ['rel_actions'], 'language': ['language']}, 'proprioception_dims': 'None', 'datasets': {'lang_dataset': {'_target_': 'flower.datasets.libero_dataset.LiberoMultitaskDataset', 'key': 'lang', 'benchmark_name': '${libero_benchmark}', 'batch_size': '${batch_size}', 'proprio_state': '${datamodule.proprioception_dims}', 'obs_space': '${datamodule.observation_space}', 'num_workers': '${num_workers}', 'action_seq_len': '${act_seq_len}', 'obs_seq_len': '${obs_seq_len}', 'split_ratio': 0.0}}}, 'model': {'_target_': 'flower.models.flower.FLOWERVLA', '_recursive_': False, 'vlm_path': 'microsoft/Florence-2-large', 'freeze_florence': False, 'freeze_vision_tower': False, 'vlm_prompt_style': 'default', 'token_dropout': 0.1, 'multistep': '${multistep}', 'num_sampling_steps': 4, 'lowdim_obs_dim': 7, 'action_dim': 7, 'act_window_size': 10, 'load_pretrained': True, 'pretrained_model_path': '/home/hk-project-sustainebot/ft4740/code/flower_vla_policy/logs/runs/2025-02-05/10-17-02/360000_model_weights.pt', 'use_second_view': True, 'second_view_key': 'image_wrist', 'action_type_adaln': True, 'use_causal_attention': True, 'use_cross_attn': True, 'use_adaln_cond': False, 'use_readout_token': False, 'use_proprio': False, 'return_act_chunk': False, 'sampling_type': 'uniform', 'dit_dim': 1024, 'n_heads': 16, 'n_layers': 18, 'attn_pdrop': 0.1, 'resid_pdrop': 0.1, 'mlp_pdrop': 0.1, 'use_rope': True, 'use_nope': False, 'query_seq_len': 100, 'rope_theta': 32.0, 'optimizer_type': 'adamw', 'optimizer': {'_target_': 'torch.optim.AdamW', 'transformer_weight_decay': 0.05, 'learning_rate': 2e-05, 'betas': [0.9, 0.99]}, 'lr_scheduler': {'lr_scheduler': {'init_lr': 2e-05, 'init_lr_scale': 0.1, 'final_lr_scale': 0.5, 'total_steps': 50000, 'phase_ratio': '(0.05, 0.1, 0.85)', 'lr': 2e-05}}}, 'root_data_dir': '/home/yagmurlu/code/MoDE_Calvin/dataset/task_ABC_D', 'lang_folder': 'lang_clip_resnet50', 'log_dir': './logs', 'slurm': False, 'seed': 42, 'device': 'cuda', 'batch_size': 8, 'devices': 4, 'goal_window_size': 1, 'act_dim': 7, 'proprio_dims': 9, 'obs_dim': 512, 'goal_dim': 512, 'obs_seq_len': 1, 'act_seq_len': 10, 'multistep': '${act_seq_len}', 'p_last_state': 0, 'max_epochs': 30, 'rollout_lh_skip_epochs': 9, 'num_workers': 1, 'benchmark_name': '${libero_benchmark}', 'libero_benchmark': 'libero_spatial', 'trainer': {'devices': '${devices}', 'precision': 'bf16-mixed', 'max_epochs': '${max_epochs}', 'sync_batchnorm': True, 'accelerator': 'gpu', 'strategy': 'ddp', 'limit_train_batches': 1000, 'limit_val_batches': 4}, 'logger': {'_target_': 'pytorch_lightning.loggers.WandbLogger', 'save_dir': '.', 'name': '2025-03-16/18-00-19', 'group': '2025-03-16', 'log_model': False, 'project': '${libero_benchmark}', 'entity': 'bennoq', 'id': '2025-03-16_18-00-19'}}
49
+ [2025-03-16 18:00:49,261][__main__][INFO] - Git commit: cd15964f487ea13d3176eaf3b9a6b7202fbbfa5a
50
+ [2025-03-16 18:00:49,431][__main__][INFO] - * CUDA:
51
+ - GPU:
52
+ - NVIDIA A100-SXM4-40GB
53
+ - NVIDIA A100-SXM4-40GB
54
+ - NVIDIA A100-SXM4-40GB
55
+ - NVIDIA A100-SXM4-40GB
56
+ - available: True
57
+ - version: 12.1
58
+ * Packages:
59
+ - numpy: 1.26.4
60
+ - pyTorch_debug: False
61
+ - pyTorch_version: 2.2.2+cu121
62
+ - pytorch-lightning: 2.0.8
63
+ - tqdm: 4.67.1
64
+ [2025-03-16 18:00:49,582][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
65
+ [2025-03-16 18:00:49,585][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
66
+ [2025-03-16 18:00:49,585][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
67
+ [2025-03-16 18:00:49,586][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB
68
+ [2025-03-16 18:01:17,215][root][INFO] - Creating EMA weights copy.
69
+ [2025-03-16 18:01:17,215][root][INFO] - Creating EMA weights copy.
70
+ [2025-03-16 18:01:17,215][root][INFO] - Creating EMA weights copy.
71
+ [2025-03-16 18:01:17,215][root][INFO] - Creating EMA weights copy.
72
+ [2025-03-16 19:01:24,821][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_between_the_plate_and_the_ramekin_and_place_it_on_the_plate
73
+ [2025-03-16 19:02:31,877][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_next_to_the_ramekin_and_place_it_on_the_plate
74
+ [2025-03-16 19:03:53,441][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_from_table_center_and_place_it_on_the_plate
75
+ [2025-03-16 19:05:04,205][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_cookie_box_and_place_it_on_the_plate
76
+ [2025-03-16 19:06:08,553][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_in_the_top_drawer_of_the_wooden_cabinet_and_place_it_on_the_plate
77
+ [2025-03-16 19:07:34,019][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_ramekin_and_place_it_on_the_plate
78
+ [2025-03-16 19:09:34,928][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_next_to_the_cookie_box_and_place_it_on_the_plate
79
+ [2025-03-16 19:10:44,781][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_stove_and_place_it_on_the_plate
80
+ [2025-03-16 19:12:09,260][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_next_to_the_plate_and_place_it_on_the_plate
81
+ [2025-03-16 19:13:21,878][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_wooden_cabinet_and_place_it_on_the_plate
82
+ [2025-03-16 19:15:07,520][flower.rollout.libero_rollout][INFO] - eval_lh/avg_seq_len success rate 0.9677884578704834
83
+ [2025-03-16 19:15:07,522][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_between_the_plate_and_the_ramekin_and_place_it_on_the_plate with success 1.0
84
+ [2025-03-16 19:15:07,523][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_next_to_the_ramekin_and_place_it_on_the_plate with success 1.0
85
+ [2025-03-16 19:15:07,524][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_from_table_center_and_place_it_on_the_plate with success 1.0
86
+ [2025-03-16 19:15:07,525][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_cookie_box_and_place_it_on_the_plate with success 1.0
87
+ [2025-03-16 19:15:07,526][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_in_the_top_drawer_of_the_wooden_cabinet_and_place_it_on_the_plate with success 0.9791666666666666
88
+ [2025-03-16 19:15:07,527][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_ramekin_and_place_it_on_the_plate with success 0.8012820512820513
89
+ [2025-03-16 19:15:07,528][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_next_to_the_cookie_box_and_place_it_on_the_plate with success 1.0
90
+ [2025-03-16 19:15:07,529][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_stove_and_place_it_on_the_plate with success 1.0
91
+ [2025-03-16 19:15:07,530][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_next_to_the_plate_and_place_it_on_the_plate with success 0.9391025641025641
92
+ [2025-03-16 19:15:07,531][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_wooden_cabinet_and_place_it_on_the_plate with success 0.9583333333333333
93
+ [2025-03-16 20:18:12,142][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_between_the_plate_and_the_ramekin_and_place_it_on_the_plate
94
+ [2025-03-16 20:19:17,547][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_next_to_the_ramekin_and_place_it_on_the_plate
95
+ [2025-03-16 20:20:54,413][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_from_table_center_and_place_it_on_the_plate
96
+ [2025-03-16 20:22:18,783][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_cookie_box_and_place_it_on_the_plate
97
+ [2025-03-16 20:23:22,687][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_in_the_top_drawer_of_the_wooden_cabinet_and_place_it_on_the_plate
98
+ [2025-03-16 20:24:48,570][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_ramekin_and_place_it_on_the_plate
99
+ [2025-03-16 20:26:37,754][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_next_to_the_cookie_box_and_place_it_on_the_plate
100
+ [2025-03-16 20:27:49,825][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_stove_and_place_it_on_the_plate
101
+ [2025-03-16 20:29:19,428][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_next_to_the_plate_and_place_it_on_the_plate
102
+ [2025-03-16 20:30:46,963][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_wooden_cabinet_and_place_it_on_the_plate
103
  [2025-03-16 20:32:39,478][flower.rollout.libero_rollout][INFO] - eval_lh/avg_seq_len success rate 0.9681089520454407
104
  [2025-03-16 20:32:39,479][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_between_the_plate_and_the_ramekin_and_place_it_on_the_plate with success 0.9791666666666666
105
  [2025-03-16 20:32:39,480][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_next_to_the_ramekin_and_place_it_on_the_plate with success 0.9807692307692308
 
110
  [2025-03-16 20:32:39,482][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_next_to_the_cookie_box_and_place_it_on_the_plate with success 1.0
111
  [2025-03-16 20:32:39,482][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_stove_and_place_it_on_the_plate with success 1.0
112
  [2025-03-16 20:32:39,482][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_next_to_the_plate_and_place_it_on_the_plate with success 0.9166666666666666
113
+ [2025-03-16 20:32:39,483][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_wooden_cabinet_and_place_it_on_the_plate with success 0.9615384615384616
114
+ [2025-03-16 21:35:50,296][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_between_the_plate_and_the_ramekin_and_place_it_on_the_plate
115
+ [2025-03-16 21:36:48,605][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_next_to_the_ramekin_and_place_it_on_the_plate
116
+ [2025-03-16 21:38:29,731][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_from_table_center_and_place_it_on_the_plate
117
+ [2025-03-16 21:39:56,846][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_cookie_box_and_place_it_on_the_plate
118
+ [2025-03-16 21:41:05,224][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_in_the_top_drawer_of_the_wooden_cabinet_and_place_it_on_the_plate
119
+ [2025-03-16 21:42:36,174][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_ramekin_and_place_it_on_the_plate
120
+ [2025-03-16 21:44:19,068][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_next_to_the_cookie_box_and_place_it_on_the_plate
121
+ [2025-03-16 21:45:30,562][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_stove_and_place_it_on_the_plate
122
+ [2025-03-16 21:47:03,502][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_next_to_the_plate_and_place_it_on_the_plate
123
+ [2025-03-16 21:48:28,224][flower.rollout.libero_rollout][INFO] - GPU 0 starting to evaluate: pick_up_the_black_bowl_on_the_wooden_cabinet_and_place_it_on_the_plate
124
+ [2025-03-16 21:50:15,455][flower.rollout.libero_rollout][INFO] - eval_lh/avg_seq_len success rate 0.9621794819831848
125
+ [2025-03-16 21:50:15,456][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_between_the_plate_and_the_ramekin_and_place_it_on_the_plate with success 0.9807692307692308
126
+ [2025-03-16 21:50:15,457][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_next_to_the_ramekin_and_place_it_on_the_plate with success 0.9599358974358975
127
+ [2025-03-16 21:50:15,458][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_from_table_center_and_place_it_on_the_plate with success 0.9615384615384616
128
+ [2025-03-16 21:50:15,458][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_cookie_box_and_place_it_on_the_plate with success 1.0
129
+ [2025-03-16 21:50:15,459][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_in_the_top_drawer_of_the_wooden_cabinet_and_place_it_on_the_plate with success 0.8990384615384616
130
+ [2025-03-16 21:50:15,459][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_ramekin_and_place_it_on_the_plate with success 0.8798076923076923
131
+ [2025-03-16 21:50:15,459][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_next_to_the_cookie_box_and_place_it_on_the_plate with success 1.0
132
+ [2025-03-16 21:50:15,460][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_stove_and_place_it_on_the_plate with success 1.0
133
+ [2025-03-16 21:50:15,460][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_next_to_the_plate_and_place_it_on_the_plate with success 0.9791666666666666
134
+ [2025-03-16 21:50:15,460][flower.rollout.libero_rollout][INFO] - eval_lh/sr_pick_up_the_black_bowl_on_the_wooden_cabinet_and_place_it_on_the_plate with success 0.9615384615384616
135
+ [2025-03-16 21:50:20,024][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
136
+ [2025-03-16 21:50:20,025][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
137
+ [2025-03-16 21:50:20,025][__main__][INFO] - GPU 2 Memory: Allocated: 3.73GB, Reserved: 3.83GB
138
+ [2025-03-16 21:50:20,025][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB
139
+ [2025-03-16 21:50:20,037][__main__][INFO] - GPU 0 Memory: Allocated: 3.73GB, Reserved: 3.79GB
140
+ [2025-03-16 21:50:20,037][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
141
+ [2025-03-16 21:50:20,038][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
142
+ [2025-03-16 21:50:20,038][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB
143
+ [2025-03-16 21:50:20,048][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
144
+ [2025-03-16 21:50:20,049][__main__][INFO] - GPU 1 Memory: Allocated: 0.00GB, Reserved: 0.00GB
145
+ [2025-03-16 21:50:20,049][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
146
+ [2025-03-16 21:50:20,049][__main__][INFO] - GPU 3 Memory: Allocated: 3.73GB, Reserved: 3.83GB
147
+ [2025-03-16 21:50:20,100][__main__][INFO] - GPU 0 Memory: Allocated: 0.00GB, Reserved: 0.00GB
148
+ [2025-03-16 21:50:20,101][__main__][INFO] - GPU 1 Memory: Allocated: 3.73GB, Reserved: 3.79GB
149
+ [2025-03-16 21:50:20,101][__main__][INFO] - GPU 2 Memory: Allocated: 0.00GB, Reserved: 0.00GB
150
+ [2025-03-16 21:50:20,101][__main__][INFO] - GPU 3 Memory: Allocated: 0.00GB, Reserved: 0.00GB