@mlzxy
Didn't match arp+ success rate
I retrained ARP+ on 2 GPU cards, which was verified to be inconsistent with the paper report
eval.py model.weights=./weights/model_70000_my_train.pth
[2025-04-15 21:56:18,742][main][INFO] - {'put_item_in_drawer': 96.0, 'reach_and_drag': 96.0, 'turn_tap': 100.0, 'slide_block_to_color_target': 100.0, 'open_drawer': 92.0, 'put_groceries_in_cupboard': 68.0, 'place_shape_in_shape_sorter': 52.0, 'put_money_in_safe': 92.0, 'push_buttons': 100.0, 'close_jar': 96.0, 'stack_blocks': 52.0, 'place_cups': 44.0, 'place_wine_at_rack_location': 96.0, 'light_bulb_in': 88.0, 'sweep_to_dustpan_of_size': 100.0, 'insert_onto_square_peg': 36.0, 'meat_off_grill': 100.0, 'stack_cups': 64.0}
[2025-04-15 21:56:18,750][main][INFO] - average success rate: 81.77777777777777
@mlzxy
Didn't match arp+ success rate
I retrained ARP+ on 2 GPU cards, which was verified to be inconsistent with the paper report
eval.py model.weights=./weights/model_70000_my_train.pth
[2025-04-15 21:56:18,742][main][INFO] - {'put_item_in_drawer': 96.0, 'reach_and_drag': 96.0, 'turn_tap': 100.0, 'slide_block_to_color_target': 100.0, 'open_drawer': 92.0, 'put_groceries_in_cupboard': 68.0, 'place_shape_in_shape_sorter': 52.0, 'put_money_in_safe': 92.0, 'push_buttons': 100.0, 'close_jar': 96.0, 'stack_blocks': 52.0, 'place_cups': 44.0, 'place_wine_at_rack_location': 96.0, 'light_bulb_in': 88.0, 'sweep_to_dustpan_of_size': 100.0, 'insert_onto_square_peg': 36.0, 'meat_off_grill': 100.0, 'stack_cups': 64.0}
[2025-04-15 21:56:18,750][main][INFO] - average success rate: 81.77777777777777