Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add support for Elephant Robotics MyArm M&C #506

Open
wants to merge 29 commits into
base: main
Choose a base branch
from

Conversation

apockill
Copy link

@apockill apockill commented Nov 13, 2024

What this does

This PR adds support for Elephant Robotics MyArm M&C robot arms, an education-focused ALOHA style pairing of "mover" and "controller" arms (hence the M&C). Specs and shop here.

I'm adding support so that others can get started more easily.

How it was tested

I own a pair of these arms, and am developing specifically to make this work well with lerobot. I'm also developing acton_ai as a helper library so as to not clutter up lerobot with myarm specific helper code.

How to checkout & try? (for the reviewer)

I need some guidance here :) I'd be happy to post some videos of the results once the PR is out of draft mode.

Question for Reviewers

Is anyone interested in me implementing this proposal in this PR, or leaving it as is and implementing it in a future PR? It would make adding new robots to lerobot much, and affect less code.

@@ -0,0 +1,59 @@
# [MyArm Robot Arm Tooling](https://github.com/apockill/acton_ai)
Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

TODO: Test and validate a policy, put a video here to show how it all came together

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Okay, so here's a policy in action that's not quite working... It was supposed to stack the cubes haha. However, it's definitely "working" in that the whole implementation works- teleop, data recording, training, and finally playback has been tested so far. I will add further PR's to teach how to train better policies in the near future :)

Here's a teleop example.

@apockill apockill marked this pull request as ready for review November 18, 2024 00:29
Follow [this guide to setup your cameras](https://github.com/huggingface/lerobot/blob/main/examples/7_get_started_with_real_robot.md#c-add-your-cameras-with-opencvcamera). Then you will be able to display the cameras on your computer while you are teleoperating by running the following code. This is useful to prepare your setup before recording your first dataset.
```bash
python3 lerobot/scripts/control_robot.py teleoperate \
--robot-path lerobot/configs/robot/myarm.yaml
Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I might need some help here. I found that cv2.imshow froze the system, I had to comment it out.

That's definitely not caused by anything in this PR, but I'd like to fix that so other's don't run into the same issue 😁

@apockill apockill changed the title Add support for Elephant Robotics MyArm M&C (ALOHA-style robots) Add support for Elephant Robotics MyArm M&C Jan 7, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant