Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Image processing rate affected by what the webcam sees #1

Open
hello-binit opened this issue Feb 29, 2024 · 0 comments
Open

Image processing rate affected by what the webcam sees #1

hello-binit opened this issue Feb 29, 2024 · 0 comments
Assignees

Comments

@hello-binit
Copy link
Contributor

hello-binit commented Feb 29, 2024

This issue is discovered by @bm-hellorobot. What is seen by the webcam that looks for the tong Aruco markers can affect the performance of the system. Part of the Dex Teleop system is a Linux process (launched through the multiprocessing library) that looks for Aruco markers in the webcam image. This image processing process is nominally running at 30hz. However, if the webcam sees a background with a large number of features that could be Aruco markers (at least according to the preprocessing steps used in OpenCV's Aruco marker detection routine), such as square white popcorn tile on the ceiling, then Aruco processing slows way down and the overall rate of the process drops. Then, the performance of the system is affected. In his testing, Blaine saw it drop down to 6hz with the popcorn ceiling, but jump back up to 30 hz when the background was blocked out.

To reproduce this issue, use the goal_from_teleop script. This reports the frequency of its last ten points so you can see it change in real time as you move the camera.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants