{{ message }}
Repository navigation
Customizing multi camera streaming pipeline #9
Description
Hi, Thanks for your great work. I have a query regarding the multi-camera stream pipeline. In my case, I have a config file having 4 video sources in which I am applying object detection using Yolov5. Later after detecting objects, I have to calculate distances and had to do other customization on bounding boxes and acquired frames. How can I acquire this data in my python script? Any suggestion, please? @joxis
Activity
julestalloen commentedon Sep 2, 2022
Hi @sharoseali! Glad you like the repository 🙂
Could you provide a bit more information on what exactly you want to achieve? Do you need the timestamps at which objects were detected? With the current implementation you can already access frames and detections via a probe.
sharoseali commentedon Sep 2, 2022
Here is the working config file that I use to get a video stream from 4 video files. Now I want to get these frames and corresponding detections for customization and display again them on 4 screens.
I want to calculate distances and redraw some data values based on B-boxes values.
sharoseali commentedon Sep 5, 2022
@joxis Any response, please?
Explaining a bit more I wanna use my YOLOV5 config file with python to extract boxes using deep stream. Meanwhile, I need two things to customize my detector output. 1 -Camera frame (I will draw a circle using open CV) and bounding boxes (x1 y1, x2, y2) to plot them differently. Sorry, if you don't understand my last comment.
julestalloen commentedon Sep 6, 2022
The current implementation does not support multiple video streams yet. Most code is already in place to make this possible but some final adjustments are needed. Did you already manage to get the boilerplate working with multiple streams? Or did you only use the standard sample application?
sharoseali commentedon Sep 6, 2022
Meanwhile, I am still trying to manage multistream in the current code. I want to ask which specific things I have to edit in app/pipeline.py. Also the current implementation is with tracker but I don't need it for now. So how should I replace my pipeline without a tracker? Thanks
julestalloen commentedon Sep 6, 2022
The
_create_source_binfunction should already create a bin supporting multiple streams. You will, however, have to adjust how it is called (theindexparameter is currently not used). An example can be found here.With respect to the tracker, the easiest method is to just use the IOU Tracker. It is fast and should not impact performance too much. If you really want to remove the tracker you would have to remove this line. You can also subclass the base pipeline and overwrite the
_create_trackerfunction to perform nothing.sharoseali commentedon Sep 8, 2022
HI I almost manage to arrange the code for multi streaming and is almost nearly to work (So I deleted my last comment).
But meanwhile running the code after changes i came across the issue in live camera streaming. As I want to read stream from USB cams that I connected with my Jetson NX kit, so I provide camera ids in this way:
['/dev/video3', '/dev/video2', '1.mp4', '2.mp4']for 4 sources.I got the following error in gstreamer pipeline. I dont know whats the reason behind that . if someone knows please share. Here are my output logs:
Available camera ids showed by this command
v4l2-ctl --list-devicesis belowOne thing more I have changed here in
_create_mp4_sink_binfunction ismp4_sink_bin.add_pad(Gst.GhostPad("sink", nvvidconv3.get_static_pad("sink")))tobin_pad = mp4_sink_bin.add_pad(Gst.GhostPad.new_no_target("src", Gst.PadDirection.SRC).This is because i was getting error :
So where I am exactly wrong? Any guidance...