KWIVER Processes in RC3D¶
RC3D [XDS17]
-
class
rc3d_detector.
RC3DDetector
(conf)¶ Forward pass for RC3D
- Input Ports:
image
RGB image (Required)timestamp
Timestamp for the image (Required)file_name
Name of the input source (Optional)
- Output Ports:
detected_object_set
Temporal detections obtained from forward pass
- Configuration:
experiment_file_name
Experiment configuration used by RC3D (Eg. experiment.yml)model_cfg
Model configuration used by RC3D (Eg. td_cnn_end2end.yml)stride
Temporal stride for RC3D (default=8)gpu
Gpu index on which RC3D is executed (default=8)
-
class
rc3d_json_writer.
RC3DJsonWriter
(conf)¶ Write
detected_object_set
from RC3D into NIST specified JSON format- Input Ports:
detected_object_set
Detected object set obtained from RC3D (Required)timestamp
Timestamp associated with the input from which the detected object set was obtained from (Required)file_name
Name of the input source (Required)
- Output Ports:
- None
- Configuration:
experiment_file_name
Experiment configuration used by RC3D (Eg. experiment.yml)model_cfg
Model configuration used by RC3D (Eg. td_cnn_end2end.yml)stride
Temporal stride for RC3D (default=8)temporal_buffer
Buffer frames when merging frames (default=8)json_path
Path where output json file is saved (default=sysfile.json)confidence_threshold
Minimum confidence threshold used by RC3D to accept an activity detection (default=0.05)
-
class
rc3d_visualizer.
RC3DVisualizer
(conf)¶ Render
detected_object_set
from RC3D on image and show temporal history of detections using swimlanes- Input Ports:
detected_object_set
Detected object set obtained from RC3D (Required)timestamp
timestamp associated with the input from which the detected object set was obtained from (Required)image
RGB image obtained from input source (Required)
- Output Ports:
image
RGB image with activity detections and swimlane
- Configuration:
experiment_file_name
Experiment configuration used by RC3D (Eg. experiment.yml)stride
Temporal stride for RC3D (default=8)- Legend Configuration Parameters: Configuration parameters associated iwith legend
legend_text_height
Height of the legend text (default=10)legend_text_width
Width of the legend text (default=40)legend_text_buffer
Space between legend text (default=4)legend_font_scale
Scale of the font used in legend (default=0.8)
- Swimlane Configuration Parameters: Configuration parameters associated with swimlane
swimlane_text_height
Height of the swimlane text (default=15)swimlane_text_width
Width of the swimlane text (default=40)swimlane_text_buffer
Space between the text in swimlane (default=2)swimlane_text_font_scale
Scale of the fonts used in swimlane (default=0.5)
image_width
Width of rendering area (default=1920)image_height
Height of the rendering area (default=1080)confidence_threshold
Lower bound on confidence to render an activiy (default=0.2)
[XDS17] | Huijuan Xu, Abir Das, and Kate Saenko. R-c3d: region convolutional 3d network for temporal activity detection. In ICCV 2017 - IEEE International Conference on Computer Vision. Venice, Italy, October 2017. |