KWIVER Processes in RC3D

RC3D [XDS17]

class rc3d_detector.RC3DDetector(conf)

Forward pass for RC3D

  • Input Ports:
    • image RGB image (Required)
    • timestamp Timestamp for the image (Required)
    • file_name Name of the input source (Optional)
  • Output Ports:
    • detected_object_set Temporal detections obtained from forward pass
  • Configuration:
    • experiment_file_name Experiment configuration used by RC3D (Eg. experiment.yml)
    • model_cfg Model configuration used by RC3D (Eg. td_cnn_end2end.yml)
    • stride Temporal stride for RC3D (default=8)
    • gpu Gpu index on which RC3D is executed (default=8)
class rc3d_json_writer.RC3DJsonWriter(conf)

Write detected_object_set from RC3D into NIST specified JSON format

  • Input Ports:
    • detected_object_set Detected object set obtained from RC3D (Required)
    • timestamp Timestamp associated with the input from which the detected object set was obtained from (Required)
    • file_name Name of the input source (Required)
  • Output Ports:
    • None
  • Configuration:
    • experiment_file_name Experiment configuration used by RC3D (Eg. experiment.yml)
    • model_cfg Model configuration used by RC3D (Eg. td_cnn_end2end.yml)
    • stride Temporal stride for RC3D (default=8)
    • temporal_buffer Buffer frames when merging frames (default=8)
    • json_path Path where output json file is saved (default=sysfile.json)
    • confidence_threshold Minimum confidence threshold used by RC3D to accept an activity detection (default=0.05)
class rc3d_visualizer.RC3DVisualizer(conf)

Render detected_object_set from RC3D on image and show temporal history of detections using swimlanes

  • Input Ports:
    • detected_object_set Detected object set obtained from RC3D (Required)
    • timestamp timestamp associated with the input from which the detected object set was obtained from (Required)
    • image RGB image obtained from input source (Required)
  • Output Ports:
    • image RGB image with activity detections and swimlane
  • Configuration:
    • experiment_file_name Experiment configuration used by RC3D (Eg. experiment.yml)
    • stride Temporal stride for RC3D (default=8)
    • Legend Configuration Parameters: Configuration parameters associated iwith legend
      • legend_text_height Height of the legend text (default=10)
      • legend_text_width Width of the legend text (default=40)
      • legend_text_buffer Space between legend text (default=4)
      • legend_font_scale Scale of the font used in legend (default=0.8)
    • Swimlane Configuration Parameters: Configuration parameters associated with swimlane
      • swimlane_text_height Height of the swimlane text (default=15)
      • swimlane_text_width Width of the swimlane text (default=40)
      • swimlane_text_buffer Space between the text in swimlane (default=2)
      • swimlane_text_font_scale Scale of the fonts used in swimlane (default=0.5)
    • image_width Width of rendering area (default=1920)
    • image_height Height of the rendering area (default=1080)
    • confidence_threshold Lower bound on confidence to render an activiy (default=0.2)

[XDS17]Huijuan Xu, Abir Das, and Kate Saenko. R-c3d: region convolutional 3d network for temporal activity detection. In ICCV 2017 - IEEE International Conference on Computer Vision. Venice, Italy, October 2017.