Edge Video Infrastructure (EVI) KPI Test User Guide

ID Date Version Classification
826104 06/28/2024 1.0 Public

Media Storage

Prepare dataset for test.

Download BIT-Vehicle Dataset and extract to /home/data/images.

mkdir -p /home/data/{images,metadata_ms}
# keep the first 1000 images only
for f in $(ls /home/data/images/* | sed -ne '1001,$p'); do rm $f; done
# generate meta data
python3 ./image_into_metadata.py

KPI test for image:

# check or edit the configuration to ensure:
# "mediaPath": "/opt/data/images", "mediaMetadataPath": "/opt/data/metadata_ms", "mediaType": "image"
kubectl -n smartedge-apps edit cm evi-test-tool-cfg

# each iteration takes about 2 minutes
for i in {1..4}; do
  kubectl -n smartedge-apps exec -it deploy/evi-test-tool -- ./kpi_image_test \
    -f configuration/evi-test-tool.json \
  | sed -n '/Results/,$p'
done
# timeAdd = 66938.73 ms; add_throughput = 5.29 MB/s
# timeRead = 11677.32 ms; read_throughput = 30.32 MB/s
# timeRemove = 5096.73 ms; remove_throughput = 69.47 MB/s

KPI test for video:

# download video for test
mkdir -p /home/data/video/ && cd $_
wget -O video_kpi.h264 https://samples.ffmpeg.org/V-codecs/h264/nature_704x576_25Hz_1500kbits.h264

for i in {1..4}; do
  kubectl -n smartedge-apps exec -it deploy/evi-test-tool -- ./kpi_video_threads_test \
    -c configuration/evi-test-tool.json -f /opt/data/video/video_kpi.h264 -t 6 -i 20 \
  | sed -n '/Results/,$p'
done
# Throughput = 105.70 MB/s