Radar-Aided Blockage Prediction
Leaderboard
| Date | Name | Scenario 30 |
|---|---|---|
| 1/15/2021 | Wireless Intelligence Lab ASU | Future-1: 88.64% Future-5: 89.55% Future-10: 85.42% |
- This table documents the different proposed radar-aided blockage prediction solutions. This provides a way to benchmark the performance of the proposed solutions.
- For the individual DeepSense scenarios (development datasets), we use the “Future-N” blockage prediction F1-score as the evaluation metric.
- For further details and information regarding the ML challenge and how to participate, please check the “ML Challenge“ section below.
License
If you want to use the dataset or scripts in this page, please cite the following two papers:
A. Alkhateeb, G. Charan, T. Osman, A. Hredzak, J. Morais, U. Demirhan, and N. Srinivas, “DeepSense 6G: A Large-Scale Real-World Multi-Modal Sensing and Communication Datasets,” IEEE Communications Magazine, 2023.
@Article{DeepSense,
author={Alkhateeb, Ahmed and Charan, Gouranga and Osman, Tawfik and Hredzak, Andrew and Morais, Joao and Demirhan, Umut and Srinivas, Nikhil},
title={DeepSense 6G: A Large-Scale Real-World Multi-Modal Sensing and Communication Dataset},
journal={IEEE Communications Magazine},
year={2023},
publisher={IEEE}}
- The Radar-Aided Blockage Prediction paper: U. Demirhan and A. Alkhateeb, “Radar Aided Proactive Blockage Prediction in Real-World Millimeter Wave Systems,” 2022 IEEE International Conference on Communications (ICC), 2022.
@INPROCEEDINGS{Demirhan2022blockage,
author={Demirhan, Umut and Alkhateeb, Ahmed},
booktitle={ICC 2022 – IEEE International Conference on Communications},
title={Radar Aided Proactive Blockage Prediction in Real-World Millimeter Wave Systems},
year={2022},
pages={4547-4552},
doi={10.1109/ICC45855.2022.9838438},}
Introduction
LOS link blockage is a challenge: Millimeter-wave (mmWave) and sub-terahertz communications are becoming the dominant directions for modern and future wireless networks. With their large bandwidth, they have the ability to satisfy the high data rate demands of several applications such as wireless Virtual/Augmented Reality (VR/AR) and autonomous driving. Communication in these bands, however, faces several challenges at both the physical and network layers. One of the key challenges stems from the sensitivity of mmWave and terahertz signal propagation to blockages. For this, these systems need to rely heavily on maintaining line-of-sight (LOS) connections between the base stations and users. The possibility of blocking these LOS links by stationary or dynamic blockages can highly affect the reliability and latency of mmWave/terahertz systems, which makes it hard for these systems to support highly-mobile and latency-sensitive applications.
Sensing aided blockage prediction is a promising solution: The key to overcoming the link blockage challenges lies in developing a critical sense of the surrounding. The dependence of mmWave/sub-THz communication systems on the line-of-sight links between the transmitter/receiver means that the awareness about their locations and the surrounding environment (geometry of the buildings, moving scatterers, etc.) could potentially help in predicting future blockages. For example, the sensory data collected from RGB cameras, LiDARs, Radars and GPS data can help in identifying probable transmitter and blockages in the wireless environment and understand their mobility patterns. These information can be utilized by the wireless network to proactively predict incoming blockages and in initiating hand-off beforehand. We call this approach sensing-aided blockage prediction and hand-off. Radar-aided blockage prediction is a special case when the basestation attempts to leverage radar measurements of the environment, captured by a radar attached to the basestation, to predict the future LOS link blockages proactively.
Radar-aided blockage prediction: Specific Task Description
Radar-aided blockage prediction at the infrastructure is the task of predicting the future LOS link blockages proactively by utilizing a machine learning model and the images of the wireless environment captured by the radar installed at the basestation.
Objective of the ML Task: At any time t, given a sequence of [katex]r[/katex] latest (previous and current) radar measurements at the time slots [katex]\{t – r + 1, \ldots, t\}[/katex], this task aims to design a machine learning model that predicts the future link blockages. Specifically, the machine learning model is expected to return the blockage status in the future [katex]k[/katex] time-slots, i.e., [katex]\{t + 1, \ldots, t + k\}[/katex]. If there is any blockage during these slots, the blockage status for the [katex]k[/katex] time-slots (future-[katex]k[/katex]) is considered as blocked. For ML model development, we provide a labeled dataset consisting of ordered sequence of radar measurements (for further processing or directly feeding into the machine learning model) and the ground-truth future blockage status. More details regarding the dataset is provided in the Dataset section below.
For further information regarding how radar can aid the beam prediction task, please refer to our paper:
Task-Specific Dataset
DeepSense 6G: Developing efficient solutions for sensing-aided blockage prediction and accurately evaluating them requires the availability of a large-scale real-world dataset. With this motivation, we built the DeepSense 6G dataset, the first large-scale real-world multi-modal dataset with co-existing communication and sensing data.
In this radar-aided blockage prediction task, we build development/challenge datasets based on the DeepSense data from scenario [30].
For each scenario, we provide the following datasets:
- Development Dataset: It comprises of the sequence of radar data and the corresponding ground-truth blockage status for k-future instances. The radar data comprises of the radar measurements of the environment captured by the radar installed at the basestation. This task involves predicting for three different future instances, i.e., future-1, future-5, and future-10.
- Challenge Dataset: To motivate the development of efficient ML models, we propose a benchmark challenge. For this, we provide a Challenge dataset, consisting of only the input radar data sequences. The ground-truth labels are hidden from the users by design to promote a fair benchmarking process. To participate in this Challenge, check the ML Challenge section below for further details.
Below we explain how to access the development dataset.
Please login to download the DeepSense datasets
How to Access Task Data?
Step 1. Download All Scenarios Dataset
Step 2. Extract the RABT.zip file. Contains the scenario dataset folders
Each scenario folder consists of following files:
- unit1:
- Includes the raw radar measurements
- Corresponding blockage labels
- idx.csv: The list of data files and corresponding indices
- future-1
- train.csv
- val.csv
- test.csv
- future-5
- train.csv
- val.csv
- test.csv
- future-10
- train.csv
- val.csv
- test.csv
What does each CSV file contain?
We provide the data indices and corresponding data files in the idx file.
| index | unit1_radar |
|---|---|
| 1 | ./unit1/radar_data/data_3703_22-42-53_46.npy |
| 2 | ./unit1/radar_data/data_3704_22-42-53_47.npy |
| 3 | ./unit1/radar_data/data_3705_22-42-53_48.npy |
| 4 | ./unit1/radar_data/data_3706_22-42-53_49.npy |
| 5 | ./unit1/radar_data/data_3707_22-42-53_50.npy |
We provide the data indices of the sequences and the corresponding future link blockage status in the train, val and test csv files. An example of 5 data samples in shown below.
Note: Different from the other blockage tasks, the blockage labels are provided as individual blockage labels. To generate future-3 blockage labels, an or operation of the first three blockages is needed, i.e., (future_3 = blockage_1 or blockage_2 or blockage_3). The paper implementation provides a code for this purpose.
| index | x_1 | x_2 | x_3 | x_4 | x_5 | x_6 | x_7 | x_8 | blockage_1 | blockage_2 | blockage_3 | blockage_4 | blockage_5 | blockage_6 | blockage_7 | blockage_8 | blockage_9 | blockage_10 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 1 | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 0 | 0 | 0 | 0 | 1 | 1 | 0 | 0 | 0 | 0 |
| 2 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 0 | 0 | 0 | 1 | 1 | 0 | 0 | 0 | 0 | 0 |
| 3 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 0 | 0 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 0 |
| 4 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 0 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
| 5 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 1 | 1 | 0 | 0 | 0 | 0 | 0 | 0 | 0 | 0 |
ML Challenge: Radar-Aided Blockage Prediction
To advance the state-of-the-art in the radar-aided blockage prediction task, we propose a benchmark challenge based on the DeepSense real-world dataset. The objective of the task is to develop a solution that includes a machine learning-based model that takes the sequence of radar measurements at the basestation as the input and predicts the future link blockage status.
This challenge adopts the labeled development dataset described above, with radar measurement and the corresponding link status.
Participation Steps
Step 1. Getting started: First, we recommend the following:
- Get familiarized with the data collection testbed and the different sensor modalities presented here
- Next, in the Tutorials page, we have provided Python-based codes to load and visualize the different data modalities
Step 4. Submission: After you develop your solution with the ML model, you are invited to submit your results at submission@DeepSense6G.net. Please find the submission process and evaluation criteria below.
Submission Process
We define a standardized beam prediction result format that serves as an input to our evaluation code. There is a single real-world DeepSense 6G scenario in this challenge. For this, please submit the following:
- The scenario has three sub-dataset, each corresponding to one of the three future prediction window length, i.e., future-1, future-5 and future-10. The users must submit the predicted link blockage status for each sub-dataset in the Challenge set. An sample submission csv file is shown below.
- Every submission should provide their pre-trained models, evaluation code and ReadMe file documenting the requirements to run the code.
| sample_index | future-1 |
|---|---|
| 1 | 1 |
| 2 | 0 |
| 3 | 0 |
| 4 | 1 |
| 5 | 0 |
Evaluation
- The evaluation metric adopted in this challenge is the prediction accuracy.
- The evaluation is done based on the ML challenge (hidden) test set, which is used for benchmarking purposes.
Leaderboard Rules
- In order to participate in this challenge, please submit your results following the submission process above
- Further, to be ranked in the Leaderboard table, contestants need to submit the challenge set results for all the 6 scenarios and for all three future prediction windows.
