Merge branch 'main' of github.com:OpenSun3D/OpenSun3D.github.io

challenge/README.md

@@ -32,7 +32,7 @@ Our challenge consists of two phases: *Development Phase*, and *Test Phase*.
 
 - In the first phase, the *Development Phase*, the challenge participants can download and use the whole *Training* split of the ARKitScenes dataset for their experiments. From these *Training* scenes, we annotate a few example scenes for development purposes. More specifically, for each example scene, we first specify an open-vocabulary query, and then manually annotate objects corresponding to the given query, by segmenting them in the point cloud of the given scene. We refer to this subset as the *Challenge Development* set. The participants can upload their predictions on scenes from the *Challenge Development* set to the [Phase 1 - Development Benchmark](https://eval.ai/web/challenges/challenge-page/2102/submission) in the challenge website.
 
-- In the second phase, the *Test Phase*, we provide a subset of scenes from the *Validation* split of the ARKitScenes dataset, we refer to this subset as the *Challenge Test* set. For each of these scenes, we provide an input text-query. The participants are expected to upload their predictions for each scene from the *Challenge Test* to the [Phase 2 - Test Benchmark](https://eval.ai/web/challenges/challenge-page/2102/submission) in the challenge website. Data for this phase will be made available for downloading in August 2023, this will be announced on our website.
+- In the second phase, the *Test Phase*, we provide a subset of scenes from the *Validation* split of the ARKitScenes dataset, we refer to this subset as the *Challenge Test* set. For each of these scenes, we provide an input text-query. The participants are expected to upload their predictions for each scene from the *Challenge Test* to the [Phase 2 - Test Benchmark](https://eval.ai/web/challenges/challenge-page/2102/submission) in the challenge website.
 
 
 ### **Download Instructions**
@@ -47,16 +47,15 @@ Download the data using
 ```
 python3 challenge/download_data_opensun3d.py --data_type=challenge_development_set --download_dir PATH/TO/ARKITSCENES/DOWNLOAD/DIR
 ```
-Queries for each scene are available in [`queries_development_scenes.csv`](benchmark_file_lists/queries_test_scenes.csv).
+Queries for each scene are available in [`queries_development_scenes.csv`](benchmark_file_lists/queries_development_scenes.csv).
 
 Furthermore, we provide ground truth instance masks for the development scenes [here](benchmark_data/gt_development_scenes), whose data format is explained [here](benchmark_data/gt_data_format.md). Please note that submission of the predicted masks require a different file format, explained in more detail [here](#submission-instructions).
 
 #### **Phase 2 - Download Challenge Test Set (~30GB)**
->NOTE: Data for this phase will be made available for downloading in August 2023, this will be announced on our website.
 ```
 python3 challenge/download_data_opensun3d.py --data_type=challenge_test_set --download_dir PATH/TO/ARKITSCENES/DOWNLOAD/DIR
 ```
-Queries for each scene will be made available in [`queries_test_scenes.csv`](benchmark_file_lists/queries_test_scenes.csv).
+Queries for each scene are available in [`queries_test_scenes.csv`](benchmark_file_lists/queries_test_scenes.csv).
 
 #### *(Optional, needed only if you want to train a model) Download Full Training Set (Several hundreds of GBs)*
 ```
@@ -69,7 +68,7 @@ Some of these scenes do not have `wide` assets (see below). If you want to downl
 python3 challenge/download_data_opensun3d.py --data_type=full_training_set_w_wide_assets --download_dir PATH/TO/ARKITSCENES/DOWNLOAD/DIR
 ```
 
-NOTE: If you need to download other assets from the ARKitScenes, please see the [data instructions](https://github.com/apple/ARKitScenes/blob/main/DATA.md) in the [original ARKitScenes repository](https://github.com/apple/ARKitScenes) for further details.  For this challenge, in order to develop or train your model, you can only use the scenes provided in the ARKitScenes Training set or the Development set we provide.
+NOTE: If you need to download other assets from the ARKitScenes, please see the [data instructions](https://github.com/apple/ARKitScenes/blob/main/DATA.md) in the [original ARKitScenes repository](https://github.com/apple/ARKitScenes) for further details.
 
 ---
 ## **Data Organization and Format of Input Data**
@@ -129,7 +128,7 @@ You can explore the [`demo_dataloader_lowres.py`](demo_dataloader_lowres.py) fil
     scene_id = "42445173" # an example scene ID
 ```
 
-Queries for each scene are available in [`queries_development_scenes.csv`](obenchmark_file_lists/queries_test_scenes.csv). First column is `video_id`, second column is `visit_id` and the last column is the open vocabulary query. What we refer to as `{SCENE_ID}` in this document is the `video_id`.
+Queries for each development scene are available in [`queries_development_scenes.csv`](benchmark_file_lists/queries_development_scenes.csv), and queries for each test scene are available in [`queries_test_scenes.csv`](benchmark_file_lists/queries_test_scenes.csv). First column is `video_id`, second column is `visit_id` and the last column is the open vocabulary query. What we refer to as `{SCENE_ID}` in this document is the `video_id`.
 
 ---
 ## **Submission Instructions**

challenge/benchmark_file_lists/challenge_test_scenes.csv

@@ -1 +1,26 @@
-video_id,visit_id,fold
+video_id,visit_id,fold
+42446165,422014,Validation
+42446151,422018,Validation
+42445991,422024,Validation
+42446100,422034,Validation
+42446540,422381,Validation
+42446529,422386,Validation
+42897564,422785,Validation
+42897545,422813,Validation
+42897688,423441,Validation
+42898818,434641,Validation
+42898817,434650,Validation
+42899459,435385,Validation
+45261150,466801,Validation
+45261133,466803,Validation
+47333934,467301,Validation
+47331262,468267,Validation
+45662987,468711,Validation
+47332916,469249,Validation
+47430036,470512,Validation
+47115474,470652,Validation
+47115526,470659,Validation
+47115452,470661,Validation
+47204573,471940,Validation
+47895732,482328,Validation
+48018367,483313,Validation

challenge/benchmark_file_lists/queries_test_scenes.csv

@@ -0,0 +1,26 @@
+video_id,visit_id,query
+42446165,422014,watercolor painting on the table
+42446151,422018,hoverboard
+42445991,422024,picture of a horse
+42446100,422034,post-it
+42446540,422381,red switch
+42446529,422386,package of paper towel rolls
+42897564,422785,victorian upholstered chair
+42897545,422813,watering can
+42897688,423441,Dyson air purifier
+42898818,434641,seashell
+42898817,434650,Persil
+42899459,435385,large letter M
+45261150,466801,Star Wars sheet
+45261133,466803,portrait of Queen Elizabeth
+47333934,467301,furniture than can seat three people
+47331262,468267,musical instrument
+45662987,468711,wall art hanging across the fireplace
+47332916,469249,heart shaped pillow
+47430036,470512,Winnie-the-Pooh
+47115474,470652,folded towel stack
+47115526,470659,hippopotamus
+47115452,470661,giant decorative fork
+47204573,471940,lego head
+47895732,482328,gamepad
+48018367,483313,oven mitts

index.html

@@ -106,7 +106,7 @@ <h2 class="title" id="dates">Important Dates 🗓️</h2>
             <ul>
               <li><b>Submission Portal</b>: <a href="https://cmt3.research.microsoft.com/OpenSUN3D2023">CMT</a></li>
               <li><b>Paper Submission Deadline</b>: July 31, 2023 (23:59 Pacific Time)</li>
-              <li><b>Notification to Authors</b>: August 7, 2023</li>
+              <li><b>Notification to Authors</b>: August 9, 2023</li>
               <li><b>Camera-ready submission</b>: August 21, 2023</li>
             </ul>
             <li><b>Challenge Track</b>:</li>
@@ -115,7 +115,7 @@ <h2 class="title" id="dates">Important Dates 🗓️</h2>
               <li><b>Data Instructions & Helper Scripts</b>: <a href="https://github.com/OpenSun3D/OpenSun3D.github.io/tree/main/challenge">GitHub</a></li>
               <li><b>Dev Phase Start</b>: July 13, 2023</li>
               <li><b>Submission Portal Start</b>: July 17, 2023</li>
-              <li><b>Test Phase Start</b>: August 13, 2023</li>
+              <li><b>Test Phase Start</b>: August 16, 2023</li>
               <li><b>Test Phase End</b>: September 30, 2023 <i>(Winners are decided on this date)</i></li>
 
             </ul>