Skip to content

Commit

Permalink
Merge pull request #48 from aidecentralized/table_docs
Browse files Browse the repository at this point in the history 
Table docs
  • Loading branch information
@joyce-yuan
joyce-yuan authored Aug 17, 2024
2 parents 673dc93 + 1f4b09d commit bf387ba
Showing 1 changed file with 33 additions and 34 deletions.
67 changes: 33 additions & 34 deletions docs/index.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -24,38 +24,36 @@ The application currently uses MPI and GRPC (experimental) to enable communicati
**Table 1:** Performance overview (AUC) of various topologies with different number of collaborators.

**Table 2** Area Under Curve of Test Accuracy Varying Number of Users
| Num Users | DomainNet | | Camelyon17 | | Digit-Five | |
|-----------|----------------------|--------------------|---------------------|--------------------|----------------------|--------------------|
| | Within Domain | Random | Within Domain | Random | Within Domain | Random |
|-----------|----------------------|--------------------|---------------------|--------------------|----------------------|--------------------|
| 12 | 56.6267 | 50.1772 | 178.3622 | 145.6398 | 57.1168 | 68.9724 |
| 18 | 59.5647 | 54.2480 | 179.5941 | 145.9916 | 66.8201 | 69.8341 |
| 24 | 61.8006 | 54.3855 | 178.5976 | 149.2037 | 71.6536 | 72.5333 |
| 30 | 66.5896 | 58.4835 | 179.1761 | 153.0658 | 74.4239 | 72.6996 |
| 39 | 68.3743 | 59.6090 | 179.1404 | 149.8618 | 163.8116 | 163.9892 |
| 45 | 68.1241 | 59.7852 | 180.0231 | 147.4649 | 77.0248 | 73.0634 |


**Table 3*** Area Under Curve of Test Accuracy Varying Number of Domains

| AUC DomainNet (48 users, 200 rounds) |
|---------------------------------------------------|
| Num Domains | Within Domain | Random |
|-------------|---------------------|---------------|
| 2 | 67.7514 | 58.7947 |
| 4 | 61.5723 | 50.2906 |
| 6 | 69.4671 | 47.7867 |

| AUC Camelyon17 (30 users, 200 rounds) |
|--------------------------------------------------------------------------|
| Num Users | DomainNet | | Camelyon17 | | Digit-Five | |
|-----------|----------------------|--------------------|---------------------|--------------------|----------------------|------------------|
| | Within Domain | Random | Within Domain | Random | Within Domain | Random |
|-----------|----------------------|--------------------|---------------------|--------------------|----------------------|------------------|
| 12 | 56.6267 | 50.1772 | 178.3622 | 145.6398 | 57.1168 | 68.9724 |
| 18 | 59.5647 | 54.2480 | 179.5941 | 145.9916 | 66.8201 | 69.8341 |
| 24 | 61.8006 | 54.3855 | 178.5976 | 149.2037 | 71.6536 | 72.5333 |
| 30 | 66.5896 | 58.4835 | 179.1761 | 153.0658 | 74.4239 | 72.6996 |
| 39 | 68.3743 | 59.6090 | 179.1404 | 149.8618 | 163.8116 | 163.9892 |
| 45 | 68.124 | 59.7852 | 180.0231 | 147.4649 | 77.0248 | 73.0634 |


**Table 3** Area Under Curve of Test Accuracy Varying Number of Domains

*AUC DomainNet (48 users, 200 rounds)*
| Num Domains | Within Domain | Random |
|-------------|---------------|---------------|
| 2 | 67.7514 | 58.7947 |
| 4 | 61.5723 | 50.2906 |
| 6 | 69.4671 | 47.7867 |

*AUC Camelyon17 (30 users, 200 rounds)*
| Num Domains | Within Domain | Random |
|-------------|---------------------|---------------|
| 2 | 179.7901 | 172.9167 |
| 3 | 179.1761 | 153.0658 |
| 5 | 176.5059 | 139.4547 |

| AUC Digit-Five (30 users, 200 rounds) |
|--------------------------------------------------------------------------|

*AUC Digit-Five (30 users, 200 rounds)*
| Num Domains | Within Domain | Random |
|-------------|---------------------|---------------|
| 2 | 71.8536 | 65.6555 |
Expand All @@ -64,9 +62,9 @@ The application currently uses MPI and GRPC (experimental) to enable communicati

**Table 4** Test Accuracy and Standard Deviation Over Rounds

| Rounds | DomainNet (39 users, 3 domains) | | | | |
|--------|-----------------------------------------------------|---------------|---------------|---------------|---------------|
| | Within Domain | | Random | |
| Rounds | DomainNet (39 users, 3 domains) | | | |
|--------|----------------------------------------------------|---------------|---------------|---------------|
| | Within Domain | | Random | |
|--------|---------------------------|------------------------|---------------------------|------------------------|
| | Mean | Std | Mean | Std |
| 100 | 0.3619 | 0.0635 | 0.3212 | 0.0625 |
Expand All @@ -76,8 +74,8 @@ The application currently uses MPI and GRPC (experimental) to enable communicati
| 500 | 0.4726 | 0.0502 | 0.4499 | 0.0496 |


| Rounds | Camelyon17 (39 users, 3 domains) | | | | |
|--------|-----------------------------------------------------|---------------|---------------|---------------|---------------|
| Rounds | Camelyon17 (39 users, 3 domains) | | | |
|--------|-----------------------------------------------------|---------------|---------------|---------------|
| | Within Domain | | Random | |
|--------|---------------------------|------------------------|---------------------------|------------------------|
| | Mean | Std | Mean | Std |
Expand All @@ -87,9 +85,10 @@ The application currently uses MPI and GRPC (experimental) to enable communicati
| 160 | 0.9361 | 0.0239 | 0.8122 | 0.1346 |
| 200 | 0.9353 | 0.0251 | 0.7762 | 0.1516 |

| Rounds | Digit Five (39 users, 3 domains) | | | | |
|--------|----------------------------------------------------|---------------|---------------|---------------|---------------|
| | Within Domain | | Random | |

| Rounds | Digit Five (39 users, 3 domains) | | | |
|--------|----------------------------------------------------|---------------|---------------|---------------|
| | Within Domain | | Random | |
|--------|---------------------------|-----------------------|---------------------------|-----------------------|
| | Mean | Std | Mean | Std |
| 20 | 0.7314 | 0.1290 | 0.6788 | 0.0839 |
Expand Down

0 comments on commit bf387ba

Please sign in to comment.