[DataCap Application] <AWS open data> - <Aind_mouse> #34

liruior · 2024-08-27T08:24:28Z

Version

1

DataCap Applicant

Allen Institute

Project ID

1

Data Owner Name

Allen Institute

Data Owner Country/Region

American Samoa

Data Owner Industry

Life Science / Healthcare

Website

https://registry.opendata.aws/allen-nd-open-data/

Social Media Handle

liruior

Social Media Type

Other

What is your role related to the dataset

Dataset Owner

Total amount of DataCap being requested

5PiB

Expected size of single dataset (one copy)

900TiB

Number of replicas to store

6

Weekly allocation of DataCap requested

2PiB

On-chain address for first allocation

f1nnoi4jw7eauijpcjffhcayiybj2y55zlpce3qfi

Data Type of Application

Public, Open Dataset (Research/Non-Profit)

Custom multisig

Use Custom Multisig

Identifier

No response

Share a brief history of your project and organization

The Allen Institute for Neural Dynamics (AIND) is committed to FAIR, Open, and Reproducible science. We therefore share all of the raw and derived data we collect publicly with rich metadata, including preliminary data collected during methods development, as near to the time of collection as possible.

Is this project associated with other projects/ecosystem stakeholders?

No

If answered yes, what are the other projects/ecosystem stakeholders

No response

Describe the data being stored onto Filecoin

Mouse Neuroanatomy and Physiology Data

Where was the data currently stored in this dataset sourced from

AWS Cloud

If you answered "Other" in the previous question, enter the details here

No response

If you are a data preparer. What is your location (Country/Region)

Hong Kong

If you are a data preparer, how will the data be prepared? Please include tooling used and technical details?

Packing data using singularity

If you are not preparing the data, who will prepare the data? (Provide name and business)

No response

Has this dataset been stored on the Filecoin network before? If so, please explain and make the case why you would like to store this dataset again to the network. Provide details on preparation and/or SP distribution.

No response

Please share a sample of the data

aws s3 ls --no-sign-request s3://allen-mouse-brain-atlas/ 190.0 TiB
aws s3 ls --no-sign-request s3://aind-open-data/   720.5 TiB

Confirm that this is a public dataset that can be retrieved by anyone on the Network

I confirm

If you chose not to confirm, what was the reason

No response

What is the expected retrieval frequency for this data

Yearly

For how long do you plan to keep this dataset stored on Filecoin

Permanently

In which geographies do you plan on making storage deals

Greater China, Asia other than Greater China, North America, South America, Europe, Australia (continent)

How will you be distributing your data to storage providers

Cloud storage (i.e. S3), HTTP or FTP server

How did you find your storage providers

Slack, Partners

If you answered "Others" in the previous question, what is the tool or platform you used

No response

Please list the provider IDs and location of the storage providers you will be working with.

f02368946 Huhehaote
f02362412 California
f02639492 California
f02822222 Hong Kong
f03166666 Hongkong
f03166668 Hongkong

How do you plan to make deals to your storage providers

Boost client

If you answered "Others/custom tool" in the previous question, enter the details here

No response

Can you confirm that you will follow the Fil+ guideline

Yes

The text was updated successfully, but these errors were encountered:

datacap-bot · 2024-08-27T08:24:45Z

Application is waiting for allocator review

TOPPOOL-LEE · 2024-08-27T09:50:44Z

Thank you for applying for DC:

Does your SP support Spark?
How do you process data? Do you need our help?
Are you ready?

liruior · 2024-08-27T12:28:41Z

Thank you for applying for DC:

Does your SP support Spark?

All support spark

How do you process data? Do you need our help?

Packing data using singularity

Are you ready?

yes

datacap-bot · 2024-08-28T03:26:30Z

Datacap Request Trigger

Total DataCap requested

5PiB

Expected weekly DataCap usage rate

2PiB

DataCap Amount - First Tranche

256TiB

Client address

f1nnoi4jw7eauijpcjffhcayiybj2y55zlpce3qfi

datacap-bot · 2024-08-28T03:26:31Z

DataCap Allocation requested

Multisig Notary address

Client address

f1nnoi4jw7eauijpcjffhcayiybj2y55zlpce3qfi

DataCap allocation requested

256TiB

Id

6f0ac1b1-349f-4bca-a320-815eb873dfab

datacap-bot · 2024-08-28T03:26:32Z

Application is ready to sign

datacap-bot · 2024-08-28T03:27:21Z

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceajxfc4iaabwst332rml5lqizdogryft33cdiai4ig3sokgq2wflc

Address

f1nnoi4jw7eauijpcjffhcayiybj2y55zlpce3qfi

Datacap Allocated

256TiB

Signer Address

f1grjkkw3p5hw3vx5gonvppkkzpcgmu4xnwfm7sli

Id

6f0ac1b1-349f-4bca-a320-815eb873dfab

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceajxfc4iaabwst332rml5lqizdogryft33cdiai4ig3sokgq2wflc

datacap-bot · 2024-08-28T03:27:22Z

Application is Granted

datacap-bot · 2024-08-28T08:48:37Z

The wallet address in this application has previously received datacap from another source. Please update the application to use a new client wallet address, so that it is clear that datacap usage is associated with this application.

liruior · 2024-08-29T01:59:46Z

checker:manualTrigger

datacap-bot · 2024-08-29T01:59:50Z

DataCap and CID Checker Report¹

No active deals found for this client.

To manually trigger this report, add a comment with text checker:manualTrigger ↩

datacap-bot · 2024-08-29T03:00:12Z

Client used 75% of the allocated DataCap. Consider allocating next tranche.

liruior · 2024-08-29T04:26:35Z

256T is more than 75% utilized and it appears that the robot's data is not updated in a timely manner
Here are some of the SP retrieval rates, can you approve the next round?

TOPPOOL-LEE · 2024-08-29T05:15:31Z

checker:manualTrigger

datacap-bot · 2024-08-29T05:15:34Z

DataCap and CID Checker Report¹

No active deals found for this client.

To manually trigger this report, add a comment with text checker:manualTrigger ↩

TOPPOOL-LEE · 2024-08-29T08:46:01Z

In the first round, the bot was not updated. It will temporarily support the second round and expect data updates tomorrow.

datacap-bot · 2024-08-29T08:46:59Z

Application is in Refill

liruior · 2024-09-02T01:20:04Z

checker:manualTrigger

datacap-bot · 2024-09-02T01:22:06Z

DataCap and CID Checker Report Summary¹

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

⚠️ 33.33% of Storage Providers have retrieval success rate less than 75%.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients²

✔️ No CID sharing has been observed.

Full report

Click here to view the CID Checker report.

To manually trigger this report, add a comment with text checker:manualTrigger ↩
To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ... ↩

TOPPOOL-LEE · 2024-09-02T03:18:09Z

The filled in sp is the same as the actual sp of cooperation, except that the geographical location of f02368946 is different in the city.
The sp is distributed in two continents and is relatively scattered.
All sps support spark. Hope to improve the retrieval rate of f02822222.
Support this round

TOPPOOL-LEE · 2024-09-02T03:18:39Z

datacap-bot · 2024-09-02T03:26:19Z

Application is in Refill

datacap-bot · 2024-09-02T03:28:08Z

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzaceacrmspjjqykro2suvzcd5ap45pwjjf42ikezznqussustioafysq

Address

f1nnoi4jw7eauijpcjffhcayiybj2y55zlpce3qfi

Datacap Allocated

768TiB

Signer Address

f1grjkkw3p5hw3vx5gonvppkkzpcgmu4xnwfm7sli

Id

8dd67a69-7ab1-4812-b6e9-4b33cdc33a44

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceacrmspjjqykro2suvzcd5ap45pwjjf42ikezznqussustioafysq

datacap-bot · 2024-09-02T03:28:09Z

Application is Granted

datacap-bot · 2024-09-03T11:00:15Z

Client used 75% of the allocated DataCap. Consider allocating next tranche.

liruior · 2024-09-05T01:29:26Z

checker:manualTrigger

datacap-bot · 2024-09-05T01:32:01Z

DataCap and CID Checker Report Summary¹

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

⚠️ 50.00% of Storage Providers have retrieval success rate less than 75%.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients²

✔️ No CID sharing has been observed.

Full report

Click here to view the CID Checker report.

To manually trigger this report, add a comment with text checker:manualTrigger ↩
To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ... ↩

TOPPOOL-LEE · 2024-10-17T09:46:46Z

checker:manualTrigger

datacap-bot · 2024-10-17T09:46:52Z

DataCap and CID Checker Report Summary¹

Storage Provider Distribution

⚠️ 1 storage providers sealed too much duplicate data - f03166668: 21.81%

⚠️ 100.00% of Storage Providers have retrieval success rate less than 75%.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients²

✔️ No CID sharing has been observed.

Full report

Click here to view the CID Checker report.

To manually trigger this report, add a comment with text checker:manualTrigger ↩
To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ... ↩

TOPPOOL-LEE · 2024-10-22T02:19:19Z

checker:manualTrigger

datacap-bot · 2024-10-22T02:19:24Z

DataCap and CID Checker Report Summary¹

Storage Provider Distribution

⚠️ 1 storage providers sealed too much duplicate data - f03166668: 21.81%

⚠️ 100.00% of Storage Providers have retrieval success rate less than 75%.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients²

✔️ No CID sharing has been observed.

Full report

Click here to view the CID Checker report.

To manually trigger this report, add a comment with text checker:manualTrigger ↩
To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ... ↩

TOPPOOL-LEE · 2024-11-04T09:17:27Z

checker:manualTrigger

datacap-bot · 2024-11-04T09:17:32Z

DataCap and CID Checker Report Summary¹

Storage Provider Distribution

⚠️ 1 storage providers sealed too much duplicate data - f03166668: 21.81%

⚠️ 100.00% of Storage Providers have retrieval success rate less than 75%.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients²

✔️ No CID sharing has been observed.

Full report

Click here to view the CID Checker report.

To manually trigger this report, add a comment with text checker:manualTrigger ↩
To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ... ↩

TOPPOOL-LEE · 2024-11-04T09:18:28Z

fidlabs/allocator-tooling#73

TOPPOOL-LEE · 2024-11-24T05:30:00Z

checker:manualTrigger

TOPPOOL-LEE · 2024-12-06T04:37:21Z

checker:manualTrigger

datacap-bot · 2024-12-06T04:37:27Z

DataCap and CID Checker Report Summary¹

Storage Provider Distribution

⚠️ 1 storage providers sealed too much duplicate data - f03166668: 21.81%

⚠️ 33.33% of Storage Providers have retrieval success rate equal to zero.

⚠️ 100.00% of Storage Providers have retrieval success rate less than 75%.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients²

✔️ No CID sharing has been observed.

Full report

Click here to view the CID Checker report.

To manually trigger this report, add a comment with text checker:manualTrigger ↩
To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ... ↩

datacap-bot bot mentioned this issue Aug 27, 2024

Datacap for Allen Institute #35

Merged

datacap-bot bot added validated waiting for allocator review labels Aug 27, 2024

TOPPOOL-LEE self-assigned this Aug 27, 2024

datacap-bot bot added ready to sign and removed validated waiting for allocator review labels Aug 28, 2024

datacap-bot bot added granted and removed ready to sign labels Aug 28, 2024

datacap-bot bot added Refill needed and removed granted labels Aug 29, 2024

datacap-bot bot added Refill and removed Refill needed labels Aug 29, 2024

datacap-bot bot added Refill and removed Refill needed labels Sep 2, 2024

datacap-bot bot mentioned this issue Sep 2, 2024

Datacap for Allen Institute #37

Merged

datacap-bot bot added granted and removed Refill labels Sep 2, 2024

TOPPOOL-LEE mentioned this issue Sep 2, 2024

2nd Community Review of TOPPOOL Allocator filecoin-project/Allocator-Governance#150

Closed

datacap-bot bot added Refill needed and removed granted labels Sep 3, 2024

TOPPOOL-LEE closed this as completed Nov 7, 2024

TOPPOOL-LEE mentioned this issue Dec 6, 2024

CID Checker reports duplicate data fidlabs/allocator-tooling#73

Closed

[DataCap Application] <AWS open data> - <Aind_mouse> #34

[DataCap Application] <AWS open data> - <Aind_mouse> #34

Comments

liruior commented Aug 27, 2024 • edited Loading

Version

DataCap Applicant

Project ID

Data Owner Name

Data Owner Country/Region

Data Owner Industry

Website

Social Media Handle

Social Media Type

What is your role related to the dataset

Total amount of DataCap being requested

Expected size of single dataset (one copy)

Number of replicas to store

Weekly allocation of DataCap requested

On-chain address for first allocation

Data Type of Application

Custom multisig

Identifier

Share a brief history of your project and organization

Is this project associated with other projects/ecosystem stakeholders?

If answered yes, what are the other projects/ecosystem stakeholders

Describe the data being stored onto Filecoin

Where was the data currently stored in this dataset sourced from

If you answered "Other" in the previous question, enter the details here

If you are a data preparer. What is your location (Country/Region)

If you are a data preparer, how will the data be prepared? Please include tooling used and technical details?

If you are not preparing the data, who will prepare the data? (Provide name and business)

Has this dataset been stored on the Filecoin network before? If so, please explain and make the case why you would like to store this dataset again to the network. Provide details on preparation and/or SP distribution.

Please share a sample of the data

Confirm that this is a public dataset that can be retrieved by anyone on the Network

If you chose not to confirm, what was the reason

What is the expected retrieval frequency for this data

For how long do you plan to keep this dataset stored on Filecoin

In which geographies do you plan on making storage deals

How will you be distributing your data to storage providers

How did you find your storage providers

If you answered "Others" in the previous question, what is the tool or platform you used

Please list the provider IDs and location of the storage providers you will be working with.

How do you plan to make deals to your storage providers

If you answered "Others/custom tool" in the previous question, enter the details here

Can you confirm that you will follow the Fil+ guideline

datacap-bot bot commented Aug 27, 2024

TOPPOOL-LEE commented Aug 27, 2024

liruior commented Aug 27, 2024

datacap-bot bot commented Aug 28, 2024

Datacap Request Trigger

datacap-bot bot commented Aug 28, 2024

DataCap Allocation requested

Multisig Notary address

Client address

DataCap allocation requested

Id

datacap-bot bot commented Aug 28, 2024

datacap-bot bot commented Aug 28, 2024

Request Approved

Message sent to Filecoin Network

Address

Datacap Allocated

Signer Address

Id

You can check the status of the message here: https://filfox.info/en/message/bafy2bzaceajxfc4iaabwst332rml5lqizdogryft33cdiai4ig3sokgq2wflc

datacap-bot bot commented Aug 28, 2024

datacap-bot bot commented Aug 28, 2024

liruior commented Aug 29, 2024

datacap-bot bot commented Aug 29, 2024

DataCap and CID Checker Report1

Footnotes

datacap-bot bot commented Aug 29, 2024

liruior commented Aug 29, 2024

TOPPOOL-LEE commented Aug 29, 2024

datacap-bot bot commented Aug 29, 2024

DataCap and CID Checker Report1

Footnotes

TOPPOOL-LEE commented Aug 29, 2024

datacap-bot bot commented Aug 29, 2024

liruior commented Sep 2, 2024

liruior commented Aug 27, 2024 •

edited

Loading

DataCap and CID Checker Report¹

DataCap and CID Checker Report¹

DataCap and CID Checker Report Summary¹

Deal Data Shared with other Clients²

DataCap and CID Checker Report Summary¹

Deal Data Shared with other Clients²

DataCap and CID Checker Report Summary¹

Deal Data Shared with other Clients²

DataCap and CID Checker Report Summary¹

Deal Data Shared with other Clients²

DataCap and CID Checker Report Summary¹

Deal Data Shared with other Clients²

DataCap and CID Checker Report Summary¹

Deal Data Shared with other Clients²