Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[DataCap Application] <Landsat> #3

Open
1 of 2 tasks
himomo007 opened this issue Jun 16, 2024 · 53 comments
Open
1 of 2 tasks

[DataCap Application] <Landsat> #3

himomo007 opened this issue Jun 16, 2024 · 53 comments
Labels

Comments

@himomo007
Copy link

Data Owner Name

USA NASA

Data Owner Country/Region

United States

Data Owner Industry

Environment

Website

https://www.gscloud.cn/sources/index?pid=263&ptitle=LANDSAT%E7%B3%BB%E5%88%97%E6%95%B0%E6%8D%AE&rootid=1

Social Media Handle

https://www.gscloud.cn/sources/index?pid=263&ptitle=LANDSAT%E7%B3%BB%E5%88%97%E6%95%B0%E6%8D%AE&rootid=1

Social Media Type

Other

What is your role related to the dataset

Data Preparer

Total amount of DataCap being requested

10PiB

Expected size of single dataset (one copy)

600TiB

Number of replicas to store

10

Weekly allocation of DataCap requested

1000TiB

On-chain address for first allocation

f12zi5r77p3pm3oaztkni564f4irgckgcnwkskgka

Data Type of Application

Public, Open Dataset (Research/Non-Profit)

Custom multisig

  • Use Custom Multisig

Identifier

No response

Share a brief history of your project and organization

The United States NASA Landsat program, since July 23, 1972, has launched eight satellites (the sixth failed). Currently, Landsat 1-4 have all failed, and Landsat 5 is still in overdue operation (from March 1, 1984 to the present). Landsat 7 was launched on April 15, 1999 Landsat 8 was launched on February 11, 2013 and began acquiring images after 100 days of test operations.

Landsat remote sensing satellite data is a very important source of remote sensing data in the field of remote sensing, with good data continuity, moderate resolution, high data quality and long time series, which has been widely used in many research fields at home and abroad.

The most widely used Landsat series satellites are Landsat 5, Landsat 7 and Landsat 8, and the sensors they carry are mainly MSS, TM, ETM+ and OLI.

Is this project associated with other projects/ecosystem stakeholders?

No

If answered yes, what are the other projects/ecosystem stakeholders

No response

Describe the data being stored onto Filecoin

Landsat remote sensing satellite data is a very important source of remote sensing data in the field of remote sensing, with good data continuity, moderate resolution, high data quality and long time series, which has been widely used in many research fields at home and abroad.

The most widely used Landsat series satellites are Landsat 5, Landsat 7 and Landsat 8, and the sensors they carry are mainly MSS, TM, ETM+ and OLI.

Where was the data currently stored in this dataset sourced from

Other

If you answered "Other" in the previous question, enter the details here

No response

If you are a data preparer. What is your location (Country/Region)

None

If you are a data preparer, how will the data be prepared? Please include tooling used and technical details?

No response

If you are not preparing the data, who will prepare the data? (Provide name and business)

No response

Has this dataset been stored on the Filecoin network before? If so, please explain and make the case why you would like to store this dataset again to the network. Provide details on preparation and/or SP distribution.

No response

Please share a sample of the data

https://www.gscloud.cn/sources/index?pid=263&ptitle=LANDSAT%E7%B3%BB%E5%88%97%E6%95%B0%E6%8D%AE&rootid=1

Confirm that this is a public dataset that can be retrieved by anyone on the Network

  • I confirm

If you chose not to confirm, what was the reason

No response

What is the expected retrieval frequency for this data

Sporadic

For how long do you plan to keep this dataset stored on Filecoin

1.5 to 2 years

In which geographies do you plan on making storage deals

Greater China, Asia other than Greater China, North America, South America, Europe, Australia (continent)

How will you be distributing your data to storage providers

HTTP or FTP server, Shipping hard drives

How did you find your storage providers

Slack, Partners

If you answered "Others" in the previous question, what is the tool or platform you used

No response

Please list the provider IDs and location of the storage providers you will be working with.

f03074586   
f03074587   
f03000070
f03074583  
f03074589   
f03074592

How do you plan to make deals to your storage providers

Boost client, Lotus client

If you answered "Others/custom tool" in the previous question, enter the details here

No response

Can you confirm that you will follow the Fil+ guideline

Yes

Copy link
Contributor

datacap-bot bot commented Jun 16, 2024

Application is waiting for allocator review

@Marshall-btc
Copy link
Owner

Hey @himomo007 , thanks for applying to Marshall-Fil-Data-Pathway.
In addition to the questions in the issue, I would still like you to confirm the following.
1.Have you prepared enough token for sector pledge?
2.Are you a data preparer? What is your previous experience as a data-preparer? List previous applications and client IDs
3.How will the data be prepared? Please include tooling used and technical details
4.If you are not preparing the data, who will prepare the data? (Name and Business)
5.Has this dataset been stored on Filecoin before? If so, why are you choosing to store it again?
6.Best practice for storing large datasets includes ideally, storing it in 3 or more regions, with 4 or more storage provider operators or owners.You should list Miner ID, Business Entity, Location of sps you will cooperate with.

@Marshall-btc
Copy link
Owner

Marshall-btc commented Jun 17, 2024

Other than that, can you send an email using the official email address to verify authenticity? marshallbtc1990@gmail.com The content should contain the name of your application.

@himomo007
Copy link
Author

  1. yes, most of the SPs are ready to pledge coins.
  2. i am a personal data preparer, i used to participate in slingshot. data preparation is mainly through boost or lotus.
  3. as far as i know, i have contacted SPs and they told me that they have not stored Landsat related datasets and would be happy to do so.
  4. f03074586 HongKong Datastone
    f03074587 Seoul Hanku
    f03000070 China Honglian Tec
    f03074583 Tokyo Fly
    f03074589 HongKong Xing
    f03074592 USA HKblockchain

@himomo007
Copy link
Author

image

The e-mail has been sent, please check, pay attention to the confidentiality of information, thank you!

@Marshall-btc
Copy link
Owner

Marshall-btc commented Jun 17, 2024

  1. I have received a KYC email from this client.
  2. I check his GitHub account. He became active in the previous V4 Fil+ and I would like to support him.
image

@Marshall-btc
Copy link
Owner

Before the first round begins, I still want to remind you @himomo007 :

  1. You and SP are to strictly adhere to the rules of Fil+ and Marshall-Fil-Data-Pathway.
  2. Please confirm SP's geographic location and name before the start of each allocation round. If there is a change, please comment promptly in that application.
  3. Please keep the SP retrievable.

Copy link
Contributor

datacap-bot bot commented Jun 17, 2024

Datacap Request Trigger

Total DataCap requested

10PiB

Expected weekly DataCap usage rate

1000TiB

DataCap Amount - First Tranche

512TiB

Client address

f12zi5r77p3pm3oaztkni564f4irgckgcnwkskgka

Copy link
Contributor

datacap-bot bot commented Jun 17, 2024

DataCap Allocation requested

Multisig Notary address

Client address

f12zi5r77p3pm3oaztkni564f4irgckgcnwkskgka

DataCap allocation requested

512TiB

Id

ebc0b0a0-76c5-4db5-9413-10e6ebd2887a

Copy link
Contributor

datacap-bot bot commented Jun 17, 2024

Application is ready to sign

Copy link
Contributor

datacap-bot bot commented Jun 17, 2024

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacedv5akks5zss2yjuhjlfaykq6kb4kcli3cf6qilfwhvzf5lpoameu

Address

f12zi5r77p3pm3oaztkni564f4irgckgcnwkskgka

Datacap Allocated

512TiB

Signer Address

f16b6a4s63opnunpag3llqg77pfl4pyixwb657iza

Id

ebc0b0a0-76c5-4db5-9413-10e6ebd2887a

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacedv5akks5zss2yjuhjlfaykq6kb4kcli3cf6qilfwhvzf5lpoameu

Copy link
Contributor

datacap-bot bot commented Jun 17, 2024

Application is Granted

@Marshall-btc
Copy link
Owner

Hey @himomo007 , you've been getting data caps for a while now. the SPs haven't started sealing yet, are you having any problems?

@himomo007
Copy link
Author

@Marshall-btc No problems,SPs are in preparation, to be sealed soon.

Copy link
Contributor

datacap-bot bot commented Jul 16, 2024

Client used 75% of the allocated DataCap. Consider allocating next tranche.

@himomo007
Copy link
Author

himomo007 commented Jul 17, 2024

The first round of data storage actual cooperation SPs, f03091739、f03144037、f02199999、f03055005.
We are in communication with f01315096, f01106668, f03055018, f03055029, f0870558, mainly depending on the preparation of SPs fil coins.

@Marshall-btc
Copy link
Owner

checker:manualTrigger

Copy link
Contributor

datacap-bot bot commented Jul 17, 2024

DataCap and CID Checker Report Summary1

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

⚠️ 33.33% of Storage Providers have retrieval success rate equal to zero.

⚠️ The average retrieval success rate is 2.38%

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients2

✔️ No CID sharing has been observed.

Full report

Click here to view the CID Checker report.

Footnotes

  1. To manually trigger this report, add a comment with text checker:manualTrigger

  2. To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

@Marshall-btc
Copy link
Owner

Marshall-btc commented Jul 17, 2024

image

Hey! @himomo007 I see that you've completed the first round of encapsulation and have two questions I'd like you to answer.
1.Why did the SP not appear in your application for this round, could you please explain?
2.Why the retrieval success rate of these SPs is very low?

@Marshall-btc
Copy link
Owner

By the way, from the checking result, there is no CID sharing and the SPs are in different cities and countries.

@himomo007
Copy link
Author

The email has been sent. Please pay attention to the review. Thank you.

image

@Marshall-btc
Copy link
Owner

Hey @himomo007 , I've received your email and I'd like to believe that your SP is in the US. I can support this round, but hopefully you will continue to contact SPs to improve Spark retrieval success.

Copy link
Contributor

datacap-bot bot commented Sep 24, 2024

Application is in Refill

Copy link
Contributor

datacap-bot bot commented Sep 24, 2024

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacebax3mcjudn4tp7ag5jhvpzi2woffhwm3fdr23eljhgqjxj5xbxf4

Address

f12zi5r77p3pm3oaztkni564f4irgckgcnwkskgka

Datacap Allocated

2PiB

Signer Address

f16b6a4s63opnunpag3llqg77pfl4pyixwb657iza

Id

ce77b4c4-2f58-4d3c-ab59-8a2de61e3480

You can check the status of the message here: https://filfox.info/en/message/bafy2bzacebax3mcjudn4tp7ag5jhvpzi2woffhwm3fdr23eljhgqjxj5xbxf4

@datacap-bot datacap-bot bot added granted and removed Refill labels Sep 24, 2024
Copy link
Contributor

datacap-bot bot commented Sep 24, 2024

Application is Granted

Copy link
Contributor

datacap-bot bot commented Nov 1, 2024

Client used 75% of the allocated DataCap. Consider allocating next tranche.

@filecoin-watchdog
Copy link

checker:manualTrigger

Copy link
Contributor

datacap-bot bot commented Nov 19, 2024

DataCap and CID Checker Report Summary1

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

⚠️ 15.00% of Storage Providers have retrieval success rate equal to zero.

⚠️ 80.00% of Storage Providers have retrieval success rate less than 75%.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients2

✔️ No CID sharing has been observed.

Full report

Click here to view the CID Checker report.

Footnotes

  1. To manually trigger this report, add a comment with text checker:manualTrigger

  2. To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

@Marshall-btc
Copy link
Owner

checker:manualTrigger

Copy link
Contributor

datacap-bot bot commented Dec 23, 2024

DataCap and CID Checker Report Summary1

Storage Provider Distribution

✔️ Storage provider distribution looks healthy.

⚠️ 5.00% of Storage Providers have retrieval success rate equal to zero.

⚠️ 60.00% of Storage Providers have retrieval success rate less than 75%.

Deal Data Replication

✔️ Data replication looks healthy.

Deal Data Shared with other Clients2

✔️ No CID sharing has been observed.

Full report

Click here to view the CID Checker report.

Footnotes

  1. To manually trigger this report, add a comment with text checker:manualTrigger

  2. To manually trigger this report with deals from other related addresses, add a comment with text checker:manualTrigger <other_address_1> <other_address_2> ...

@Marshall-btc
Copy link
Owner

I checked the sprak retrieval success rate, @himomo007 can you contact this sp and explain why the spark retrieval success rate is 0?
image

@himomo007
Copy link
Author

We apologize for the delayed response. The f02199999 failed to achieve Spark connectivity due to the limited capabilities of their technical team. As a result, we only issued a small number of orders to them and ceased further cooperation long ago. We are committed to working exclusively with SPs who maintain high Spark retrieval rates or who are continuously striving to improve their Spark performance. Thank you for your continued support.

@Marshall-btc
Copy link
Owner

I can continue to support 2 PiB based on the fact that the overall Spark retrieval rate situation is good.

Copy link
Contributor

datacap-bot bot commented Dec 25, 2024

Application is in Refill

Copy link
Contributor

datacap-bot bot commented Dec 25, 2024

Request Approved

Your Datacap Allocation Request has been approved by the Notary

Message sent to Filecoin Network

bafy2bzacea4oxrzquohi5xsccujzm2ttuakhw3r4ghvfemuvdgqi5kygkfr22

Address

f12zi5r77p3pm3oaztkni564f4irgckgcnwkskgka

Datacap Allocated

2PiB

Signer Address

f16b6a4s63opnunpag3llqg77pfl4pyixwb657iza

Id

05d8eb8b-bef7-4ace-8fd6-d5cb0bc9dfce

You can check the status here https://filfox.info/en/message/bafy2bzacea4oxrzquohi5xsccujzm2ttuakhw3r4ghvfemuvdgqi5kygkfr22

Copy link
Contributor

datacap-bot bot commented Dec 25, 2024

Application is Granted

@datacap-bot datacap-bot bot added granted and removed Refill labels Dec 25, 2024
@himomo007
Copy link
Author

Updation new SPs:f03300963.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

3 participants