Primary competition visual

Telangana Crop Health Challenge

Helping India
€6 900 EUR
Completed (over 1 year ago)
Classification
1090 joined
283 active
Starti
08 Nov 24
Closei
09 Feb 25
Reveali
10 Feb 25
User avatar
MuhammadQasimShabbeer
Engmatix
EarthEngineDataTrainingStaterNotebook
Notebooks · 14 Jan 2025, 10:43 · 27

https://www.kaggle.com/code/muhammadqasimshabbir/teleghanhealthearthenginedatatraining

Please If you find it helpful upvote it so that other may find it easily.

Discussion 27 answers
User avatar

what is the score on the leaderboard?

Upvotes 0
User avatar
MuhammadQasimShabbeer

Probably i think about 72 score on leader board

Upvotes 1
User avatar

please i need urgent assistance to this

Troubleshooting info: Principal: bellokabir001@gmail.com Resource: ee-ak2024 Troubleshooting URL: console.cloud.google.com/iam-admin/troubleshooter;permissions=resourcemanager.projects.get,resourcemanager.projects.getIamPolicy;principal=bellokabir001@gmail.com;resources=%2F%2Fcloudresourcemanager.googleapis.com%2Fprojects%2Fee-ak2024,%2F%2Fcloudresourcemanager.googleapis.com%2Fprojects%2Fee-ak2024/result Missing permissions: resourcemanager.projects.get resourcemanager.projects.getIamPolicy

Upvotes 0
User avatar

How did you get ur project id

Upvotes 0
User avatar
MuhammadQasimShabbeer

make account in earth engine log in i mean then https://developers.google.com/earth-engine/guides/access flow this create project https://console.cloud.google.com/cloud-resource-manager?inv=1&invt=Abm1Jw My project id is present on this link your is also present on this link Also use your gmail not this bellokabir001@gmail.com when authencation you will see your project Id as well use this in initilzation

Upvotes 1
User avatar

please sir i did not get explanation very well

Upvotes 1
User avatar
MuhammadQasimShabbeer

First step make a account of google earth enginee

When you run a code and During authenication go to link.

During these step you will see your project id use this project id to initilzation and then run code after it you can see https://console.cloud.google.com/cloud-resource-manager?inv=1&invt=Abm6yQ on this link as well your earth enginee project id

Upvotes 1
User avatar
Upvotes 1
User avatar
MuhammadQasimShabbeer

okay that s good for you

Upvotes 1
User avatar

Please sir what is the essence of the google earth engine

Upvotes 0
User avatar
MuhammadQasimShabbeer

The Essence of Google Earth Engine (GEE):

Google Earth Engine (GEE) is a cloud-based platform for processing and analyzing large-scale geospatial data. It provides access to global datasets like satellite imagery (e.g., Landsat, Sentinel) and climate data, enabling real-time environmental monitoring and analysis. Also in the notebook we download this data and use this data to train model as in given Stater notebook. you can say that i have edited the stater notebook which in this competetion is provided already. it uses Sentinel data to improve accuracy and robustness of model. I have use one model you can try different model with parametere and different technique. In the notebook first we download data and get features from this and trian and make submission.

Upvotes 1
User avatar

Ok sir but am still facing challenge on running the starter notebook

FileNotFoundError: [Errno 2] No such file or directory: '/content/drive/MyDrive/EarthEngineImages/data.csv'

Upvotes 0
User avatar
MuhammadQasimShabbeer

Here’s the corrected version of your statement:

There is no data.csv file initially available. You need to first run the code provided in this notebook: Teleghan Health Earth Engine Data Training to download the required data.

Once the data is downloaded, you can load it using:

pythonCopy codedata = pd.read_csv(data_path)

You can then save the file as data.csv for future use.

Additionally, I have also saved the downloaded images . If you prefer, you can directly access the dataset I’ve already prepared here: Sentinel Time Series Data.

Feel free to upvote datasets if you find it helpful! 😊

Upvotes 0
User avatar
MuhammadQasimShabbeer

you can use my data.csv and other sentienal files i have donwloaded already

Upvotes 1
User avatar
Upvotes 0
User avatar

Sorry to ask, What makes the stater notebook code different from that of Kaggle

Upvotes 0
User avatar
MuhammadQasimShabbeer

There is not much different between them aside that i have separate the part the of authentication , initialzation and Data loading etc rest of the code of is similarr to provided notebook . But you can still add it optuna study, try different model and hypertuning technique to improve your accurcracy.

Upvotes 1
User avatar
Am still having this problem after I download the zip folder contaning data.csv and downloads. ---------------------------------------------------------------------------
TypeError                                 Traceback (most recent call last)
Cell In[23], line 3
      1 # Select a random image file from the dataset and visualize it
      2 path = random.choice(data['tif_path'].values)
----> 3 image = visualize_rgb_image(path)

Cell In[22], line 26, in visualize_rgb_image(file_path, gamma, contrast_stretch)
     17 """
     18 Visualize an RGB image using matplotlib with scaling, optional gamma correction, and contrast stretching.
     19 
   (...)
     23 - contrast_stretch: bool, whether to apply contrast stretching (default=True)
     24 """
     25 # Open the image file
---> 26 with rasterio.open(file_path) as src:
     27     # Read RGB bands (assuming Sentinel-2 band order: Red=B4, Green=B3, Blue=B2)
     28     red = src.read(3)  # Band 4 for Red
     29     green = src.read(2)  # Band 3 for Green

File ~\AppData\Local\Programs\Python\Python310\lib\site-packages\rasterio\env.py:463, in ensure_env_with_credentials.<locals>.wrapper(*args, **kwds)
    460     session = DummySession()
    462 with env_ctor(session=session):
--> 463     return f(*args, **kwds)

File ~\AppData\Local\Programs\Python\Python310\lib\site-packages\rasterio\__init__.py:258, in open(fp, mode, driver, width, height, count, crs, transform, dtype, nodata, sharing, opener, **kwargs)
    251 if not isinstance(fp, str):
    252     if not (
    253         hasattr(fp, "open")
    254         or hasattr(fp, "read")
    255         or hasattr(fp, "write")
    256         or isinstance(fp, (os.PathLike, MemoryFile, FilePath))
    257     ) or isinstance(fp, DatasetBase):
--> 258         raise TypeError(f"invalid path or file: {fp!r}")
    259 if not isinstance(mode, str):
    260     raise TypeError(f"invalid mode: {mode!r}")

TypeError: invalid path or file: nan
Upvotes 0
User avatar
MuhammadQasimShabbeer

correct your psth from data.csv and when pass to read file please IT is pathfile problem

Upvotes 0
User avatar
51pegasi

Were you able to download images at different times for the same field? Or simply the the latest?

Upvotes 0
User avatar

Hey i am unable to download the dataset where i can find the images ?

Upvotes 0
User avatar
MuhammadQasimShabbeer

Here is link for it https://www.kaggle.com/muhammadqasimshabbir/datasets SentinelTimeSeriesData are the dataset in profile are these one is formatted in csv file while other is simply json like format file which is get through postman response If you find my dataset helpful please upvote them

Upvotes 0
User avatar
MuhammadQasimShabbeer
Upvotes 0
User avatar

the image dataset i accessed through your kaggle: https://www.kaggle.com/datasets/muhammadqasimshabbir/sentineltimeseriesdata

all the images are just black block, I tried multiple online .tif image viewer but showing the same black block for all image. Can you please help

a google drive link or something would be so helpful

Upvotes 0
User avatar
MuhammadQasimShabbeer

https://www.kaggle.com/code/muhammadqasimshabbir/teleghanhealthearthenginedatatraining Run this notebook it will download from earthenginee directly

Upvotes 0
User avatar

@ MuhammadQasimShabbeer

I am working Telangana Crop Health Challenge

I have extracted the data of sentinel satellite images into csv my doubt is that how i can concat the this sentinel data and train.csv data as we sentinel is not having the target variable but train.csv is having the target variable and i have observed that in the train.csv the records and the sentinel data csv the data points I mean the farm id are common how i can use this sentinel data

Upvotes 0
User avatar
MuhammadQasimShabbeer
https://www.kaggle.com/code/muhammadqasimshabbir/teleghanhealthearthenginedatatraining Run this notebook it will download from earthenginee directly, Here we contcate the data of train and test we have target in data.  data = pd.concat(
    [train.assign(dataset='train'), test.assign(dataset='test')]
).reset_index(drop=True)
Upvotes 0