POST
|
I have added the output Python script, hope that helps.
... View more
04-10-2018
03:22 PM
|
0
|
1
|
1732
|
POST
|
I should say, for the input data, each timeframe output for each RCP is stored in a NetCDF file - but that's overall. Each model deals with a single NetCDF input file; the SBD tool runs on it to select the appropriate raster data, and copy it out to individual raster files. Perhaps it's easiest to show in the non-interated form: Each of the individual rows runs on each dimensional value, then merges the layers to create the ensemble, clips and projects out as appropriate. This is a separate model, but identical template (the broken nature of the far right is unrelated to this issue, that's just a question of file paths changing between computers and isn't related to the OP in this case). It's the left portion that we are obviously trying to iterate. The "For" operator seemed the appropriate one from the material that I read regarding it, since what is being selected are individual dimensions within a multidimensional dataset, but if a different iterator is more appropriate, I'm open to considering that as well.
... View more
04-09-2018
07:18 PM
|
0
|
0
|
1732
|
POST
|
Climate model outputs, each value is an individual model output. In this case, each is an individual model projection for average temperature projections for RCP 2.6 from 2017-2025. The model as a whole merges them to form an ensemble model output for a given time period. We have similar models for temperature extremes (max/min) and precipitation; they all follow the same general outline, but the number of models that are involved in calculating the composite changes depending on the RCP and time period (2025, 2050, 2080, or 2099); not all models have outputs for each.
... View more
04-09-2018
06:12 PM
|
0
|
4
|
1732
|
POST
|
In order to expedite the models that I've been working with, I've been attempting to use an iterator in ModelBuilder so fewer file name changes in the model process (the main time consumer) are necessary. However, whenever the model process reaches the iterator itself, the program crashes. I've tried using systems with more processing power, but that doesn't fix the issue. Anyone have any idea what the issue might be? I can't find much out there on this topic, so I'm not sure what the problem itself might be. Would prefer a solution that involves adjusting the model itself rather than a Python-based solution, since most of our processes are run through ModelBuilder. I've attached a screenshot of the model. I'm using ArcGIS 10.4. EDIT: I have attached the Python code output to help in diagnosing the issue.
... View more
04-09-2018
05:35 PM
|
0
|
6
|
2728
|
POST
|
I'm trying to handle NetCDF files, extracting the individual bands into individual rasters and then combining them into ensemble rasters for given time periods (since each band represents an individual model, and GCM models are more accurate when combined with one another). Anyone have any thoughts on the appropriate tool and workflow to carry out this procedure, particularly in ModelBuilder? I tried using the Make New Raster to extract each band and then combining them using the Mosaic to New Raster, but in ModelBuilder I get an error that the number of bands must match (which I don't understand, since I set it to one band per temp raster and one band output from the Mosaic to New Raster tool as well, and when I ran a test manually extracting the first three bands and then attempting to merge them using the aforementioned process, it seemed to work. Doing that with around 8 different time periods with 53 models per period is a bit time consuming, however, so using MB to automate that would be more efficient). I'm using ArcGIS 10.4. modelbuilder arcgis pro model builder; netcdf data and model builder netcdf netcdf file raster analytics merge raster multiband raster multiband
... View more
07-03-2017
11:24 AM
|
0
|
0
|
840
|
POST
|
The output from the ModelBuilder process is as follows: Executing (Make NetCDF Raster Layer (25)): MakeNetCDFRasterLayer "D:\Todd Research\GIS Datasets\Climate_Projections\CMIP_5_Data2\Monthly\RCP_4.5\Precipitation\BCSD_0.125deg_pr_Amon_bcc-csm1-1_rcp45_r1i1p1_200601-209912.nc" pr longitude latitude Precip_bcc-csm1-1_RCP45_Dec2025 # "time '12/16/2025 12:00:00 PM'" BY_VALUE Start Time: Wed Jun 21 14:52:43 2017 Succeeded at Wed Jun 21 14:52:43 2017 (Elapsed Time: 0.12 seconds) Executing (Project): Project "D:\Todd Research\Processing\Chesapeake_Bay.gdb\Somerset_County_MD_2016" "D:\Todd Research\Processing\Chesapeake_Bay.gdb\Somerset_County_MD_2016_WGS84" PROJCS['WGS_1984_World_Mercator',GEOGCS['GCS_WGS_1984',DATUM['D_WGS_1984',SPHEROID['WGS_1984',6378137.0,298.257223563]],PRIMEM['Greenwich',0.0],UNIT['Degree',0.0174532925199433]],PROJECTION['Mercator'],PARAMETER['False_Easting',0.0],PARAMETER['False_Northing',0.0],PARAMETER['Central_Meridian',0.0],PARAMETER['Standard_Parallel_1',0.0],UNIT['Meter',1.0]] WGS_1984_(ITRF00)_To_NAD_1983 GEOGCS['GCS_North_American_1983',DATUM['D_North_American_1983',SPHEROID['GRS_1980',6378137.0,298.257222101]],PRIMEM['Greenwich',0.0],UNIT['Degree',0.0174532925199433]] NO_PRESERVE_SHAPE # NO_VERTICAL Start Time: Wed Jun 21 14:52:43 2017 Succeeded at Wed Jun 21 14:52:44 2017 (Elapsed Time: 1.66 seconds) Executing (Clip (159)): Clip Precip_bcc-csm1-1_RCP45_Dec2025 "283.763542 37.886605 284.460367 38.298944" "D:\Todd Research\Processing\Tangier_Smith_Islands.gdb\Precip_bcc-csm1-1_RCP45_Dec2025_Somerset_MD_WGS84" "D:\Todd Research\Processing\Chesapeake_Bay.gdb\Somerset_County_MD_2016_WGS84" 1.000000e+020 NONE NO_MAINTAIN_EXTENT Start Time: Wed Jun 21 14:52:45 2017 ERROR 999999: Error executing function. The table name is invalid. No spatial reference exists. FDO error: -2147220948 The table was not found. [Precip_bcc-csm1-1_RCP45_Dec2025_Somerset_MD_WGS84] Failed to execute (Clip (159)). Failed at Wed Jun 21 14:52:45 2017 (Elapsed Time: 0.14 seconds)
... View more
06-21-2017
11:54 AM
|
0
|
1
|
650
|
POST
|
I was trying to combine a number of flood hazard (FIRM) layers of different jurisdictions in multiple states together and then limit it to a watershed within the designated area. I built a model to this effect, combining each layer together with Merge and then running a clip to the watershed of interest. However, when I run the model, I get the following error on the Clip portion (I won't include the merge portion of the model code, as it is extremely lengthy from the number of files involved across about 5 states): Executing (Clip): Clip "D:\Todd Research\Processing\Chesapeake_Bay.gdb\Chesapeake_States_Watershed_Flood_Hazard_Areas2NL" "D:\Todd Research\Processing\Chesapeake_Bay.gdb\Chesapeake_Bay_Watershed" "D:\Todd Research\Processing\Chesapeake_Bay.gdb\Chesapeake_Watershed_Flood_Hazard_Areas2NL" # Start Time: Mon Jun 19 21:54:30 2017 Reading Features... Processing Tiles... ERROR 999999: Error executing function. The table was not found. The table was not found. [Chesapeake_Watershed_Flood_Hazard_Areas2NL] The table was not found. The table was not found. [Chesapeake_Watershed_Flood_Hazard_Areas2NL] General function failure General function failure Failed to execute (Clip). Failed at Tue Jun 20 00:35:54 2017 (Elapsed Time: 2 hours 41 minutes 23 seconds) Does anyone know what the problem might be here? I know the error number is just a general error that could be caused by a number of things. I'm a bit concerned that the problem might be caused by an issue with the table generated by the Merge preceding the Clip, even though the model outputs say that executed successfully. I tried running it twice, once with a preliminary firm from an additional jurisdiction and once without, and got the same error both times. I did make sure to modify the preliminary FIRM attribute table to match the final FIRM attribute tables in format as well, for the time that I included it.
... View more
06-21-2017
11:27 AM
|
0
|
4
|
1057
|
POST
|
I'll look into doing the code export as soon as I get my external drive with my data on it hooked up again, probably within an hour or so. The FTP link to the download for the data I am currently using is ftp://gdo-dcp.ucllnl.org/pub/dcp/archive/cmip5/bcsd/BCSD/bcc-csm1-1/rcp26/mon/r1i1p1/pr/.
... View more
06-12-2017
12:46 PM
|
0
|
0
|
650
|
POST
|
I'll try and post a screenshot of the model as well, presuming that's what you mean by "job stream," as I'm not entirely sure if that's the case, keeping in mind that I have tried several different orders of the tools as well as several different tools, in some cases, and continued to get the same result (aside from the situation described below, which removed this problem but seems to have created another in the process).
... View more
06-10-2017
10:16 AM
|
0
|
4
|
650
|
POST
|
That error appeared both when I ran the Copy Raster tool directly on the output of Make NetCDF Raster and also when I attempted to run a Clip after attempting to project it into NAD 83/MD State Plane. I've wondered about the table name & table not found portions of the error myself; there's no obvious cause for it, with no attribute table involved. I've also wondered about the table not found error.
... View more
06-09-2017
11:42 AM
|
0
|
0
|
650
|
POST
|
I tried running Project Raster on the output of the Make NetCDF Raster Tool, projecting it into the already-applied coordinate system, and then running the time series extract script from there. That seems to resolve the spatial error, as I did not get that. However, it also seems to remove the multidimensional component of the NetCDF raster in the process of running the project at that point, so only one raster is generated by the script, as opposed to one per NetCDF time series entry. So that appears to solve one problem and create another.
... View more
06-09-2017
11:27 AM
|
0
|
0
|
650
|
POST
|
I ran Copy Raster on the output of the Make NetCDF Raster tool, but the same error appeared - no spatial reference exists, the table was not found.
... View more
06-09-2017
10:52 AM
|
0
|
7
|
1457
|
POST
|
I'll check that. Unfortunately the NetCDF file I'm using is too large to attach by itself.
... View more
06-09-2017
10:34 AM
|
0
|
0
|
1457
|
POST
|
Yes; the tool itself doesn't seem to throw the error. It's any processes run on the output generated by the tool that generate the error. I will confess that I'm not entirely sure how to attach the code itself. I can attach one of the files I am using relatively easily shortly. Sent from my iPhone
... View more
06-09-2017
09:38 AM
|
0
|
11
|
1457
|
POST
|
Update: I also tried using the NetCDF Time Series Extract script as detailed at How To: Export each time slice from a NetCDF layer as a single raster (*.tif), but I still got a spatial reference error. I checked the properties for the multidimensional raster generated by the Make NetCDF Raster tool as the preliminary step to using the script, and WGS 84 is set as the datum in the properties, so I'm still unsure where the error is coming from. Could it have something to do with trying to run a transformation to NAD 83 as part of the script environment? The precise error returned from the script was the following. I believe the latter portion is the same as the error message received from ModelBuilder when I attempted the procedure described previously: ExecuteError: ERROR 999999: Error executing function. The table name is invalid. No spatial reference exists. The table was not found. [NetCDF_Raster.tif] Failed to execute (CopyRaster).
... View more
06-08-2017
03:58 PM
|
0
|
13
|
1457
|
Online Status |
Offline
|
Date Last Visited |
11-11-2020
02:24 AM
|