spatial join math error

397
1
07-16-2011 06:20 AM
JohnWarden
New Contributor III
I am performing a spatial join in which I sum the values for one polygon layer and assign that data to another polygon layer it intersects. For summed values of 7 or more digits, the calculated value is missing the first digit. For example, the join summation shows an answer such as 756,324, when the actual correct answer is 7,563,241. Any answer with 6 digits or less is correct.

Any thoughts as to the cause, or a solution?
0 Kudos
1 Reply
DanEvans
Occasional Contributor II
Are you using shapefiles? If so, you have to define the Precision and Scale for the fields in question in the shapefile properties. Precision is the total number of significant digits, and scale is the number of decimal places. If the field is an integer then obviously there is only the precision to set. Try setting the precision of your fields to 7 or more.

Hope that helps...

Dan

I am performing a spatial join in which I sum the values for one polygon layer and assign that data to another polygon layer it intersects. For summed values of 7 or more digits, the calculated value is missing the first digit. For example, the join summation shows an answer such as 756,324, when the actual correct answer is 7,563,241. Any answer with 6 digits or less is correct.

Any thoughts as to the cause, or a solution?
0 Kudos