1 Reply Latest reply on Jul 18, 2011 2:51 AM by DanEvans83

    spatial join math error

    johnwarden
      I am performing a spatial join in which I sum the values for one polygon layer and assign that data to another polygon layer it intersects. For summed values of 7 or more digits, the calculated value is missing the first digit. For example, the join summation shows an answer such as 756,324, when the actual correct answer is 7,563,241. Any answer with 6 digits or less is correct.

      Any thoughts as to the cause, or a solution?
        • Re: spatial join math error
          DanEvans83
          Are you using shapefiles? If so, you have to define the Precision and Scale for the fields in question in the shapefile properties. Precision is the total number of significant digits, and scale is the number of decimal places. If the field is an integer then obviously there is only the precision to set. Try setting the precision of your fields to 7 or more.

          Hope that helps...

          Dan

          I am performing a spatial join in which I sum the values for one polygon layer and assign that data to another polygon layer it intersects. For summed values of 7 or more digits, the calculated value is missing the first digit. For example, the join summation shows an answer such as 756,324, when the actual correct answer is 7,563,241. Any answer with 6 digits or less is correct.

          Any thoughts as to the cause, or a solution?