Setting up spatiotemporal data store in Amazon EC2

1899
9
07-29-2017 12:26 PM
JesseAdams
New Contributor III

I'm running into an issue with trying to setup the spatiotemporal arcgis data store on an Amazon EC2 instance.  Currently I have two servers setup; one with a base deployment of ArcGIS Enterprise (with ArcGIS Server federated with Portal), and a second with ArcGIS Server licensed as a Geoanalytics Server.  Federating the Geoanalytics server with the Portal instance worked just fine.  I'm trying to setup a third instance for storing the spatiotemporal data store.  I have the data store successfully registered with the hosting server, however, the hosting server is not able to communicate with the data store server. It looks like when data store is registered with server it uses the machine name of the data store:

This won't work since the hosting server can't find the data store by machine name.  I've tried changing the machine name to the public amazon DNS and the private DNS.  Neither of those work.  Validating the connection after updating to either of the DNS names throws a token error:

Is there a setting on the data store machine that I need to update so server can use the DNS name instead of the machine name?  Any suggestions would be great.

Thank you,

9 Replies
SagarAyare
New Contributor III

Hi Jesse,

By default, after installation, ArcGIS Server will point to a spatiotemporal big data store using the internal hostname (e.g. WIN- KI1388PECAS4) on the Big Data Server.

For ArcGIS Enterprise deployments on Amazon and Azure instances, the hostname must be changed to the internal IP address of the Big Data Server via the ArcGIS Server Administrative Directory on the GIS Server at https://<GIS Server.domain>.com:6443/server/admin.

If there is an issue with the internal IP, then you can try the public IP of the BDS machine.

Updating hostname to internal IP of data store machine in the BDS JSON

If the above steps do not fix your issue, then you should check the hostidentifier.properties file under the installation directory of data store which is  \Program Files\ArcGIS\DataStore\framework\etc\ 

If the last line in this file (preferredidentifier=ip) is commented, please uncomment it (by deleting the # and saving it).

uncommenting preferredidentifier=ip line in hostidentifier.properties for BDS on cloud

This will ensure that the hosting server will look for BDS machine's IP address instead of the hostname.

Hope this helps !

Thanks,

Sagar Ayare | Product Engineer

Real-time & Big Data GIS

ESRI Redlands, CA

JesseAdams
New Contributor III

Hi Sagar,

Thank you for the additional suggestion.  Unfortunately that didn't seem to resolve my issue.  I updated the hostidentifier.properties file to use preferredidentifier of "ip".  After the update I restarted ArcGIS Data Store on the BDS machine.  I still receive the following message:

I also tested the ports using telnet and the BDS server has access to 6443 on the hosting server and the hosting server has access to 2443, 9220, 9320 coming from the BDS server.

Another thing I tried was to verify the datastore from the BDS machine using the "describedatastore" command:

Are there other ports that need to be accessible to BDS other then 6443?

Let me know if you have other suggestions.

Thank youk,

0 Kudos
SagarAyare
New Contributor III

Hi Jesse,

Looking at your second screenshot, it appears that the system still looks for hostname from the data store machine.

However, from the hosting server (first screenshot) it appears that you've updated to IP address instead of the hostname.

Is it possible, for you to restart the hosting ArcGIS Server service after this change. (if you haven't already restarted)

Also, instead of the public IP of the BDS machine, can you try the internal IP in the JSON and then restart the hosting ArcGIS server service.

Thanks,

Sagar Ayare | Product Engineer

Real-time & Big Data GIS

ESRI Redlands, CA

0 Kudos
JesseAdams
New Contributor III

Hi Sagar,

I tried restarting the hosting ArcGIS Server service after making the ip address update through the admin API on the hosting ArcGIS Server machine.  Unfortunately that doesn't seem to make much difference.  The validate function still returns "invalid token." I tried re registering the data store with the hosting server using the internal IP but unfortunately the result is the same with the checking the validation.  Is there a recommended setting in the windows host file for the ArcGIS Data Store machine?  I've tried machine name, IP, and machine name with fake domain name.

Thanks for the help.   

0 Kudos
SagarAyare
New Contributor III

Hi Jesse,

Can you also please check hostidentifier.properties file under the content directory of data store which is  \arcgisdatastore\etc\ 

If the last line in this file (preferredidentifier=ip) is commented, please uncomment it (by deleting the # and saving it).

The changes that by you had done to the hostidentifier.properties under program files should be reflected here.

If not, then you need to follow the above steps and then restart the data store on BDS machine.

Try validating data store after this change.

If that doesn't work, can you please try running the registerdatastore.bat utility

ArcGIS Data Store command utility reference—Installation Guides | ArcGIS Enterprise 

Can you please share the data store logs under \arcgisdatastore\logs to geoevent@esri.com

Thanks,

Sagar Ayare | Product Engineer

Real-time & Big Data GIS

ESRI Redlands, CA

0 Kudos
JesseAdams
New Contributor III

Sagar,

After the re-install I the updated the hostidentifier.properties file and commented out the "preferredidentifier=ip" line.  Restarted data store and also restarted AGS server on the hosting machine for good measure.  After verification the same token invalid error persists.  I've also tried the "registerdatastore" command the BDS machine referencing the hosting machine internal IP.  Unfortunately still the same error "invalid token."

I will send over log files.

Thanks again for the help.

0 Kudos
SagarAyare
New Contributor III

Hi Jesse,

A user may come across this error if the SSL certificates are not configured properly on hosting server and portal.

The detailed info for importing certs is described in GeoEvent Server - Spatiotemporal Big Data Store – Tutorial.

(Page 5-14 )

https://www.arcgis.com/home/item.html?id=870b1bf0ad17472497b84b528cb9af00

You can also go through this comment from Jon Satchwell

https://community.esri.com/thread/175921#comment-605455 

Hope this helps !

Thanks,

Sagar Ayare | Product Engineer

Real-time & Big Data GIS

ESRI Redlands, CA

0 Kudos
JesseAdams
New Contributor III

Hopefully this time the message will post as the correct user.....

Hi Sagar,

 

Sorry for the delayed response.  I've tried the complete uninstall and reinstall of BDS without any success.  I still receive the same error "Invalid Token."  I'm also able to access the BDS from the hosting server through the url "http://interalIP:9220".  Here is the result (doesn't prompt for username and password):

 

 

Looking through the tutorial it appears that the hosting server needs to have a non self signed certificate registered to the URL used when registering the BDS with the hosting server.  Does that sound correct?  Definitely open to other suggestions.

 

Thank you,

0 Kudos
SagarAyare
New Contributor III

Hi Jesse,

 

Thank you for sharing the screenshot.

I think you have tried most of the steps that I have suggested. 

The system works with self signed certificates as well. However, for production it is recommended to have CA issued certificate.

Can you please send an email to geoevent@esri.com and we can try possibly a quick remote session for this issue.

 

Thanks,

Sagar Ayare | Product Engineer

Real-time & Big Data GIS

ESRI Redlands, CA

0 Kudos