Community

Geoportal: UNC path settings ?

614
6
08-26-2022 12:38 PM
YinShi
by
New Contributor III
‎08-26-2022 12:38 PM

I am testing importing metadata from UNC location. I tried both UNC path name and mapped drive name. Neither worked. I got the 'error reading data' data. 

I then copied the content of the UNC folder to C drive and import the metadata from C. There was no issues. So I know the metadata files are ok. 

Is there any reason why importing from UNC locations would not work? 

Thanks so much in advance.

YinShi_0-1661542327202.png

YinShi_1-1661542523994.png

YinShi_2-1661542601131.png

 

 

 

 

0 Kudos
6 Replies
Marten
by
Occasional Contributor
‎09-07-2022 11:59 AM

we resolved this on the other thread, right? there were no metadata xml files in the folder (see image 2)

0 Kudos
YinShi
by
New Contributor III
‎09-08-2022 06:19 AM

Sorry I pasted the wrong screenshot. Those xmls were tested using UNC local drive, i.e. C:\temp and they imported in Geoportal successfully . However, when I placed them on a network folder and referenced using the UNC path (i.e.\\xxxx\xxx\xx), nothing was imported. The network folder was readable by everyone. I also tested using the mapped drive, again nothing was imported. 

I didn't set filter in the UNC broker, so everything in the UNC folder should be imported. I checked harvester log and geoportal log ,there was no corresponding entries there.  The only error message was from harvester itself.

 

Any suggestions for troubleshooting? 

 

YinShi_1-1662643132749.png

 

 

YinShi_0-1662642770920.png

 

0 Kudos
Marten
by
Occasional Contributor
‎09-08-2022 07:16 AM
Did your UNC folder include .xml files? The harvester will not actually harvest all files (like the .lyr files in the screenshot). It only gets .xml and some office documents (like pdf, word, etc)
0 Kudos
YinShi
by
New Contributor III
‎09-08-2022 11:32 AM

Yes, the UNC folder has .xml files, they are just .lyr.xml. Just for testing I renamed all .lyr.xml to .xml and ran the task again in harvester, nothing was imported. When I placed those .xml in a local folder on C drive, I was able to import those xml files. This is really odd. Are there any other logs I could look into other than geoportal and hrv logs?

YinShi_0-1662661828453.png

 

 

0 Kudos
Marten
by
Occasional Contributor
‎09-08-2022 11:44 AM
That is strange indeed. Temporarily (as it has the potential of creating a lot of messages), can you set logging to FINEST or ALL and then repeat the process, then collect the harvester log?
See harvester/WEB-INF/classes/logging.properties
M
0 Kudos
YinShi
by
New Contributor III
‎09-08-2022 12:26 PM

I turned on FINEST but there was nothing coming from harvester when I ran the task. I have set up everything as http(Geoportal, Harvester and Elastic Search), not https. I wonder if that would make a difference. No worries if you are running out of ideas to try. We can solve this issue later. We will get in touch with you and with our ESRI rep soon. 

 

08-Sep-2022 15:15:14.626 FINER [Catalina-utility-1] org.apache.jasper.compiler.JspRuntimeContext.checkUnload Checking JSPs for unload in context [/harvester], JSP count: [0] queue length: [-1]
08-Sep-2022 15:15:24.669 FINER [Catalina-utility-1] org.apache.jasper.compiler.JspRuntimeContext.checkUnload Checking JSPs for unload in context [/harvester], JSP count: [0] queue length: [-1]
08-Sep-2022 15:15:34.714 FINER [Catalina-utility-2] org.apache.jasper.compiler.JspRuntimeContext.checkUnload Checking JSPs for unload in context [/harvester], JSP count: [0] queue length: [-1]
08-Sep-2022 15:15:44.766 FINE [Catalina-utility-1] org.apache.catalina.session.ManagerBase.processExpires Start expire sessions StandardManager at 1662664544766 sessioncount 0
08-Sep-2022 15:15:44.767 FINE [Catalina-utility-1] org.apache.catalina.session.ManagerBase.processExpires End expire sessions StandardManager processingTime 1 expired sessions: 0
08-Sep-2022 15:15:44.767 FINER [Catalina-utility-1] org.apache.jasper.compiler.JspRuntimeContext.checkUnload Checking JSPs for unload in context [/harvester], JSP count: [0] queue length: [-1]
08-Sep-2022 15:15:54.806 FINER [Catalina-utility-1] org.apache.jasper.compiler.JspRuntimeContext.checkUnload Checking JSPs for unload in context [/harvester], JSP count: [0] queue length: [-1]
08-Sep-2022 15:16:02.292 FINE [http-nio-9000-exec-2] org.apache.catalina.authenticator.AuthenticatorBase.invoke Security checking request GET /harvester/rest/harvester/brokers
08-Sep-2022 15:16:02.308 FINE [http-nio-9000-exec-2] org.apache.catalina.authenticator.AuthenticatorBase.invoke Not subject to any constraint
08-Sep-2022 15:16:02.308 FINER [http-nio-9000-exec-2] org.apache.catalina.core.StandardWrapper.allocate   Returning non-STM instance
08-Sep-2022 15:16:02.313 FINE [http-nio-9000-exec-5] org.apache.catalina.authenticator.AuthenticatorBase.invoke Security checking request GET /harvester/rest/harvester/brokers
08-Sep-2022 15:16:02.313 FINE [http-nio-9000-exec-5] org.apache.catalina.authenticator.AuthenticatorBase.invoke Not subject to any constraint
08-Sep-2022 15:16:02.314 FINER [http-nio-9000-exec-5] org.apache.catalina.core.StandardWrapper.allocate   Returning non-STM instance
08-Sep-2022 15:16:04.868 FINER [Catalina-utility-2] org.apache.jasper.compiler.JspRuntimeContext.checkUnload Checking JSPs for unload in context [/harvester], JSP count: [0] queue length: [-1]
08-Sep-2022 15:16:08.119 FINE [http-nio-9000-exec-9] org.apache.catalina.authenticator.AuthenticatorBase.invoke Security checking request POST /harvester/rest/harvester/tasks/5cfb8ee8-c0c0-491c-ab87-7f9e2ce4568b/execute
08-Sep-2022 15:16:08.134 FINE [http-nio-9000-exec-9] org.apache.catalina.authenticator.AuthenticatorBase.invoke Not subject to any constraint
08-Sep-2022 15:16:08.134 FINER [http-nio-9000-exec-9] org.apache.catalina.core.StandardWrapper.allocate   Returning non-STM instance
08-Sep-2022 15:16:08.557 FINE [http-nio-9000-exec-3] org.apache.catalina.authenticator.AuthenticatorBase.invoke Security checking request GET /harvester/rest/harvester/triggers
08-Sep-2022 15:16:08.557 FINE [http-nio-9000-exec-4] org.apache.catalina.authenticator.AuthenticatorBase.invoke Security checking request GET /harvester/rest/harvester/processes
08-Sep-2022 15:16:08.562 FINE [http-nio-9000-exec-3] org.apache.catalina.authenticator.AuthenticatorBase.invoke Not subject to any constraint
08-Sep-2022 15:16:08.562 FINE [http-nio-9000-exec-4] org.apache.catalina.authenticator.AuthenticatorBase.invoke Not subject to any constraint
08-Sep-2022 15:16:08.563 FINER [http-nio-9000-exec-3] org.apache.catalina.core.StandardWrapper.allocate   Returning non-STM instance
08-Sep-2022 15:16:08.563 FINER [http-nio-9000-exec-4] org.apache.catalina.core.StandardWrapper.allocate   Returning non-STM instance
08-Sep-2022 15:16:08.726 FINE [http-nio-9000-exec-8] org.apache.catalina.authenticator.AuthenticatorBase.invoke Security checking request GET /harvester/rest/harvester/processes/874830c9-df0c-422e-b6a1-0d2eeecd0981
08-Sep-2022 15:16:08.726 FINE [http-nio-9000-exec-8] org.apache.catalina.authenticator.AuthenticatorBase.invoke Not subject to any constraint
08-Sep-2022 15:16:08.726 FINER [http-nio-9000-exec-8] org.apache.catalina.core.StandardWrapper.allocate   Returning non-STM instance
08-Sep-2022 15:16:08.884 FINE [http-nio-9000-exec-7] org.apache.catalina.authenticator.AuthenticatorBase.invoke Security checking request GET /harvester/rest/harvester/processes/874830c9-df0c-422e-b6a1-0d2eeecd0981
08-Sep-2022 15:16:08.884 FINE [http-nio-9000-exec-7] org.apache.catalina.authenticator.AuthenticatorBase.invoke Not subject to any constraint
08-Sep-2022 15:16:08.884 FINER [http-nio-9000-exec-7] org.apache.catalina.core.StandardWrapper.allocate   Returning non-STM instance
08-Sep-2022 15:16:14.925 FINER [Catalina-utility-2] org.apache.jasper.compiler.JspRuntimeContext.checkUnload Checking JSPs for unload in context [/harvester], JSP count: [0] queue length: [-1]
08-Sep-2022 15:16:24.965 FINER [Catalina-utility-1] org.apache.jasper.compiler.JspRuntimeContext.checkUnload Checking JSPs for unload in context [/harvester], JSP count: [0] queue length: [-1]
08-Sep-2022 15:16:34.994 FINER [Catalina-utility-1] org.apache.jasper.compiler.JspRuntimeContext.checkUnload Checking JSPs for unload in context [/harvester], JSP count: [0] queue length: [-1]
08-Sep-2022 15:16:45.044 FINE [Catalina-utility-2] org.apache.catalina.session.ManagerBase.processExpires Start expire sessions StandardManager at 1662664605044 sessioncount 0
08-Sep-2022 15:16:45.044 FINE [Catalina-utility-2] org.apache.catalina.session.ManagerBase.processExpires End expire sessions StandardManager processingTime 0 expired sessions: 0
08-Sep-2022 15:16:45.045 FINER [Catalina-utility-2] org.apache.jasper.compiler.JspRuntimeContext.checkUnload Checking JSPs for unload in context [/harvester], JSP count: [0] queue length: [-1]
08-Sep-2022 15:16:55.087 FINER [Catalina-utility-2] org.apache.jasper.compiler.JspRuntimeContext.checkUnload Checking JSPs for unload in context [/harvester], JSP count: [0] queue length: [-1]
08-Sep-2022 15:17:05.118 FINER [Catalina-utility-2] org.apache.jasper.compiler.JspRuntimeContext.checkUnload Checking JSPs for unload in context [/harvester], JSP count: [0] queue length: [-1]
08-Sep-2022 15:17:15.181 FINER [Catalina-utility-1] org.apache.jasper.compiler.JspRuntimeContext.checkUnload Checking JSPs for unload in context [/harvester], JSP count: [0] queue length: [-1]
08-Sep-2022 15:17:25.248 FINER [Catalina-utility-1] org.apache.jasper.compiler.JspRuntimeContext.checkUnload Checking JSPs for unload in context [/harvester], JSP count: [0] queue length: [-1]
08-Sep-2022 15:17:35.290 FINER [Catalina-utility-1] org.apache.jasper.compiler.JspRuntimeContext.checkUnload Checking JSPs for unload in context [/harvester], JSP count: [0] queue length: [-1]
08-Sep-2022 15:17:45.337 FINE [Catalina-utility-2] org.apache.catalina.session.ManagerBase.processExpires Start expire sessions StandardManager at 1662664665337 sessioncount 0
08-Sep-2022 15:17:45.337 FINE [Catalina-utility-2] org.apache.catalina.session.ManagerBase.processExpires End expire sessions StandardManager processingTime 0 expired sessions: 0
08-Sep-2022 15:17:45.337 FINER [Catalina-utility-2] org.apache.jasper.compiler.JspRuntimeContext.checkUnload Checking JSPs for unload in context [/harvester], JSP count: [0] queue length: [-1]
0 Kudos